PLDI 2022 (series) / MAPS 2022 (series) / The 6th Annual Symposium on Machine Programming /
Productivity Assessment of Neural Code Completion
Mon 13 Jun 2022 11:15 - 11:30 at Boardroom - Morning II Chair(s): Satish Chandra
Mon 13 Jun 2022 23:15 - 23:30 at Boardroom - Morning II
Mon 13 Jun 2022 23:15 - 23:30 at Boardroom - Morning II
Neural code synthesis has reached a point where snippet generation is accurate enough to be considered for integration into human software development workflows. Commercial products aim to increase programmers’ productivity, without being able to measure it directly. In this case study, we asked users of OurTool (anonymized for review) about its impact on their productivity, and sought to find a reflection of their perception in directly measurable user data. We find that the rate with which shown suggestions are accepted, rather than more specific metrics regarding the persistence of completions in the code over time, drives developers’ perception of productivity.
Mon 13 JunDisplayed time zone: Pacific Time (US & Canada) change
Mon 13 Jun
Displayed time zone: Pacific Time (US & Canada) change
10:30 - 12:00 | |||
10:30 45mKeynote | Improving Software Reliability using Machine Learningvirtual MAPS Baishakhi Ray Columbia University | ||
11:15 15mTalk | Productivity Assessment of Neural Code Completion MAPS Albert Ziegler GitHub, Eirini Kalliamvakou GitHub, X. Alice Li GitHub, Andrew Rice GitHub, Devon Rifkin GitHub, Shawn Simister GitHub, Ganesh Sittampalam GitHub, Eddie Aftandilian GitHub Pre-print | ||
11:30 15mTalk | Predictive Synthesis of API-Centric Code MAPS Daye Nam CMU, Carnegie Mellon University, Baishakhi Ray Columbia University, Seohyun Kim Meta, xianshan qu , Satish Chandra Facebook Pre-print | ||
11:45 15mTalk | From Perception to Programs: Regularize, Overparameterize, and Amortize MAPS |
22:30 - 00:00 | |||
22:30 45mKeynote | Improving Software Reliability using Machine Learningvirtual MAPS Baishakhi Ray Columbia University | ||
23:15 15mTalk | Productivity Assessment of Neural Code Completion MAPS Albert Ziegler GitHub, Eirini Kalliamvakou GitHub, X. Alice Li GitHub, Andrew Rice GitHub, Devon Rifkin GitHub, Shawn Simister GitHub, Ganesh Sittampalam GitHub, Eddie Aftandilian GitHub Pre-print | ||
23:30 15mTalk | Predictive Synthesis of API-Centric Code MAPS Daye Nam CMU, Carnegie Mellon University, Baishakhi Ray Columbia University, Seohyun Kim Meta, xianshan qu , Satish Chandra Facebook Pre-print | ||
23:45 15mTalk | From Perception to Programs: Regularize, Overparameterize, and Amortize MAPS |