Posts with #AI4Code
Public posts on X that use #AI4Code.
Amjad Masad @amasadIn 2018 we announced Multiplayer Mode. Since then, Replit became the world's leading collaborative editor. Today, we're announcing AI Mode, which infuses state-of-the-art intelligence into nearly all IDE features, the next major evolution for Replit:
Google AI @GoogleAICheck out a new hybrid approach that leverages both ML and rule-based semantic engines to build a Transformer-based semantic code completion model, which we show can improve developer efficiency. Read more ↓
AK @_akhaliqDemystifying GPT Self-Repair for Code Generation paper page: Large Language Models (LLMs) have shown remarkable aptitude in code generation but still struggle on challenging programming tasks. Self-repair -- in which the model debugs and fixes mistakes in its own code -- has recently become a popular way to boost performance in these settings. However, only very limited studies on how and when self-repair works effectively exist in the literature, and one might wonder to what extent a model is really capable of providing accurate feedback on why the code is wrong when that code was generated by the same model. In this paper, we analyze GPT-3.5 and GPT-4's ability to perform self-repair on APPS, a challenging dataset consisting of diverse coding challenges. To do so, we first establish a new evaluation strategy dubbed pass@t that measures the pass rate of the tasks against the total number of tokens sampled from the model, enabling a fair comparison to purely sampling-based approaches. With this evaluation strategy, we find that the effectiveness of self-repair is only seen in GPT-4. We also observe that self-repair is bottlenecked by the feedback stage; using GPT-4 to give feedback on the programs generated by GPT-3.5 and using expert human programmers to give feedback on the programs generated by GPT-4, we unlock significant performance gains.
Yiru Chen @Yiru__ChenNo programming, No learning curve! We can now generate INTERACTIVE multi-vis interfaces from NL queries! Yes! Directly from NL! Check this demo below. I will also give a talk on this next Sat in the NLVIS workshop @IEEEVIS. Paper:
