Inspired by Co-Pilot recently published by GitHub and OpenAI, in this RECIPE we tried to collect some resources and guidelines about how a machine learning based source code generation can be built.
GitHub Co-Pilot is a collaboration between GitHub and OpenAI where they used open source code from GH, and GPT family of language models to auto-complete a code snippet typed in by a developer.
For a good review about what it can do and what it cannot, see this
For further details, look at the items on this RECIPE, but first, see the following as some high level points about each of the stages.
Evaluation metrics for code generation models can be match-based or functional correctness based.
Some of the resources presented on this RECIPE are sourced from HuggingFace Flax/JAX Community Week Discord