StarCoder, the hottest new Open Source code-completion LLM, is based on GPT-2 architecture and trained on The Stack – which contains an insane amount of permissive code.
Star Coder shows how open source AI is advancing fast. The model may not match GPT-4 but it highlights how the community is gaining capabilities that are on pace to match industry titans such as Google and OpenAI!
Overall, Star Coder is a solid model for code completion!
Check it out – it's totally open source!
Blog:
Paper:
#llm #generativeai #huggingface #starcoder