代码生成
代码生成是利用多模态数据源(如不完整代码、其他编程语言的程序、自然语言描述或执行示例)预测明确的代码或程序结构的重要领域。该技术旨在辅助自动编程工具的开发,提高编程效率和生产力,具有广泛的应用前景。
MBPP
HumanEval
AgentCoder (GPT-4)
APPS
AlphaCode 1B
CoNaLa
MarianCG
Django
MarianCG
WikiSQL
NL2SQL-RULE
RES-Q
QurrentOS-coder + Claude 3.5 Sonnet
PECC
Claude 3 Haiku
WebApp1K-React
o1-preview
CodeContests
MapCoder (GPT-4)
CoNaLa-Ext
BART W/ Mined
WebApp1k-Duo-React
DSEval-LeetCode
Turbulence
GPT-4
Shellcode_IA32
CodeBERT
TACO-Code
GPT-4
BigCodeBench-Complete
BigCodeBench-Instruct
GPT-4o-2024-05-13
CodeXGLUE - CodeSearchNet
Redcoder-ext
CONCODE
Livecodebench
LPW (GPT-4o)
Verified Smart Contract Code Comments
Android Repos
Entity Type Model
FloCo
FloCo-T5
VerilogEval
Nexus (Claude 3.5 Sonnet)
Multi-Source Python Code Corpus