HyperAI超神经

Code Search On Codesearchnet

评估指标

Go
JS
Java
Overall
PHP
Python
Ruby

评测结果

各个模型在此基准测试上的表现结果

比较表格
模型名称GoJSJavaOverallPHPPythonRuby
graphcodebert-pre-training-code84.171.175.777.472.5 87.973.2
codet5-open-code-large-language-models-for92.470..876.177.169.875.677.7
codebert-a-pre-trained-model-for-programming69.374.886.876.070.684.070.6
text-and-code-embeddings-by-contrastive-pre97.786.094.093.496.799.886.3
text-and-code-embeddings-by-contrastive-pre97.586.594.493.597.299.985.5
codet5-open-code-large-language-models-for92.771.376.277.470.175.878.0