Skip to main content

Table of Results

LLM Name Python "Hello World" Python Clock Python Application Python Compliment App Notes
mlfoundations-dev_-_mistral_7b_0-3_oh-dcft-v3.1-claude-3-5-haiku-20241022 Completed in a single pass Failed

Failed

 


utilized Cline interface
llama-3.2-1b-claude-3.7-sonnet-reasoning-distilled Couldn't use tools



llama-3.2-3b-claude-3.7-sonnet-reasoning-distilled Not using the tools



meta-llama-3.1-8b-instruct Completed in a single pass

Tried hard

Â