Table of Results

LLM Name 

 Python "Hello World" 

 Python Clock 

 Python Application 

 Python Compliment App 

 Notes 

 

 

 mlfoundations-dev_-_mistral_7b_0-3_oh-dcft-v3.1-claude-3-5-haiku-20241022 

 Completed in a single pass 

 Failed 

 

 Failed 

   

 

 

 utilized Cline interface 

 

 

 llama-3.2-1b-claude-3.7-sonnet-reasoning-distilled 

 Couldn't use tools 

 

 

 

 

 

 

 llama-3.2-3b-claude-3.7-sonnet-reasoning-distilled 

 Not using the tools 

 

 

 

 

 

 

 meta-llama-3.1-8b-instruct 

 Completed in a single pass 

 

 Tried hard