LLMs for Engineers

Home
Archive
About
LLMs Know More Than What They Say
... and how that provides winning evals
 • 
Ruby Pai

June 2024

Pytest is All You Need
… for LLM evaluation when you have reference data and metrics.
 • 
Wenzhe Xue

January 2024

Scaling human feedback with fine-tuned open-source LLMs
Discover how Llama and Mistral can improve accuracy at scale
 • 
Wenzhe Xue

November 2023

Hybrid Evaluation: Scaling human feedback with custom evaluation models
...how to really get model based evals to work for you
 • 
Ansup Babu
 and 
Arjun Bansal

October 2023

Which Llama-2 Inference API should I use?
understanding the complete trade-offs of Llama-2 providers
 • 
Wenzhe Xue
Ready, Set, Test: Building Evaluation into Your LLM Workflow
... with llmeval
 • 
Niklas Nielsen

August 2023

How do I evaluate LLM coding agents? 🧑‍💻
...aka when can I hire an AI software engineer?
 • 
Arjun Bansal
🕵️🗺️ Where do I deploy Llama-2? 🦙🦙
We share the most cost efficient way to run Llama-2
 • 
Arjun Bansal
Llama-2 and the open source LLM 🌊
Anyone can own and run full stack LLM applications like never before
 • 
Arjun Bansal

July 2023

Evaluating LLM Agents and Applications
A lot of AI research such as HELM and BigBench has been devoted to building test suites to evaluate the accuracy of large language models.
 • 
Arjun Bansal

June 2023

Evolution of LLM Agents
...and how to avert a crisis on further progress!
 • 
Arjun Bansal
 and 
Niklas Nielsen

May 2023

3 ways to improve LLM Agent chains with debugging
Tl;dr: Cost, reliability & accuracy
 • 
Arjun Bansal
3
© 2024 Arjun Bansal
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great culture