Self-improving LLM Applications
AI that optimizes LLM applications by tuning prompts and models
AI-powered LLMOps for developers
From development to production across data management, evals & fine-tuning.
- Manage LLM Data
Log all your LLM calls to compare and find the best prompts, store feedback, collect latency & usage metrics. Perform analytics & compliance monitoring of LLM apps
- Evaluate
Integrate Log10's GitHub app into your CI/CD workflow to continuously monitor the health of your LLM apps. Get notified when anomalies are detected. Option to run locally via cli
- Optimize
Optimize your LLM app via a rich debugger, automatic evaluations, and AI-powered tuning of prompts and models
Integrate Log10 with a single line of code
Easy programmatic integration
Just call log10(openai) and use the OpenAI client library as before
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
from log10.load import log10
import openai
log10(openai)
completion = openai.ChatCompletion.create(
model="gpt-3.5-turbo",
messages=[
{
"role": "system",
"content": "You are the most knowledgable Star Wars guru on the planet"
},
{
"role": "user",
"content": "Write the time period of all the Star Wars movies and spinoffs?"
}
]
)Monitor via web dashboard
Debug, compare and improve prompts & models
- Stats
- Get latency, cost & stats for each request
- Feedback
- Collect feedback for model fine-tuning
- Organize
- with full text search, tags and filters
- Sessions & Color highlighting
- Color highlighting for Chains
- Create playgrounds from logs
- experiment with new prompts and models
Accelerate generative AI development,
with faster time to market.
Build LLM-powered apps 10x faster and more reliably with Log10
Meet the founders
We're passionate about AI and are committed to its safe, reliable & productive use
Arjun Bansal
CEO & Co-founder
Arjun's career spans research in brain-machine interfaces, building AI processors and AI sidekicks. He previously co-founded Nervana Systems (acq. Intel for $408M) and XOKind (an AI travel agent startup). He was a VP for AI Software & Research at Intel where he launched and led several open source AI projects and enterprise engagements.
Niklas Nielsen
CTO & Co-founder
Nik was most recently Head of Product at MosaicML (acq. Databricks for $1.3B). Prior to that he worked at Intel and Mesosphere on building Distributed Systems, and at Adobe on the Virtual Machines and Compilers team. He co-founded CustomerDB, a startup applying AI to product management.