- Startup Spells 🪄
- Posts
- How OpenRouter's LLM Rankings Helps You Pick the Best LLM for Any Job
How OpenRouter's LLM Rankings Helps You Pick the Best LLM for Any Job
PLUS: Cursor Co-Founder Aman Sanger on the Journey from 0-$100M in 12 Months
How OpenRouter's LLM Rankings Helps You Pick the Best LLM for Any Job
OpenRouter’s comprehensive rankings let you compare language models across 12 categories, including Programming, Translation, Marketing, Roleplay, and more.

LLM Rankings - Programming
Track Model Performance Across Timeframes
OpenRouter provides insights into how models perform over different periods. Here’s a breakdown for the Programming category:
Daily Leaders: Claude 3.7 Sonnet Stays on Top
While Gemini 2.5 Pro is gaining ground, Claude 3.7 Sonnet remains the top performer of the day. This consistency highlights Claude's reliability for programming tasks.

Openrouter Rankings - Top Of The Day
Weekly Winners: GPT-4o-mini Dominates Despite Quasar Alpha’s Brief Appearance
GPT-4o-mini took the weekly crown, even as Quasar Alpha (OpenAI’s Q* model) briefly appeared as a free option before disappearing. This shows how quickly the landscape can shift.

Openrouter Rankings - Top Of The Week
Note that Quasar Alpha was offered as a free model for a while hence the heavy usage.
Monthly Masters: Claude 3.7 Sonnet Leads the Pack
Claude 3.7 Sonnet topped the monthly rankings, proving its sustained performance in Programming tasks.

Openrouter Rankings - Top Of The Month
Trending Models: Optimus Alpha Gains Momentum
Newer free models like Optimus Alpha are trending, offering a glimpse into cutting-edge technology without any cost.

Openrouter Rankings - Trending
Free Access to Next-Gen Models: Limited-Time Opportunities
OpenRouter occasionally offers free access to next-generation models.
For instance, Quasar Alpha was available for 4 days, seeing significant user adoption before it was removed.
Currently, Optimist Alpha is free to use, though it will be a paid model when officially released. This is your chance to test futuristic LLMs at no cost.
Task-Specific Excellence: Find the Best Model for Your Needs
OpenRouter’s rankings help you identify which model excels at specific tasks. For example, in Translation, Google’s models dominate the rankings, which makes sense given Google Translate’s long-standing presence in the field.

Openrouter Rankings - Translation
Similarly, you can find the best models for tasks like Legal, Health, Marketing, or even Roleplay by checking their respective rankings.
Simply get started in 3 simple steps:
Create an OpenRouter account to access the platform.
Add $5 in credits to start testing models.
Grab an API key and begin experimenting with the models.
There’s a lot of untapped potential on scouring the rankings on OpenRouter once per day to find out the next best model and building a product around it.
Top Tweets of the day
1/
The food industry is the lead gen of diseases for the pharma industry.
Every big business needs a lead gen, and creation and production of new customers. This is how it's done at scale. One industry lead gens for the other.
— Alen Sultanic (@IAmAlenSultanic)
1:08 PM • Aug 23, 2023
Figure out which industries will always exist and build for them. Recession-free industries have the best businesses.
2/
Now:
- $40M revenue
- Still 100% bootstrapped
- 5.1M email subs
- Team size: ~18 ($2.2M/employee)
- Traffic: 10M/mo
- Growth: SEO, Paid ads, and YouTube
- Fancy new HQ in South Dakota— Matt Paulson (@MattPaulsonSD)
12:58 AM • Nov 14, 2024
Marketbeat is one of the well-executed newsletters. Anything finance-related is money-making. The closest you are to money, the more money you can make.
3/
Stop looking at hook rate and start thinking of your hook as a filtration mechanism
You don't just want anyone to stop scrolling
You want the RIGHT eyeballs on your ad
Ways to do this:
- Call out specific problems in the opening line/caption/visual- - Call out specific
— Sufian (@sufianszn)
4:04 PM • Nov 9, 2024
Laurel Portié has a topic in her book stating exactly this.
Rabbit Holes
What’d ya think of today’s newsletter? Hit ‘reply’ and let me know.
Do me a favor and share it in your company's Slack #marketing channel.
First time? Subscribe.
Follow me on X.
Reply