LLMs Text: Sitemap For LLMs

Large Language Models (LLMs) are increasingly using web content, and they need information in a structured format.

llms.txt is a proposed standard that helps websites provide concise, easily digestible information to LLMs.

Think of it as an entry point for AI to access the key details about your site. It uses a simple markdown file located at the root of your domain ( /llms.txt).

Why Do We Need It?

LLMs struggle with standard HTML. All the navigation, ads, and JavaScript make it difficult for them to parse.

Plus, LLMs have limited context windows, so they need to get right to the point. llms.txt solves this problem by pointing them directly to the most crucial markdown content.

How Does It Work?

1. Create an /llms.txt file: This markdown file will contain a brief overview of your site and links to other markdown files with more details.

2. Provide .md versions: For pages with information relevant to LLMs, create a markdown version at the same URL but with .md added (e.g., /index.html would have a markdown version at /index.html.md).

Think of it like a sitemap for AI.

Examples in Practice

Let's look at how Svelte is doing it:

Currently, they have the following root-level files...

• /llms.txt — a listing of the available files

• /llms-full.txt — complete documentation for Svelte, SvelteKit and the CLI

• /llms-small.txt — compressed documentation for use with smaller context windows

...and package-level documentation:

• /docs/svelte/llms.txt

• /docs/kit/llms.txt

• /docs/cli/llms.txt

Real-World Impact

This isn't just for tech sites or developer-oriented SaaS or API SaaS. Consider the possibilities:

• Software libraries: LLMs can provide a structured overview of documentation, making it easier for LLMs to locate specific features or usage examples.

• Corporate sites: LLMs can outline organizational structures and key information sources.

• E-commerce sites: LLMs can outline product categories and policies.

• Personal portfolio or CV websites: LLMs could use them to help answer questions about an individual.

• Educational institutions: LLMs might use them to summarize course offerings and resources.

LLMs Txt Format Is Early

LLMs Text, like SEO, will become essential for ranking in LLM results. Before 1997, SEO didn't exist. But now it is a multi-billion dollar industry. LLMs Text along with AIO (Artificial Intelligence Optimization) might become the new SEO.

It will be critical for all types of websites from personal portfolios to SaaS.

These directories already cover sites that have already adopted the new format:

• LLMs Txt Cloud

• LLMs Txt Site

If you are building a developer-oriented SaaS, API SaaS, or AI SaaS, using LLMs Text is a must.

And if you are learning about a tool, then this is the best way to learn about all the features as you get a single-page doc.

Top Tweets of the day

1/

Wanna build startups? Be in San Fransisco. Wanna do acting? Be in Los Angeles. Wanna be a footballer? Be in Brazil. Wanna be a sprinter? Be born in Africa.

You can absolutely win from outside of your environment but it requires lots of inner motivation. Whereas if you join an environment with your desired behavior, you get to level up and win pretty darn fast as outer motivation does the trick when everyone around you is winning.

2/

The reason to ride waves is you get to make significant amount of money by just riding a trend. You don't need 10x or 100x effort.

Think of it like swimming in a Tsunami where even the worst swimmer in the world will look like a world-class swimmer. Might not live afterwards but can certainly swim upto 98ft above sea level.

3/

There's always a way around it. Think harder or use o1 to think harder for you.

Rabbit Holes

1. Using Claude to Copy Chief Your Sales Letters (Crazy Process) by Stefan Georgi

2. On willpower by Andrey

3. The Inner Workings of Twitter's Algorithm by Martin

What’d ya think of today’s newsletter? Hit ‘reply’ and let me know.

First time? Subscribe.

Follow me on X.

More Startup Spells 🪄

1. How Google stole OpenAI's spotlight (LINK)

2. The Negative Ad That Made $60k in Sales for Crayo AI (LINK)

3. Why SaaS is the Best Business Model? (LINK)

4. Paddle's 'Credit Card Fees' Hack To Increase Bottom Line (LINK)