Make your website readable by AI search: robots.txt, llms.txt and schema
More people now ask ChatGPT, Gemini and Perplexity instead of typing into Google. If your site blocks those crawlers or explains itself badly, you will not be mentioned. At DiziGoo, a digital marketing and software compa
More people now ask ChatGPT, Gemini and Perplexity instead of typing into Google. If your site blocks those crawlers or explains itself badly, you will not be mentioned. At DiziGoo, a digital marketing and software company in Bareilly, India, we made our own site AI-friendly and these are the steps that mattered.
1. Let the AI crawlers in
Check your robots.txt. If you want to be cited in AI answers, allow the bots that fetch pages for answers, such as GPTBot, OAI-SearchBot, ChatGPT-User, PerplexityBot, ClaudeBot and Google-Extended. Also check your CDN: some platforms add their own managed robots.txt that can override yours, so open /robots.txt in a browser after every change.
2. Publish an llms.txt
llms.txt is a plain text file at the root of your site that summarises who you are, what you offer and your best pages, written for machines. Keep it factual: business name, location, services, links to guides, contact details.
3. Add structured data
Use schema.org JSON-LD for Organization, LocalBusiness, Service, FAQPage and BreadcrumbList. Keep the name, address and phone identical to your Google Business Profile. Machines trust data that matches everywhere.
4. Write plain, specific answers
AI answers quote pages that answer one question clearly. Use short headings that are real questions, answer in the first two sentences, and keep facts like services, locations and timelines in text, not only in images.
5. Build consistent mentions
Claim your Google Business Profile, Bing Places and company directories, and publish helpful articles. OpenAI has also started Businesses in ChatGPT, where a company can claim a verified profile. We have started that process too.
6. Measure
Search your brand and your service plus your city in an AI assistant once a week, and note whether you are mentioned. Fix the page that should have answered.
None of this needs a big budget, only consistency. More on how we approach AI search and SEO: https://dizigoo.com/services/seo/
By Akash Gupta, founder of DiziGoo (digital marketing, websites, software and AI automation), Bareilly and Pilibhit, India.
Originally published by Dev.to WebDev. Aggregated on AIWithGhost for educational purposes β full credit and traffic to the original publisher.