SEO resources tools, studies, guides Every resource we publish, sorted by the question it answers.
MoxSEO’s SEO resources are free to use: 18 diagnostic tools for technical SEO and AI search, three original studies with downloadable datasets (506 domains, 243 homepages, 148 businesses), practical guides from the 156-article blog, and a public methodology and corrections log. Start with the question you need answered, then pick the resource built for it.
| Resource | Answers | Count |
|---|---|---|
| Tools | Is this issue on my page right now? | 18 |
| Studies | How common is this across the web? | 3 |
| Guides | How do I fix it? | 156 |
| Glossary | What does this term mean? | 12 |
| Case studies | What happened in one real project? |
- free diagnostic tools for SEO and AI search
- 18
- original studies, each with a CSV of every row
- 3
- articles on the blog, each with a named author
- 156
- terms defined in the glossary below
- 12
Which resource answers your question?
A checker can identify an observable issue; research can show whether a pattern appears across a defined sample; a case study can describe one project; and a service page can explain how a team addresses the system. Use the right evidence for the question instead of treating every resource as the same kind of proof.
Diagnostic tools
Run focused checks
Free utilities for technical SEO, AI crawler access, answer extractability, schema, internal links and entity signals. Each one checks one observable thing on one page or domain. Tools remain independent utilities.
Original research
Inspect published findings
Samples, collection windows, measured observations, interpretations and limitations, with a CSV of every row. Read each claim with its documented context.
Project evidence
Understand work in context
Project constraints, implementation choices, recorded outcomes and measurement boundaries for selected client work.
Guides
Learn how to fix it
Practical articles across SEO, AI search, content, WordPress engineering and web development. 156 so far, each signed by its author.
Method and corrections
Check how evidence is governed
How questions are scoped, observations reviewed, limitations reported and material errors corrected.
Service guidance
Move from evidence to capability
Connect the problem you observed to SEO, content, marketing, design and engineering work.
People and process
See who owns the work
Documented team members, and how responsibility moves from diagnosis to validated delivery.
Tool, study, case study or guide: what can each one prove?
Each kind of resource answers a different question, and none of them answers all of them.
| Resource | Answers | Cannot tell you | Example |
|---|---|---|---|
| Diagnostic tool | Is this specific issue present on my page or domain today? | How common the issue is, or whether fixing it will move rankings. | AI Crawler Access Checker: is GPTBot allowed by my robots.txt? |
| Original study | How often a pattern appears across a defined, published sample. | What is true of your own site. | Study 01: 104 of 506 sites block at least one AI crawler. |
| Case study | What happened in one project, under its constraints. | That the same result will repeat on another site. | Dermacian: +340% organic patient growth. |
| Guide | How to diagnose or fix a known problem. | Which problem matters most on your site. | How to audit your own robots.txt for AI crawler access. |
| Service page | How a team would handle the whole system. | Proof of results on its own. | Services directory. |
18 free tools, one check each
Grouped by the job they do. Run them on any public URL; results describe what the tool could observe at that moment.
Open the tools directoryAI search and crawlers 8
- AI Crawler Access CheckerSee whether robots.txt allows or blocks GPTBot, ClaudeBot, PerplexityBot, Google-Extended and other AI crawlers.
- AI Answer Extractability CheckerScore whether a page is structured so ChatGPT Search, Perplexity and Claude can lift and credit an answer.
- AI Fetch Timeout Risk CheckerMeasure response time, status and HTML weight for live AI fetcher user agents.
- Common Crawl Visibility CheckerCheck recent Common Crawl index visibility and directional page coverage for a domain.
- llms.txt Generator and ValidatorCreate or validate an llms.txt file that points language models to your key pages.
- Agentic Resource Discovery CheckerValidate the agent-facing catalogue discovery signals a public website exposes.
- Agent and Tool SearchSearch public capability registries for agents, tools and running spaces.
- Open Knowledge Bundle GeneratorExtract page knowledge into a portable Markdown bundle (generated, not verified).
Technical and on-page 5
- On-Page SEO Audit and Indexability CheckerCheck title tags, meta descriptions, canonicals, robots directives and heading hierarchy.
- Internal Link FinderAnalyse internal link distribution, anchor text and orphan page opportunities.
- Schema Markup ValidatorValidate Organization, FAQPage, Article, Product and LocalBusiness JSON-LD.
- Hreflang ValidatorInspect hreflang annotations, return tags and language codes across versions.
- Meta Tag GeneratorWrite titles, meta descriptions and Open Graph tags, with a title pixel-width check.
Entities and knowledge graph 3
- Knowledge Panel Readiness CheckerReview public corroboration signals for a person, brand or organisation.
- Person and Organization Schema GeneratorGenerate clean JSON-LD for Person and Organization entities.
- Google Entity Profile Link GeneratorNormalise a KGMID and create a stable Google entity result link.
Three studies, data attached
How websites look to AI systems: which crawlers they let in, whether a page offers an answer an AI can lift, and whether a business signs its work.
Open the research hub-
The web is blocking AI training, not AI search
robots.txt of 506 top sites, 14 AI crawlers. GPTBot is blocked 1.95 times as often as OpenAI’s own search crawler.
Ashish Khan
-
Only 3% of top websites are structurally quotable by AI
243 homepages scored on nine weighted checks; the median was 45 out of 100.
Sakshi Kumari
-
We scanned 148 businesses in 20 cities. Only 16% sign their work.
Structured data is close to universal at 85.1%; declaring an author and a date sits at 16.2%.
Ashish Khan
Start here: guides worth reading first
Practical guides chosen from the 156-article archive, each tied to a tool or a study above.
Browse all 156 articles-
AI search
How to audit your own robots.txt for AI crawler accessFourteen AI crawlers, what each one does, and how to decide which to allow.
Ashish Khan -
AI search
Why your website is failing the AI extractability test, and how to check itWhat the extractability checks look for on a page, and how to run them on your own site.
Aditya Bhimrajka -
Technical SEO
Schema markup guide: how to unlock rich results in Google
Sakshi Kumari -
Technical SEO
Core Web Vitals guide: how to improve LCP, CLS and INP
Sakshi Kumari -
Research
Keyword research guide: how to find the right keywords for SEO
Ashish Khan -
Local SEO
Local SEO guide: how to rank your business in the local pack
Yash Narayan -
WordPress
WordPress SEO checklist: 32 steps to improve rankings
Sakshi Kumari -
Method
Publishing your mistakes: why we run a corrections logTwo discarded scan runs and a scoring error, and why documenting them makes the rest of the data usable.
Sakshi Kumari
Newest on the blog
Glossary: terms we use
Short definitions of the terms that come up across our tools, studies and guides, each linked to where we go deeper.
- AI crawler
A bot that fetches web pages for an AI company. Training crawlers such as GPTBot and ClaudeBot collect text to train models; retrieval crawlers such as OAI-SearchBot and Claude-SearchBot fetch pages to cite in answers. In our study of 506 sites, training crawlers were blocked about twice as often.
- robots.txt
A plain-text file at the root of a domain that tells crawlers which paths they may fetch, defined in RFC 9309. It states a policy; it does not enforce it.
- Answer extractability
How easily an AI system can lift a self-contained, attributable passage from a page: a direct answer near the top, clear headings, lists or tables, and a declared author and date. Only 3% of the 243 top homepages we scored were structurally quotable.
- llms.txt
A proposed Markdown file at /llms.txt that summarises a site and points language models to its most useful pages (llmstxt.org). It is a community proposal, not a standard that search engines have adopted.
- Structured data
Machine-readable labels, usually JSON-LD using the Schema.org vocabulary, that describe what a page is about: an organisation, an article, a product, an FAQ. Google explains how it uses them in its structured data guide.
- Hreflang
An annotation that tells search engines which language or regional version of a page to show. Every version must link back to the others; Google documents the rules in its localised versions guide.
- Canonical tag
A link element that names the preferred URL among duplicate or near-duplicate pages. Search engines treat it as a strong hint, not a directive.
- Crawl budget
How many URLs a search engine will crawl on a site in a given period, shaped by how fast the server responds and how much demand there is for its pages. Google says it mainly matters for very large or fast-changing sites (Google Search Central).
- Orphan page
A URL that no other page on the site links to, so crawlers and visitors can only reach it from a sitemap or an external link.
- NAP consistency
Whether a business’s name, address and phone number match across its website, Google Business Profile and local directories.
- Knowledge panel
The entity box Google can show for a well-corroborated person, brand or organisation, drawn from its Knowledge Graph.
- Common Crawl
A non-profit that publishes a free, open archive of web crawl data (commoncrawl.org), widely used to build AI training datasets.
Questions about these resources
What SEO resources does MoxSEO offer for free?
MoxSEO publishes 18 free diagnostic tools, three original studies with their CSV datasets, practical guides on the blog, this glossary, a research methodology and a public corrections log. Paid work only starts under a written agreement; everything on this page can be used without one.
Which free SEO tool should I run first?
If pages are missing from Google, start with the On-Page SEO Audit and Indexability Checker. If you want AI assistants to cite you, start with the AI Crawler Access Checker, then the AI Answer Extractability Checker. Each one checks a single page or domain and shows what it found.
How is a study different from a tool result?
A tool result describes your page as it is today. A study measures how often a pattern appears across a defined sample, such as robots.txt files from 506 top domains, and publishes its method and limitations. Use a study for context and a tool for your own site.
Can I reuse MoxSEO research data?
Each study links a CSV with one row per site. The city-market dataset is published under CC BY 4.0, which allows reuse with attribution. For the other datasets, check the terms stated on the study page and cite the study as the source.
How do I report an error in a resource?
Email editorial@moxseo.com with the page address and the correction. Material errors are fixed and recorded in the public corrections log, following the process set out in the research methodology.
Do the tools or guides guarantee better rankings?
No. Articles, studies and tools provide general information, and tool outputs depend on the data available at the time. Search engines and AI platforms are outside MoxSEO’s control, so no ranking, traffic or revenue outcome is guaranteed.
Who maintains these resources?
Sakshi Kumari and Ashish Khan, the SEO specialists who run MoxSEO, authored the three studies and review this hub. Every blog article names its author, and the methodology explains how studies are scoped, reviewed and corrected.
Not sure which one fits? Ask the people who built them.
A free 30-minute call with Sakshi Kumari or Ashish Khan. Bring the tool result or study finding you want to act on, and your numbers.
A call is not an engagement, and we never guarantee rankings.