Agent-Friendly

This site is built for AI agents.

When Claude, ChatGPT or your own agent crawls our site, it should understand it — without JavaScript, scraping hacks or rate-limit games. Here are the eight things we do to make that work.

01

Stable URLs

Every page has one canonical URL that never changes. No hash-routing tricks, no URL params for identity.

02

Semantic HTML

h1/h2/h3, ul/ol, table, article — no div soup. Agents parse the DOM directly.

03

Open Graph + Twitter Card

Fully populated on every page. Crawlers understand title, description and image on the first hit.

04

JSON-LD per page type

SoftwareApplication, BlogPosting, DefinedTerm — structured data lives in HTML, not after JS hydration.

05

llms.txt for LLM crawlers

A robots.txt-style file telling LLMs which pages help them — and which to skip.

06

MCP tool as an API

Instead of scraping, agents call our /research function directly via MCP. No reverse engineering required.

07

Plain-text pricing

Prices are readable in HTML — not hidden behind React state that renders only after a click.

08

OpenAPI at /docs

Machine-readable OpenAPI schema at /openapi.json. Tool integrations skip the doc-scraping detour.

Don't scrape — call our API

If your agent needs to know about our pricing or features, skip the HTML parsing detour. Connect directly to our MCP endpoint and use the tools we already maintain.

# Claude Desktop config (.json)
{
  "mcpServers": {
    "research-agent": {
      "url": "https://research-agent.net/mcp/$YOUR_API_KEY",
      "transport": "http"
    }
  }
}

Build an agent-friendly site with us

The Research Agent helps you analyze competitors — and our skill library shows how we operate this very page.