Agent-Friendly
This site is built for AI agents.
When Claude, ChatGPT or your own agent crawls our site, it should understand it — without JavaScript, scraping hacks or rate-limit games. Here are the eight things we do to make that work.
Stable URLs
Every page has one canonical URL that never changes. No hash-routing tricks, no URL params for identity.
Semantic HTML
h1/h2/h3, ul/ol, table, article — no div soup. Agents parse the DOM directly.
Open Graph + Twitter Card
Fully populated on every page. Crawlers understand title, description and image on the first hit.
JSON-LD per page type
SoftwareApplication, BlogPosting, DefinedTerm — structured data lives in HTML, not after JS hydration.
llms.txt for LLM crawlers
A robots.txt-style file telling LLMs which pages help them — and which to skip.
MCP tool as an API
Instead of scraping, agents call our /research function directly via MCP. No reverse engineering required.
Plain-text pricing
Prices are readable in HTML — not hidden behind React state that renders only after a click.
OpenAPI at /docs
Machine-readable OpenAPI schema at /openapi.json. Tool integrations skip the doc-scraping detour.
Don't scrape — call our API
If your agent needs to know about our pricing or features, skip the HTML parsing detour. Connect directly to our MCP endpoint and use the tools we already maintain.
# Claude Desktop config (.json)
{
"mcpServers": {
"research-agent": {
"url": "https://research-agent.net/mcp/$YOUR_API_KEY",
"transport": "http"
}
}
} Build an agent-friendly site with us
The Research Agent helps you analyze competitors — and our skill library shows how we operate this very page.