Any website to clean Markdown, one API call.
Scrape any URL into LLM-ready Markdown with the boilerplate stripped, map every link on a site, or crawl whole sections to Markdown page by page. The web half of the same API that transcribes YouTube, TikTok, Instagram, X, and Facebook.
100 free credits · no credit card required
curl -X POST https://transcriptfetch.com/api/v1/web \
-H "Authorization: Bearer tf_live_..." \
-H "Content-Type: application/json" \
-d '{"url": "https://example.com/article"}'{
"ok": true,
"data": {
"kind": "web",
"url": "https://example.com/article",
"title": "Example article",
"markdown": "# Example article\n\nClean, boilerplate-free content ...",
"metadata": { "author": "Jane Doe", "date": "2026-01-15" }
},
"usage": { "credits_spent": 1 }
}Scrape: URL to Markdown
One page in, clean Markdown out - navigation, ads, cookie banners, and boilerplate removed. Plus title, author, date, and site metadata.
Map & crawl whole sites
/web/map lists every link on a site (sitemap included); /web/crawl walks same-site pages and returns Markdown for each - 1 credit per page.
Made for LLM pipelines
Markdown is the format LLMs read best. Feed docs sites, blogs, or competitor pages straight into RAG, agents, and analysis - no scraper to maintain.
Frequently asked questions
How do I convert a website to Markdown?
POST the URL to /api/v1/web and you get the page's main content back as clean Markdown plus metadata. Agents can do the same via the scrape_url tool on our MCP server.
Can I crawl a whole site?
Yes - /api/v1/web/crawl walks same-site links breadth-first and returns clean Markdown for up to 25 pages per call, billing 1 credit per page actually returned. /api/v1/web/map lists a site's URLs first so you can target what to crawl.
How is boilerplate removed?
Content extraction identifies the main article/body of the page and drops navigation, sidebars, ads, footers, and cookie banners - so what reaches your LLM is the content, not the chrome.
How much does it cost?
1 credit per page scraped or mapped, with 100 free credits on signup and no credit card required. Failed fetches aren't charged.
Also available: YouTube Transcript API · TikTok · Instagram · X (Twitter) · Facebook · Website to Markdown