AnakinScraper

What it does

AnakinScraper exposes a self-hosted scraping API that converts arbitrary web pages into readable markdown or structured JSON. It is designed to handle JavaScript-heavy single-page apps and anti-bot protections via an anti-detect browser and proxy auto-selection. The skill documents available endpoints for synchronous and asynchronous scraping, batch jobs, and job polling, plus recommended parameter usage for browser rendering and JSON extraction.

When to use it

Use AnakinScraper when you need robust extraction from pages that standard HTTP fetches fail on—product listing pages, article archives, SPA-driven content, or sites with basic anti-bot measures. Prefer the async endpoints for slow pages and batch endpoints for multiple URLs.

What's included

• Scripts: Setup/launch instructions to self-host the anakinscraper service (clone + make up).
• References: Usage guidance and parameter notes for endpoints: anakinscraper_scrape, anakinscraper_extract_json, anakinscraper_batch_scrape, anakinscraper_scrape_async, anakinscraper_get_job.
• Instructions: How to run the service locally and which endpoints to call for markdown vs structured JSON.

Compatible agents

Agents with network access and the ability to call local HTTP APIs or run containers; useful for data-extraction, research, and content migration tasks.