CrawlerData API examples

Copy-paste examples for the CrawlerData API: Google Shopping products, sellers and prices, plus Google Search, Images, News, Local and Autocomplete results as JSON.

Each example sends one live request to POST https://api.crawlerdata.com/v1/jobs and prints the result.

Setup

1. Create an account at app.crawlerdata.com. Company emails get free trial credits.
2. Create an API key in the dashboard.
3. Export it:

export CRAWLERDATA_API_KEY=your_key

Endpoints

API	endpoint	Examples	Reference
Google Shopping API	google-shopping-search	python · node · curl	docs
Google Shopping Sellers API	google-shopping-product	python · node · curl	docs
Google Shopping Product API	google-shopping-product-info	python · node · curl	docs
Google Search API	google-search	python · node · curl	docs
Google Images API	google-images	python · node · curl	docs
Google News API	google-news	python · node · curl	docs
Google Local API	google-local	python · node · curl	docs
Google Autocomplete API	google-autocomplete	python · node · curl	docs

Python examples need requests (pip install requests). Node examples need Node 18 or newer and no packages.

No-code templates

Template	What it does
Google Sheets price tracker	A CrawlerData menu in Google Sheets: list products, click Check prices now, get the lowest Google Shopping price, merchant and seller count in a History sheet. Optional daily check.
n8n: Google Shopping prices → Sheets	Daily top-5 offers for your products appended to a Google Sheet.
n8n: daily rank tracker → Sheets	Your domain's position per keyword, country and device, and whether Google's AI Overview cites you.
n8n: AI Overview monitor → Slack	A morning Slack report: which keywords show an AI Overview and whether it cites your domain.
Open WebUI tool: Google Search	Gives your Open WebUI models live Google results with the AI Overview and its sources, plus Google News.
Dify plugin: Google Search	A Dify tool plugin with Google Search (AI Overview + sources) and Google News for workflows and agents.

Setup notes for the n8n workflows are in n8n/README.md.

Full scripts

• python/google_shopping_sellers_to_csv.py searches Google Shopping, picks a product and writes every seller's price, shipping and total to CSV, with retries. Walkthrough: How to scrape Google Shopping prices with Python.

Request shape

{
  "endpoint": "google-shopping-search",
  "params": { "query": "wireless headphones", "country": "us" },
  "queue": "live"
}

• queue: live returns the result in the same response. fast and regular are async: poll GET /v1/jobs/{id} or pass a postbackUrl for a webhook. The price is the same on every queue.
• The response is { "job": { "id", "status", "credits", ... }, "result": { ... } }. Failed jobs cost 0 credits.

Pricing

1 credit per request, except Google Shopping sellers, which is 1 credit per 10 sellers returned (rounded up, minimum 1). From $1.00 per 1,000 credits down to $0.30 with larger packs, no subscription. See pricing.

Links

• Docs
• Blog
• Questions: contact@crawlerdata.com

License

MIT