Baidu Search Scraper API
Last updated: · REST · JSON
Send GET https://proxy.scrapier.io/api/v2/baidu-search/?query=机器学习 with your key in the X-API-Key header. You get the page of results back as JSON. 1 credit per page of results; failed calls are free.
- 1 credit per page of results
- Failed calls free
- 3 parallel requests per key
Call the Baidu Search Scraper API
Use the Baidu Search Scraper API from your own apps, scripts or agents. You need a Scrapier account and the API key from your dashboard. Pick a language.
import requests# Replace YOUR_API_KEY with the key from your Scrapier dashboardAPI_KEY = "YOUR_API_KEY"params = { "query": "机器学习", "days": "0",}r = requests.get( "https://proxy.scrapier.io/api/v2/baidu-search/", headers={"X-API-Key": API_KEY}, params=params, timeout=210,)r.raise_for_status()# The result sits under data.organic_resultsresult = r.json()["data"]["organic_results"]print(result)
// Replace YOUR_API_KEY with the key from your Scrapier dashboardconst API_KEY = "YOUR_API_KEY";const params = new URLSearchParams({ query: "\u673a\u5668\u5b66\u4e60", days: "0",});const res = await fetch(`https://proxy.scrapier.io/api/v2/baidu-search/?${params}`, { headers: { "X-API-Key": API_KEY }, signal: AbortSignal.timeout(210_000),});if (!res.ok) throw new Error(`HTTP ${res.status}`);const { data } = await res.json();console.log(data.organic_results);
# One GET request. The key goes in a header, never in the URL.GET /api/v2/baidu-search/?query=机器学习&days=0 HTTP/1.1Host: proxy.scrapier.ioX-API-Key: YOUR_API_KEYAccept: application/json
# Scrapier publishes an OpenAPI spec that covers every endpoint. No API key needed.curl -O https://proxy.scrapier.io/api/v2/openapi.json# Import openapi.json into Postman, Insomnia, Bruno or a code generator,# then add your key as the X-API-Key header.
# 1. Add the Scrapier MCP server to Claude Codeclaude mcp add -t http scrapier https://mcp.scrapier.io/mcp --header "X-API-Key: YOUR_API_KEY"# 2. Ask your agent. It finds the endpoint with search_endpoints# and calls it with run_scrape:"Search Baidu for 机器学习 and list the top organic results with their links"run_scrape("baidu-search", {query: "机器学习"})
Baidu Search Scraper API in Python
Plain requests is all you need — no SDK. Every response is typed JSON.
Install
Baidu Search Scraper API in JavaScript
Works in Node 18+, Deno, Bun and edge runtimes with the built-in fetch.
Check your setup
Baidu Search Scraper API over HTTP
One GET request. Auth is a single X-API-Key header.
Check your setup
Baidu Search Scraper API OpenAPI definition
Download the spec once, then import it into the tools you already use. No key is needed to fetch it.
Download the spec
Baidu Search Scraper API over MCP
The same endpoint is a tool call for Claude Code, Cursor and Windsurf. Same query, same 1 credit per page of results.
Install
Other ways to call it
Baidu Search Scraper API Interactive Playground
Edit the request, watch the code update, then run it. Without a key it shows the catalog sample and bills nothing. With your key it makes a real call from your browser; the key goes only to proxy.scrapier.io and is never stored.
GET /api/v2/baidu-search/?query=机器学习Press Run request to send it. Without a key you get the catalog sample.
Failed calls are not billed.
The sample is the same for every input: it shows the response shape, not the account you typed.
Example response, catalog sample from 9 Nov 2026
{
"success": true,
"data": {
"query": "机器学习",
"page": 1,
"page_size": 10,
"organic_results": [
{
"title": "什么是机器学习? - 百度百科",
"link": "https://baike.baidu.com/item/%E6%9C%BA%E5%99%A8%E5%AD%A6%E4%B9%A0",
"displayed_link": "baike.baidu.com",
"snippet": "机器学习是人工智能的一个分支,它使计算机能够通过数据学习,而不是通过明确的编程指令...",
"position": 1,
"keyword": "机器学习"
}
],
"answer_box": [],
"next_cursor": "eyJoIjoiYWJjMTIzZGVmNDU2IiwicG4iOjEwLCJxIjoi5py65Zmo5a2m5LmgIiwidHAiOiIifQ"
}
}Data You Can Extract
Baidu Search Scraper extracts the organic results Baidu returns for a search phrase, one page per call: each result's title, destination link, displayed domain, snippet and position, plus the page number and the query it answered. Every field below comes from the catalog sample response, as typed JSON.
Organic result
6 fields in the response.
- title
- link
- displayed_link
- snippet
- position
- keyword
Response envelope and paging
6 fields in the response.
- success
- data.query
- data.page
- data.page_size
- data.answer_box
- data.next_cursor
Response Schema Reference
Every field in the sample response. Field names stay the same on every call.
| Field | Type | Example | Description |
|---|---|---|---|
organic_results.title | string | "什么是机器学习? - 百度百科" | Result title as Baidu shows it |
organic_results.link | string | "https://baike.baidu.com/item/%E6%9C%BA%E5%9…" | Destination URL of the result |
organic_results.displayed_link | string | "baike.baidu.com" | Domain Baidu displays under the title |
organic_results.snippet | string | "机器学习是人工智能的一个分支,它使计算机能够通过数据学习,而不是通过明确的编程指令..." | Description text under the title |
organic_results.position | integer | 1 | Rank of the result on the page, from 1 |
organic_results.keyword | string | "机器学习" | The search term that produced the row |
success | boolean | true | true on every 200 response |
data.query | string | "机器学习" | Your search term, echoed back |
data.page | integer | 1 | Page number of this response |
data.page_size | integer | 10 | Results per page |
data.answer_box | array | [] | Answer panel entries; an empty list when Baidu shows none |
data.next_cursor | string | "eyJoIjoiYWJjMTIzZGVmNDU2IiwicG4iOjEwLCJxIjo…" | Pass back as cursor for the next page; null on the last page |
Request Parameters Reference
| Name | Type | Required | Default | Description | Example |
|---|---|---|---|---|---|
query | string | Yes | — | A search phrase, one per call. Required on the first call; ignored when cursor is supplied. Aliases: queries, q, keyword | 机器学习 |
cursor | string | No | — | Pass back data.next_cursor from the previous response, unchanged, to get the next page; null means the last page | — |
time_period | string | No | — | Restrict results to a date range: stf=START,END|stftype=1 or a JSON object with start_date and end_date (camelCase startDate/endDate also accepted) | — |
days | integer | No | 0 | Shorthand for the last N days, default 0. Overrides time_period when above 0 | 0 |
use_proxy | boolean | No | true | Route through Scrapier's residential proxy pool, on by default. Leave as is | true |
raw_data | boolean | No | false | Return Baidu's raw upstream payload under raw_responses instead of the formatted items | true |
One term per call: to search ten terms, make ten calls and page each with cursor. Booleans are the strings true or false.
Pagination in the Baidu Search Scraper API
The Baidu Search Scraper API returns results in pages. Pass data.next_cursor back as cursor to get the next page; when it is null there are no more. Each successful call, first page or later, costs 1 credit.
Access Without Baidu Login
The Baidu Search Scraper API needs no Baidu account, no login and no session cookies. You send your Scrapier key in the X-API-Key header and get JSON back. It reads public data only: what any visitor sees without logging in.
Speed, Cost and Concurrency
| Metric | Value | Source |
|---|---|---|
| Cost of a successful call | 1 credit | Scrapier catalog |
| Cost of a failed call | 0 credits | Any non-2xx response |
| Parallel requests per key | 3 | Above that: 429 with Retry-After |
| Recommended client timeout | 210 seconds | Scrapier docs, every endpoint |
Latency of the Baidu Search Scraper API
Scrapier does not publish a latency or success-rate figure for this endpoint. Each call reads Baidu at call time, so response time depends on Baidu and on the size of the result. Set a client timeout of 210 seconds, as the docs recommend for every endpoint.
Limits of the Endpoint
Honest constraints of the Baidu Search Scraper API.
- Public data only.
- A failed call, for example a missing or unavailable page of results, returns a non-2xx status and costs 0 credits.
- Data is read live at call time.
- 3 parallel requests per key; above that the API answers
429withRetry-After. - Large results come in pages; pass
data.next_cursorback ascursor. - Fields Baidu does not show are not returned.
Scrapier vs the Official Baidu API
If you need a fully custom crawler or already run your own scraping stack, DIY gives more control; Scrapier suits teams that want one key and one JSON shape across many platforms.
| Feature | Scrapier Baidu scraper | DIY Baidu scraping |
|---|---|---|
| Access needed | One Scrapier API key | Your own proxies, parser and servers |
| Which data | Organic results for any keyword, as Baidu shows them | Whatever your parser extracts |
| Fields returned | 6 fields per result: title, link, displayed link, snippet, position and keyword | Whatever you build and maintain |
| Setup | Sign up, copy a key, send a request | Write selectors, handle blocks and retries |
| Cost | 1 credit per page, from $1.20 per 1,000 pages | Proxy, server and engineering time |
Errors and Retry Handling
| Status | Meaning | Billed | Fix |
|---|---|---|---|
| 200 | Page of results data returned in data.organic_results | Yes | — |
| 400 | Bad or missing input | No | Check query: one value per call |
| 401 | X-API-Key header missing | No | Add the header |
| 402 | Out of credits (body has balance) | No | Top up; retrying will not help |
| 403 | Invalid or revoked API key | No | Check the key in your dashboard |
| 429 | Throttled | No | Wait Retry-After seconds, then retry |
| 5xx | Upstream failure or timeout | No | Retry with backoff; set a 210 s client timeout |
From the error reference. Any non-2xx response costs 0 credits.
Retry logic for the Baidu Search Scraper API
import time, requests def get_search(value, key, tries=5): for attempt in range(tries): r = requests.get( "https://proxy.scrapier.io/api/v2/baidu-search/", headers={"X-API-Key": key}, params={"query": value}, timeout=210, ) if r.status_code == 429: time.sleep(int(r.headers.get("Retry-After", 2 ** attempt))) elif r.status_code >= 500: time.sleep(2 ** attempt) else: r.raise_for_status() return r.json() raise RuntimeError("gave up after retries")
Pricing and Rate Limits
| Plan | Monthly price | Pages Of Results included | Cost per 1,000 |
|---|---|---|---|
| Hobby | $29 | 15,000 | $1.93 |
| Pro | $79 | 50,000 | $1.58 |
| Scale | $299 | 250,000 | $1.20 |
Billing rules for the Baidu Search Scraper API
The Baidu Search Scraper API bills 1 credit per successful page of results. Failed calls, meaning any non-2xx status, cost 0 credits. Every plan allows 3 parallel requests per key. The free tier lets you try it before you pay.
Bulk Lookups and CSV
query takes one value per call. For a list, loop and run up to 3 requests in parallel per key, then flatten each row into one CSV line.
import csv, requests from concurrent.futures import ThreadPoolExecutor values = ["\u673a\u5668\u5b66\u4e60"] # your list def fetch(value): r = requests.get( "https://proxy.scrapier.io/api/v2/baidu-search/", headers={"X-API-Key": "YOUR_API_KEY"}, params={"query": value}, timeout=210, ) r.raise_for_status() out = r.json()["data"]["organic_results"] return out if isinstance(out, list) else [out] # 3 parallel requests per key is the limit with ThreadPoolExecutor(max_workers=3) as pool: rows = [row for part in pool.map(fetch, values) for row in part] cols = ["title", "link", "displayed_link", "snippet", "position", "keyword"] with open("out.csv", "w", newline="") as f: w = csv.DictWriter(f, fieldnames=cols, extrasaction="ignore") w.writeheader() w.writerows(rows)
CSV export from the Baidu Search Scraper API
title,link,displayed_link,snippet,position,keyword 什么是机器学习? - 百度百科,https://baike.baidu.com/item/%E6%9C%BA%E5%99%A8%E5%AD%A6%E4%B9%A0,baike.baidu.com,机器学习是人工智能的一个分支,它使计算机能够通过数据学习,而不是通过明确的编程指令...,1,机器学习
AI Agent Access via MCP
MCP for the Baidu Search Scraper API
The same endpoint is available to AI agents through the Scrapier MCP server at https://mcp.scrapier.io/mcp. One command registers it in Claude Code: claude mcp add -t http scrapier https://mcp.scrapier.io/mcp --header "X-API-Key: YOUR_API_KEY". The agent finds the endpoint with search_endpoints and calls it with run_scrape and the endpoint id baidu-search. It takes the same query input and costs the same 1 credit per page of results. Setup for every client is on the Baidu Search Scraper MCP page.
Integration Paths by Role
n8n and Make
- Add an HTTP Request step
- GET the endpoint with your
X-API-Keyheader - Map the
data.organic_resultsfields to your columns
Loop and paginate
MCP tool in your agent
Call run_scrape with endpoint baidu-search from Claude, Cursor or Windsurf. Setup is on the MCP page.
CSV and flattened JSON
Flatten each row into one CSV line, one column per field, ready for Sheets, Excel or a BI tool.
Legal and Compliance Notes
Scraping publicly available web pages is generally lawful in many countries, but the answer depends on what you collect, where you are and how you use it. In the US, hiQ Labs v. LinkedIn is the case most often cited on public-data scraping. Scrapier returns only data any visitor can see without logging in. Under GDPR and similar laws, collecting public data can be permissible, but how you store and use personal data must still comply with local data-protection rules, and Baidu's terms apply. Consult legal counsel if your use case involves bulk storage of personal data. This is not legal advice; see our Terms of Use.
Frequently Asked Questions
Is there a Baidu page of results API?
Yes. Scrapier's Baidu Search Scraper API returns any public page of results as JSON with one GET request and an X-API-Key header. No Baidu app or login.
How do I call it from Python?
Use <code>requests.get</code> on <code>https://proxy.scrapier.io/api/v2/baidu-search/</code> with <code>params={'query': '机器学习'}</code> and <code>headers={"X-API-Key": KEY}</code>. Read <code>r.json()["data"]["organic_results"]</code>.
What happens when a call fails?
Any non-200 response is free. Retry 429 and 5xx with backoff; the API already retries upstream failures.
How much does it cost?
1 credit per successful call — about $1.58 per 1,000 pages of results on the Pro plan. Failed calls are free.
Is there an OpenAPI spec?
Yes. It needs no key and covers every Scrapier endpoint.
Related Baidu APIs
Fetch public Baidu pages of results as typed JSON in one request
1 credit per page of results · failed calls free