Twitter Profile Scraper API
Last updated: · REST · JSON
Send GET https://proxy.scrapier.io/api/v2/twitter-tweets/?usernames=elonmusk with your key in the X-API-Key header. You get the page of tweets back as JSON. 1 credit per page of tweets; failed calls are free.
- 1 credit per page of tweets
- Failed calls free
- 3 parallel requests per key
Call the Twitter Profile Scraper API
Use the Twitter Profile Scraper API from your own apps, scripts or agents. You need a Scrapier account and the API key from your dashboard. Pick a language.
import requests# Replace YOUR_API_KEY with the key from your Scrapier dashboardAPI_KEY = "YOUR_API_KEY"params = { "usernames": "elonmusk", "with_replies": "true", "include_user_info": "true",}r = requests.get( "https://proxy.scrapier.io/api/v2/twitter-tweets/", headers={"X-API-Key": API_KEY}, params=params, timeout=210,)r.raise_for_status()# The result sits under data.tweetsresult = r.json()["data"]["tweets"]print(result)
// Replace YOUR_API_KEY with the key from your Scrapier dashboardconst API_KEY = "YOUR_API_KEY";const params = new URLSearchParams({ usernames: "elonmusk", with_replies: "true", include_user_info: "true",});const res = await fetch(`https://proxy.scrapier.io/api/v2/twitter-tweets/?${params}`, { headers: { "X-API-Key": API_KEY }, signal: AbortSignal.timeout(210_000),});if (!res.ok) throw new Error(`HTTP ${res.status}`);const { data } = await res.json();console.log(data.tweets);
# One GET request. The key goes in a header, never in the URL.GET /api/v2/twitter-tweets/?usernames=elonmusk&with_replies=true&include_user_info=true HTTP/1.1Host: proxy.scrapier.ioX-API-Key: YOUR_API_KEYAccept: application/json
# Scrapier publishes an OpenAPI spec that covers every endpoint. No API key needed.curl -O https://proxy.scrapier.io/api/v2/openapi.json# Import openapi.json into Postman, Insomnia, Bruno or a code generator,# then add your key as the X-API-Key header.
# 1. Add the Scrapier MCP server to Claude Codeclaude mcp add -t http scrapier https://mcp.scrapier.io/mcp --header "X-API-Key: YOUR_API_KEY"# 2. Ask your agent. It finds the endpoint with search_endpoints# and calls it with run_scrape:"Get the latest tweets from the X profile @elonmusk"run_scrape("twitter-tweets", {usernames: "elonmusk"})
Twitter Profile Scraper API in Python
Plain requests is all you need — no SDK. Every response is typed JSON.
Install
Twitter Profile Scraper API in JavaScript
Works in Node 18+, Deno, Bun and edge runtimes with the built-in fetch.
Check your setup
Twitter Profile Scraper API over HTTP
One GET request. Auth is a single X-API-Key header.
Check your setup
Twitter Profile Scraper API OpenAPI definition
Download the spec once, then import it into the tools you already use. No key is needed to fetch it.
Download the spec
Twitter Profile Scraper API over MCP
The same endpoint is a tool call for Claude Code, Cursor and Windsurf. Same usernames, same 1 credit per page of tweets.
Install
Other ways to call it
Twitter Profile Scraper API Interactive Playground
Edit the request, watch the code update, then run it. Without a key it shows the catalog sample and bills nothing. With your key it makes a real call from your browser; the key goes only to proxy.scrapier.io and is never stored.
GET /api/v2/twitter-tweets/?usernames=elonmuskPress Run request to send it. Without a key you get the catalog sample.
Failed calls are not billed.
The sample is the same for every input: it shows the response shape, not the account you typed.
Example response, catalog sample from 9 Nov 2026
{
"success": true,
"data": {
"usernames": "BillGates",
"user_id": "50393960",
"screen_name": "BillGates",
"page": 1,
"page_size": 20,
"tweets": [
{
"id": "1948167071684231344",
"tweet_id": "1948167071684231344",
"url": "https://x.com/BillGates/status/1948167071684231344",
"verified": true,
"username": "@BillGates",
"fullname": "Bill Gates",
"timestamp": "Wed Jul 23 23:43:19 +0000 2025",
"text": "Learning how many kids were dying from diarrhea back in 1997 ... https://t.co/NYitqiRY38",
"links": [
"https://gatesnot.es/46lTfBz"
],
"isPinned": false,
"isQuote": false,
"isRetweet": false,
"isReply": false,
"likes": 5219,
"replies": 0,
"retweets": 1816,
"quotes": 598,
"bookmarks": 334,
"views": 2828080,
"lang": "en",
"user": {
"avatar": "https://pbs.twimg.com/profile_images/1879013694367252480/Gxa-Pspq_normal.jpg",
"username": "BillGates",
"userFullName": "Bill Gates",
"description": "Sharing things I'm learning through my foundation work and other interests.",
"location": "Seattle, WA",
"website": "https://gatesnot.es/tgn",
"joinDate": "Wed Jun 24 18:44:10 +0000 2009",
"verified": true,
"totalLikes": 542,
"totalTweets": 4521,
"totalFollowing": 571,
"totalFollowers": 65231300,
"url": "https://t.co/TiXXwOGE95",
"userId": "50393960",
"totalMediaCount": 1530
},
"media": [],
"tweetUserId": "50393960",
"input_username": "BillGates",
"scraped_at": "2026-10-03T03:35:53.722Z"
}
],
"next_cursor": "eyJoIjoiLi4uIiwiaW4iOiJCaWxsR2F0ZXMiLCJsdCI6IjE5MjYwNDY2MzQ0NDc1NTg1NjYiLCJwIjoyLCJyIjp0cnVlLCJzbiI6IkJpbGxHYXRlcyIsInUiOiI1MDM5Mzk2MCIsInVpIjp0cnVlfQ"
}
}Data You Can Extract
Twitter Profile Scraper extracts the tweets of an X profile from a handle, a numeric user ID or a profile URL. Every field below comes from the catalog sample response, as typed JSON.
Tweet
8 fields in the response.
- id
- tweet_id
- url
- text
- timestamp
- lang
- links
- media
Engagement
6 fields in the response.
- likes
- replies
- retweets
- quotes
- bookmarks
- views
Type flags
4 fields in the response.
- isPinned
- isQuote
- isRetweet
- isReply
Author
5 fields in the response.
- username
- fullname
- verified
- tweetUserId
- user
Input and timestamp
2 fields in the response.
- input_username
- scraped_at
Response envelope and paging
7 fields in the response.
- success
- data.usernames
- data.user_id
- data.screen_name
- data.page
- data.page_size
- data.next_cursor
Response Schema Reference
Every field in the sample response. Field names stay the same on every call.
| Field | Type | Example | Description |
|---|---|---|---|
tweets.id | string | "1948167071684231344" | Tweet ID |
tweets.tweet_id | string | "1948167071684231344" | Tweet ID (same value as id) |
tweets.url | string | "https://x.com/BillGates/status/194816707168…" | URL of the tweet |
tweets.text | string | "Learning how many kids were dying from diar…" | Text of the tweet |
tweets.timestamp | string | "Wed Jul 23 23:43:19 +0000 2025" | When the tweet was posted, as X formats it |
tweets.lang | string | "en" | Language code of the tweet |
tweets.links | array | 1 items | Links found in the tweet |
tweets.media | array | [] | Media attached to the tweet |
tweets.likes | integer | 5219 | Number of likes |
tweets.replies | integer | 0 | Number of replies |
tweets.retweets | integer | 1816 | Number of retweets |
tweets.quotes | integer | 598 | Number of quote tweets |
tweets.bookmarks | integer | 334 | Number of bookmarks |
tweets.views | integer | 2828080 | View count |
tweets.isPinned | boolean | false | true if the tweet is pinned |
tweets.isQuote | boolean | false | true if the tweet quotes another |
tweets.isRetweet | boolean | false | true if the tweet is a retweet |
tweets.isReply | boolean | false | true if the tweet is a reply |
tweets.username | string | "@BillGates" | Handle with @ |
tweets.fullname | string | "Bill Gates" | Display name of the author |
tweets.verified | boolean | true | Whether the author is verified |
tweets.tweetUserId | string | "50393960" | Numeric user ID of the author |
tweets.user | object | {…} | Author object: avatar, username, userFullName, description, location, website, joinDate, verified, totalLikes, totalTweets, totalFollowing, totalFollowers, url, userId, totalMediaCount |
tweets.input_username | string | "BillGates" | The usernames value you sent |
tweets.scraped_at | string | "2026-10-03T03:35:53.722Z" | When Scrapier read the page (ISO 8601, UTC) |
success | boolean | true | true on every 200 response |
data.usernames | string | "BillGates" | Your profile input, echoed back |
data.user_id | string | "50393960" | The resolved numeric user ID |
data.screen_name | string | "BillGates" | The resolved handle |
data.page | integer | 1 | Page number of this response |
data.page_size | integer | 20 | Tweets per page (20 in the catalog sample) |
data.next_cursor | string | "eyJoIjoiLi4uIiwiaW4iOiJCaWxsR2F0ZXMiLCJsdCI…" | Pass back as cursor for the next page; null on the last page |
Request Parameters Reference
| Name | Type | Required | Default | Description | Example |
|---|---|---|---|---|---|
usernames | string | Yes | — | An X handle, numeric user ID or profile URL. One per call. Required on the first call, ignored when cursor is set. Aliases: username, user, users, profile | elonmusk |
cursor | string | No | — | Pass back data.next_cursor from the previous response to get the next page; null means the last page | — |
with_replies | boolean | No | true | true (default) includes replies, false leaves them out. Locked in the cursor | true |
include_user_info | boolean | No | true | true (default) adds the per-tweet user object. Locked in the cursor | true |
use_proxy | boolean | No | true | Route through Scrapier's rotating residential proxy pool, since X rate-limits anonymous calls per IP. Leave as is | true |
raw_data | boolean | No | false | Return X's raw upstream payload under raw_responses instead of the formatted items | true |
One profile per call: to scan ten profiles, make ten calls and page each with cursor. Booleans are the strings true or false.
Pagination in the Twitter Profile Scraper API
The Twitter Profile Scraper API returns results in pages. Pass data.next_cursor back as cursor to get the next page; when it is null there are no more. Each successful call, first page or later, costs 1 credit.
Access Without X (Twitter) Login
The Twitter Profile Scraper API needs no X (Twitter) account, no login and no session cookies. You send your Scrapier key in the X-API-Key header and get JSON back. It reads public data only: what any visitor sees without logging in.
Speed, Cost and Concurrency
| Metric | Value | Source |
|---|---|---|
| Cost of a successful call | 1 credit | Scrapier catalog |
| Cost of a failed call | 0 credits | Any non-2xx response |
| Parallel requests per key | 3 | Above that: 429 with Retry-After |
| Recommended client timeout | 210 seconds | Scrapier docs, every endpoint |
Latency of the Twitter Profile Scraper API
Scrapier does not publish a latency or success-rate figure for this endpoint. Each call reads X (Twitter) at call time, so response time depends on X (Twitter) and on the size of the result. Set a client timeout of 210 seconds, as the docs recommend for every endpoint.
Limits of the Endpoint
Honest constraints of the Twitter Profile Scraper API.
- Public data only.
- A failed call, for example a missing or unavailable page of tweets, returns a non-2xx status and costs 0 credits.
- Data is read live at call time.
- 3 parallel requests per key; above that the API answers
429withRetry-After. - Large results come in pages; pass
data.next_cursorback ascursor. - Fields X (Twitter) does not show are not returned.
Scrapier vs the Official X (Twitter) API
The official X API is the better choice when you post or act on behalf of a user, or need data that only the account owner can see.
| Feature | Scrapier page of tweets scraper | Official X (Twitter) API |
|---|---|---|
| Access needed | One Scrapier API key | A developer account, app credentials and a plan with access limits |
| Which tweets | Any public profile's tweets, replies on or off | Depends on the endpoints and access level of your plan |
| Fields returned | 25 fields per tweet, including text, engagement and author | Depends on the fields and expansions you request |
| Rate limits | Up to 3 parallel requests per key; 429 with Retry-After | Limits set per endpoint and plan |
| Setup | Sign up, copy a key, send a request | Apply for access, create an app, manage tokens |
| Cost | 1 credit per page, from $1.20 per 1,000 pages | Set by the plan you choose |
Errors and Retry Handling
| Status | Meaning | Billed | Fix |
|---|---|---|---|
| 200 | Page of tweets data returned in data.tweets | Yes | — |
| 400 | Bad or missing input | No | Check usernames: one value per call |
| 401 | X-API-Key header missing | No | Add the header |
| 402 | Out of credits (body has balance) | No | Top up; retrying will not help |
| 403 | Invalid or revoked API key | No | Check the key in your dashboard |
| 429 | Throttled | No | Wait Retry-After seconds, then retry |
| 5xx | Upstream failure or timeout | No | Retry with backoff; set a 210 s client timeout |
From the error reference. Any non-2xx response costs 0 credits.
Retry logic for the Twitter Profile Scraper API
import time, requests def get_profile_tweets(value, key, tries=5): for attempt in range(tries): r = requests.get( "https://proxy.scrapier.io/api/v2/twitter-tweets/", headers={"X-API-Key": key}, params={"usernames": value}, timeout=210, ) if r.status_code == 429: time.sleep(int(r.headers.get("Retry-After", 2 ** attempt))) elif r.status_code >= 500: time.sleep(2 ** attempt) else: r.raise_for_status() return r.json() raise RuntimeError("gave up after retries")
Pricing and Rate Limits
| Plan | Monthly price | Pages Of Tweets included | Cost per 1,000 |
|---|---|---|---|
| Hobby | $29 | 15,000 | $1.93 |
| Pro | $79 | 50,000 | $1.58 |
| Scale | $299 | 250,000 | $1.20 |
Billing rules for the Twitter Profile Scraper API
The Twitter Profile Scraper API bills 1 credit per successful page of tweets. Failed calls, meaning any non-2xx status, cost 0 credits. Every plan allows 3 parallel requests per key. The free tier lets you try it before you pay.
Bulk Lookups and CSV
usernames takes one value per call. For a list, loop and run up to 3 requests in parallel per key, then flatten each row into one CSV line.
import csv, requests from concurrent.futures import ThreadPoolExecutor values = ["elonmusk"] # your list def fetch(value): r = requests.get( "https://proxy.scrapier.io/api/v2/twitter-tweets/", headers={"X-API-Key": "YOUR_API_KEY"}, params={"usernames": value}, timeout=210, ) r.raise_for_status() out = r.json()["data"]["tweets"] return out if isinstance(out, list) else [out] # 3 parallel requests per key is the limit with ThreadPoolExecutor(max_workers=3) as pool: rows = [row for part in pool.map(fetch, values) for row in part] cols = ["username", "fullname", "timestamp", "text", "likes", "retweets"] with open("out.csv", "w", newline="") as f: w = csv.DictWriter(f, fieldnames=cols, extrasaction="ignore") w.writeheader() w.writerows(rows)
CSV export from the Twitter Profile Scraper API
username,fullname,timestamp,text,likes,retweets @BillGates,Bill Gates,Wed Jul 23 23:43:19 +0000 2025,Learning how many kids were dying from diarrhea back in 1997 ... https://t.co/NYitqiRY38,5219,1816
AI Agent Access via MCP
MCP for the Twitter Profile Scraper API
The same endpoint is available to AI agents through the Scrapier MCP server at https://mcp.scrapier.io/mcp. One command registers it in Claude Code: claude mcp add -t http scrapier https://mcp.scrapier.io/mcp --header "X-API-Key: YOUR_API_KEY". The agent finds the endpoint with search_endpoints and calls it with run_scrape and the endpoint id twitter-tweets. It takes the same usernames input and costs the same 1 credit per page of tweets. Setup for every client is on the Twitter Profile Scraper MCP page.
Integration Paths by Role
n8n and Make
- Add an HTTP Request step
- GET the endpoint with your
X-API-Keyheader - Map the
data.tweetsfields to your columns
Loop and paginate
MCP tool in your agent
Call run_scrape with endpoint twitter-tweets from Claude, Cursor or Windsurf. Setup is on the MCP page.
CSV and flattened JSON
Flatten each row into one CSV line, one column per field, ready for Sheets, Excel or a BI tool.
Legal and Compliance Notes
Scraping publicly available X (Twitter) data is generally lawful in many countries, but the answer depends on what you collect, where you are and how you use it. In the US, hiQ Labs v. LinkedIn is the case most often cited on public-data scraping. Scrapier returns only public tweets and profile details any visitor can see without logging in. Under GDPR and similar laws, collecting public data can be permissible, but how you store and use personal data, such as names, handles or posts, must still comply with local data-protection rules, and X's terms apply. Consult legal counsel if your use case involves bulk storage of personal data. This is not legal advice; see our Terms of Use.
Frequently Asked Questions
Is there a X (Twitter) page of tweets API?
Yes. Scrapier's Twitter Profile Scraper API returns any public page of tweets as JSON with one GET request and an X-API-Key header. No X (Twitter) app or login.
How do I call it from Python?
Use <code>requests.get</code> on <code>https://proxy.scrapier.io/api/v2/twitter-tweets/</code> with <code>params={'usernames': 'elonmusk'}</code> and <code>headers={"X-API-Key": KEY}</code>. Read <code>r.json()["data"]["tweets"]</code>.
What happens when a call fails?
Any non-200 response is free. Retry 429 and 5xx with backoff; the API already retries upstream failures.
How much does it cost?
1 credit per successful call — about $1.58 per 1,000 pages of tweets on the Pro plan. Failed calls are free.
Is there an OpenAPI spec?
Yes. It needs no key and covers every Scrapier endpoint.
Fetch public X (Twitter) pages of tweets as typed JSON in one request
1 credit per page of tweets · failed calls free