Competitor and brand tracking
Pull the latest posts from competitor and brand accounts on a schedule, with likes, replies, reposts and views. See which posts land and how often each account posts.
- 1tweets
- 2post
- Benchmark
Profile posts, single posts, followers and following, Communities and video transcripts: every X (Twitter) endpoint Scrapier ships, each returning typed JSON in the same response envelope. Public data only.
Pick the data you need. Each endpoint takes a username, a post link or a Community ID and gives you clean JSON back, for 1 or 2 credits per successful call.
GET/api/v2/twitter-tweets/An account's posts, a page at a time, with text, like, reply, repost, quote, bookmark and view counts.
GET/api/v2/twitter-post/Posts by username or status URL, with engagement counts and the author's follower and post counts.
GET/api/v2/twitter-transcript/Speech-to-text transcript of a video post, with language and duration.
GET/api/v2/twitter-user-scraper/Accounts around a user: followers, following and retweeters, with follower counts. Takes your own X cookies.
GET/api/v2/twitter-community-info/A Community's name, member count, join policy, creator and admin. Takes your own X auth_token.
GET/api/v2/twitter-community-tweets/Posts in a Community with text, likes, reposts, replies and author. Takes your own X auth_token.
INprofileUrlAccounts that follow a profile: name, handle, bio, verified type, follower, following and post counts. Takes your own X cookies.
INusernamesAccounts a profile follows: name, handle, bio, verified type, follower and post counts, join date. Takes your own X cookies.
INuser_namesBoth lists for an account in one run: name, handle, location, bio and follower count of each. Takes your own X cookies.
INurlsReplies to a post, or the accounts that retweeted it, chosen by category. Takes your own X cookies.
INsearchQueriesPosts matching a search query, with text, likes, replies, retweets, quotes, media and author details. Takes your own X cookies.
INstartUrlsTop or latest posts for a handle or term, over an optional time window.
INliveTrending topics by position, with post volume and link, live or over the last hour to three days.
INkeywordsPublic emails found on X pages for a keyword, with the page title, description and URL of each match.
INkeywordsPublic emails on X profiles and posts that match a keyword, filtered by email domain, with the source URL.
INkeywordsPublic emails on X profile pages for a keyword and location, with the page title and URL.
INkeywordsPublic phone numbers on X pages for a keyword and country, with the dial code, page title and URL.
INkeywordsPublic phone numbers on X profiles and posts that match a keyword, with country, dial code and source URL.
INkeywordsPublic phone numbers on X profile pages for a keyword and country, with the dial code and URL.
Pick an endpoint, fill in the input and press Run. Without a key you see the catalog sample and nothing is billed. With your API key it runs a real call from your browser.
Every successful call costs 1 or 2 credits, whether the page holds one profile or a page of comments. Failed calls cost nothing. A free tier lets you try it first.
On Pro, 1,000 calls at 2 credits cost $3.16. Scale brings that to $2.39, so 125,000 X (Twitter) calls a month is $299.
See all plans →| Plan | Price / mo | Credits / mo | Per 1,000 calls |
|---|---|---|---|
| Free | $0 | Free tier | — |
| Hobby | $29 | 15,000 | $3.87 |
| Pro | $79 | 50,000 | $3.16 |
| Scale | $299 | 250,000 | $2.39 |
Built to be easy to start with, even if you've never scraped a website. Here's how to get X (Twitter) data in a few minutes:
next_cursor; pass it back as cursor for the next page.twitter-user-scraper takes your own auth_token and ct0 cookies; the Community endpoints take auth_token.X-API-Key header, or ask your AI agent over MCP.Two ways in. Use whichever matches what you already have.
You already know which accounts you want.
elonmuskYou already have the links to the pages you want.
x.com/MrBeast/status/2096285173788840001// GET /api/v2/twitter-tweets/ { "usernames": "elonmusk", "with_replies": "true", "include_user_info": "true" } // or // GET /api/v2/twitter-post/ { "usernames": "elonmusk" }
// GET /api/v2/twitter-user-scraper/ · needs your own sessionid cookie { "usernames": "elonmusk", "auth_token": "", "ct0": "", "get_retweeters": "true", "get_about": "true", "get_followers": "true", "get_following": "true", "include_unavailable_users": "true" }
// GET /api/v2/twitter-community-info/ · needs your own sessionid cookie { "communities": "1783990533192651232", "auth_token": "" } // or // GET /api/v2/twitter-community-tweets/ · needs your own sessionid cookie { "community_ids": "1783990533192651232", "auth_token": "" }
// GET /api/v2/twitter-transcript/ { "urls": "https://x.com/MrBeast/status/2096285173788840001", "translate_to_english": "false", "model_size": "small", "beam_size": "5", "vad_filter": "true", "max_duration_seconds": "900" }
| Send this | Parameter | And you can get |
|---|---|---|
| Username | usernames | The account's posts, with replies and user info on request |
| Username or post URL | usernames | Posts with engagement counts and author stats |
| Username + X cookies | usernames · auth_token · ct0 | Followers, following and retweeters |
| Community ID + X cookie | communities · auth_token | Community details, and its posts with community_ids |
| Video post URL | urls | The video's transcript, language and duration |
Optional on list endpoints: cursor (pass back next_cursor for the next page). Auth is one header: X-API-Key. Send parameters in the query string (GET) or as a JSON body (POST).
The one thing to know: each data type has its own shape. Field names stay the same on every call, so code and agents read them directly. Samples below come from the live catalog.
// GET /api/v2/twitter-tweets/?usernames=elonmusk // one item of data.tweets · catalog sample { "id": "1948167071684231344", "tweet_id": "1948167071684231344", "url": "https://x.com/BillGates/status/1948167071684231344", "verified": true, "username": "@BillGates", "fullname": "Bill Gates", "timestamp": "Wed Jul 23 23:43:19 +0000 2025", "text": "Learning how many kids were dying from diarrhea back in 1997 ... https://t.co/NYitqiRY38", "links": [ "https://gatesnot.es/46lTfBz" ], "isPinned": false, "isQuote": false, "isRetweet": false, "isReply": false, "likes": 5219, "replies": 0, "retweets": 1816, "quotes": 598, "bookmarks": 334, "views": 2828080, "lang": "en", "user": { "avatar": "https://pbs.twimg.com/profile_images/1879013694367252480/Gxa-Pspq_normal.jpg", "username": "BillGates", "userFullName": "Bill Gates", "description": "Sharing things I'm learning through my foundation work and other interests.", "location": "Seattle, WA", "website": "https://gatesnot.es/tgn", "joinDate": "Wed Jun 24 18:44:10 +0000 2009", "verified": true, "totalLikes": 542, "totalTweets": 4521, "totalFollowing": 571, "totalFollowers": 65231300, "url": "https://t.co/TiXXwOGE95", "userId": "50393960", "totalMediaCount": 1530 }, "media": [], "tweetUserId": "50393960", "input_username": "BillGates", "scraped_at": "2026-10-03T03:35:53.722Z" }
// GET /api/v2/twitter-post/?usernames=elonmusk // one item of data.tweets · catalog sample { "biography": "", "bookmarks": 16000, "date_posted": "2022-10-26T18:45:58.000Z", "description": "Entering Twitter HQ – let that sink in! https://t.co/D68z4K2wq7", "external_url": null, "followers": 241733278, "following": 1300, "hashtags": null, "id": "1585341984679469056", "input": { "url": "https://x.com/elonmusk/status/1585341984679469056/" }, "is_verified": true, "likes": 1221559, "name": "Elon Musk", "photos": null, "posts_count": 98000, "profile_image_link": "https://pbs.twimg.com/profile_images/example_normal.jpg", "quoted_post": { "date_posted": null, "description": null, "post_id": null, "profile_id": null, "profile_name": null, "url": null, "videos": null }, "quotes": 70000, "replies": 160000, "reposts": 200000, "tagged_users": null, "url": "https://x.com/elonmusk/status/1585341984679469056", "user_posted": "elonmusk", "videos": [ "https://video.twimg.com/ext_tw_video/1585341912877146112/pu/vid/1920x1080/example.mp4?tag=14" ], "views": null, "input_username": "https://x.com/elonmusk/status/1585341984679469056" }
// GET /api/v2/twitter-user-scraper/?usernames=elonmusk // one item of data.users · catalog sample { "input_source": "elonmusk", "type": "user", "username": "SpaceX", "url": "https://x.com/SpaceX", "twitter_url": "https://twitter.com/SpaceX", "id": "41903658", "name": "SpaceX", "is_verified": true, "followers": 41903658, "following": 120, "found_in_timeline_of": "elonmusk", "input_username": "elonmusk", "scraped_at": "2026-09-12T06:58:18.302Z" }
// GET /api/v2/twitter-community-info/?communities=1783990533192651232 // one item of data.community · catalog sample { "id": "1783990533192651232", "name": "C and Assembly Developers", "member_count": 62700, "is_member": false, "role": "NonMember", "join_policy": "Open", "creator_username": "tetsuoai", "admin_username": "tetsuoai" }
// GET /api/v2/twitter-community-tweets/?community_ids=1783990533192651232 // one item of data.tweets · catalog sample { "community_id": "1783990533192651232", "tweet_id": "2099740026573816254", "created_at": "Tue Sep 15 06:00:08 +0000 2026", "text": "What's stopping you from working at SpaceXAI?", "favorites": 454, "retweets": 36, "replies": 62, "screen_name": "tetsuoai", "scrapedAt": "2026-09-16T12:47:09.183Z" }
// GET /api/v2/twitter-transcript/?urls=https://x.com/MrBeast/status/2096285173788840001 // one item of data.transcript · catalog sample { "input_url": "https://x.com/MrBeast/status/2096285173788840001", "transcript": "We're in the middle of the world's deadliest show...", "language": "en", "status_id": "2096285173788840001", "video_url": "https://video.twimg.com/....mp4", "duration": 31.2, "status": "success" }
Every response is {"success": true, "data": {…}}: your input echoed back, the result under its own key (profile, posts, comments…) and next_cursor for the next page.
Public X (Twitter) data powers social listening, influencer research, competitor tracking, community research and video analysis. Here are five common jobs, and the X scraper endpoints each one chains together.
Pull the latest posts from competitor and brand accounts on a schedule, with likes, replies, reposts and views. See which posts land and how often each account posts.
Start from a known creator's posts, then map the accounts around them: followers, following and retweeters, each with a follower count. The user network endpoint takes your own X cookies.
Read what members of an X Community talk about: its size and join policy, then its latest posts with engagement. Both endpoints take your own X auth_token.
Transcribe video posts from news, sports or creator accounts and run the text through search or an LLM, so video is as searchable as text posts.
Follow posts from executives, officials and journalists, and keep a timestamped archive of every post with its counts at the time of the call.
X (Twitter) Scraper fetches clean, structured X data at low cost: built for social listening, influencer research, competitor tracking and AI agents.
Each request reads X at call time, and most responses say when in scraped_at.
Same field names on every call, counts as numbers, ready for code, sheets or an LLM.
List endpoints return next_cursor; run up to 3 requests in parallel per key.
Posts, users, Communities and transcripts share the same envelope and auth.
The Scrapier MCP server reaches every endpoint from Claude Code, Cursor, Windsurf and VS Code with one command.
Plain REST: Python, Node.js, cURL, n8n, Make, Zapier or Google Sheets.
Public data only. 3 of the 6 live endpoints need no X login; users and Communities take your own X cookies.
When X changes its pages, Scrapier updates the scraper; your field names stay the same.
1 or 2 credits per call, however many posts the page holds. Failed calls are never billed.
The official X API reads public posts, but it needs a developer account and an app, and read volume beyond the smallest tier is paid. Scrapier reads public X posts and video transcripts with one API key, at a price you know before the call runs; user lists and Communities take your own X cookies.
Any non-2xx response is free, so retries cost nothing.
At 2 credits a call; profile posts and single posts cost 1 credit. No compute units to estimate.
Profile posts, single posts and transcripts need no X developer account, app or bearer token.
The same key and JSON envelope cover Threads, Bluesky, Reddit, LinkedIn and more.
| Feature | Scrapier X (Twitter) Scraper | X API | DIY scraper |
|---|---|---|---|
| Whose data | Any public account or post | Any public account or post | Any public account |
| Setup | One API key | Developer account, app, tokens | Proxies, accounts, parsers |
| Maintenance | Handled by Scrapier | Version and policy changes | Breaks on layout changes |
| Cost | From $2.39 per 1,000 calls | Paid plans for most read volume | Servers, proxies and engineering time |
| AI agents | MCP server included | Not included | Build your own |
No. Each endpoint returns one data type. To get an account's posts and the transcript of a video post, call twitter-tweets then twitter-transcript with the post URL, or let an AI agent chain the calls over MCP.
Three of the six live endpoints. twitter-user-scraper takes your auth_token and ct0 cookies; twitter-community-info and twitter-community-tweets take auth_token. Profile posts, single posts and video transcripts need no X login.
No. Scrapier reads public data only. A protected account's posts are visible only to its approved followers, so they are not returned by any endpoint.
As many as X shows publicly. List endpoints return a page at a time with next_cursor; pass it back as cursor for the next page. Each page of profile posts is one call at 1 credit.
Yes. twitter-transcript takes a post URL with a video and returns the transcript, the detected language and the duration. Set translate_to_english to get English text, and max_duration_seconds to skip long videos.
Counts are a snapshot from the moment of the call, so likes, reposts and views keep changing after it. Some fields, such as views on older posts, can be null when X doesn't show them.
It depends on what you collect, where you are and how you use it, so this is not legal advice. Scrapier returns publicly visible data only. Some of it can be personal data under GDPR or CCPA, so collect only what you have a legitimate reason to use.
Yes. Any tool that can make an HTTP request works: n8n, Make, Zapier, Google Sheets, Airbyte or your own code. Send your key in the X-API-Key header and read the JSON response.
Yes. Run claude mcp add -t http scrapier https://mcp.scrapier.io/mcp with your key in an X-API-Key header. The agent finds the right X endpoint with search_endpoints and calls it with run_scrape, in Claude Code, Cursor or Windsurf.
Check the status code first: 401 means the X-API-Key header is missing, 403 an invalid key, 402 no credits left, 429 too many requests (wait Retry-After seconds). If it's still wrong, report it with the request and the response.
Profile posts and single posts cost 1 credit per successful call; users, Communities and transcripts cost 2. Failed calls are free. Plans: Hobby $29 for 15,000 credits, Pro $79 for 50,000, Scale $299 for 250,000, Enterprise custom. A free tier lets you try it first.
Run up to 3 requests in parallel per API key. If you go faster, the API answers 429 with a Retry-After header: wait that many seconds and retry. 429 and 5xx responses are never billed, and long-running endpoints need a client timeout of 210 seconds or more.
Use the requests library: requests.get("https://proxy.scrapier.io/api/v2/twitter-tweets/", headers={"X-API-Key": key}, params={"usernames": "BillGates"}, timeout=210). The response is JSON, so read r.json()["data"]["tweets"] directly; there is no HTML to parse. Loop over your list for more accounts.
Free API key. No sales call, no proxy setup, and failed calls are free.