$0.85/1000
results
Bulk X timeline export — original posts, reply history, and media-tab tweets with engagement metrics per row. Username or user ID in, structured JSON out.
Bulk X timeline export — original posts, reply history, and media-tab tweets with engagement metrics per row. Username or user ID in, structured JSON out.
Pull posts, replies, and media items from public profiles in one run — toggle each timeline independently with per-user caps.
On Scrapy.io, X Profile Posts & Replies Collector by Thunderbolt is built for apify twitter scraper workflows — run from the Store, schedule recurring jobs, or POST to thunderbolt.p.scrapy.io from your stack.
scrape_posts, scrape_replies, and scrape_media independentlymax_posts, max_replies, and max_media with engagement on every rowX (Twitter) remains a real-time signal for news, brand sentiment, and creator distribution. A apify twitter scraper job on Scrapy.io hydrates handles and queries into JSON your warehouse can diff over time.
X Profile Posts & Replies Collector is built for repeatable extraction with caps you control — the same fast, API-first model Thunderbolt is known for on other platforms.
This apify twitter scraper on Scrapy.io exports structured fields including:
For your first run, keep caps low (maxResults, maxReviews, etc.) until you validate row shape in the Output preview.
Teams discover X Profile Posts & Replies Collector while researching apify twitter scraper and related terms such as python twitter scraper, twitter scraper python, python scrape twitter, twitter scraping python. This listing is structured to answer common questions — including — with concrete Input and Output examples you can run on Scrapy.io without maintaining your own scraper infrastructure.
If you arrived from SEO or paid search, start with the Input JSON example below, run once on the free tier, then scale with schedules or the publisher API once row shape and cost look right.
Use this checklist before your first production run of X Profile Posts & Replies Collector:
maxResults, maxReviews, or equivalent limits so a full batch stays within budgetthunderbolt.p.scrapy.io/x-profile-posts-and-replies-scraper/v1/api or create a scheduled jobMost teams keep a "golden" input file in git for X Profile Posts & Replies Collector so staging and production use identical payloads. Update that file when you add keywords, targets, or communities — not the orchestration code around it.
Supply X usernames, user IDs, or profile URLs. Toggle posts, replies, and optional media timelines.
Configure the run in the Scrapy.io input form or pass JSON to the publisher API.
{
"usernames": [
"example"
],
"replyScope": "author"
}| Field | Type | Required | Description |
|---|---|---|---|
usernames | string[] | Yes | One X screen name, numeric user ID, or profile URL per line. Usernames are resolved to user IDs automatically |
replyScope | string | No | Controls which items from the Replies tab are returned |
Results appear in the Scrapy.io run Output tab. Posts, Replies, Media, and Errors tables in the run output.
Each successful row is designed for warehouse loads: stable column names, explicit error rows, and caps you control in the input form.
[
{
"type": "post",
"tweet_id": "1234567890",
"text": "Launch day thread 🚀",
"created_at": "2026-08-20T10:00:00.000Z",
"favorite_count": 240,
"retweet_count": 42
}
]Download the full dataset as JSON, CSV, or Excel from the Output tab, or fetch results programmatically via the publisher API after the run completes.
track publishing cadence and top posts
Teams usually snapshot these rows on a schedule, store a scrapedAt timestamp in their warehouse, and diff week-over-week to spot new entries or metric changes. For first-time setup, run Thunderbolt with conservative caps, validate the Output preview against your schema, then promote the same JSON to a cron or API job. Document which Output view (Posts, Comments, Reviews, etc.) your downstream models consume so new teammates can reproduce the pipeline without tribal knowledge.
archive public statements with engagement context
Teams usually snapshot these rows on a schedule, store a scrapedAt timestamp in their warehouse, and diff week-over-week to spot new entries or metric changes. For first-time setup, run Thunderbolt with conservative caps, validate the Output preview against your schema, then promote the same JSON to a cron or API job. Document which Output view (Posts, Comments, Reviews, etc.) your downstream models consume so new teammates can reproduce the pipeline without tribal knowledge.
compare reply activity across rival accounts
Teams usually snapshot these rows on a schedule, store a scrapedAt timestamp in their warehouse, and diff week-over-week to spot new entries or metric changes. For first-time setup, run Thunderbolt with conservative caps, validate the Output preview against your schema, then promote the same JSON to a cron or API job. Document which Output view (Posts, Comments, Reviews, etc.) your downstream models consume so new teammates can reproduce the pipeline without tribal knowledge.
sample media-heavy posts before creative briefs
Teams usually snapshot these rows on a schedule, store a scrapedAt timestamp in their warehouse, and diff week-over-week to spot new entries or metric changes. For first-time setup, run Thunderbolt with conservative caps, validate the Output preview against your schema, then promote the same JSON to a cron or API job. Document which Output view (Posts, Comments, Reviews, etc.) your downstream models consume so new teammates can reproduce the pipeline without tribal knowledge.
Timeline export with separate caps per surface (posts, replies, media) — prefer Thunderbolt when you need predictable cost on busy accounts.
X Profile Posts & Replies Collector is rarely the only step in a data workflow. Teams typically:
See Related Thunderbolt tools below for same-publisher companions you can chain without leaving the Scrapy.io billing account.
Most production deployments follow the same shape:
postUrl, placeId, videoId, reviewId, …) plus scrape date where history mattersX Profile Posts & Replies Collector separates successful rows from per-input errors, so staging logic can WHERE type != 'error' (or the equivalent filter for your tool) without failing the whole batch. Join across Thunderbolt tools on those stable keys to build multi-step datasets without re-scraping upstream steps.
Maintaining Facebook, LinkedIn, Instagram, or X extractors in-house means handling rate limits, HTML or API changes, proxy rotation, and observability — work that rarely differentiates your product. X Profile Posts & Replies Collector on Scrapy.io outsources that operational burden: you supply inputs, Scrapy.io runs the job, and you pay per successful row.
Thunderbolt listings add API-first, warehouse-ready documentation (clear caps, field lists, and pipeline patterns) so data teams can onboard without reading executor source code. When requirements change, update the input JSON or schedule — not your scraper fleet.
X Profile Posts & Replies Collector runs on Scrapy.io support multiple ways to get data out:
For production pipelines, most teams land JSON in object storage, normalize in dbt or Spark, and schedule recurring runs so the Store listing becomes just another data source — not a manual step.
Run X Profile Posts & Replies Collector once from the Store to validate inputs, then promote the same JSON payload to a scheduled job on Scrapy.io. Common patterns:
thunderbolt.p.scrapy.io on a queueThunderbolt tools use pay-per-result billing, so scheduled jobs stay predictable when you cap maxResults, max_posts, max_comments, or equivalent limits in the input form.
curl -X POST "https://thunderbolt.p.scrapy.io/x-profile-posts-and-replies-scraper/v1/api" \
-H "Content-Type: application/json" \
-H "X-API-Key: YOUR_API_KEY" \
-d '{
"usernames": ["nasa"],
"scrape_posts": true,
"max_posts": 100,
"scrape_replies": true,
"max_replies": 50,
"replyScope": "author"
}'Bulk runs via the scraper endpoint:
curl -X POST "https://thunderbolt.p.scrapy.io/x-profile-posts-and-replies-scraper/v1/scraper" \
-H "Content-Type: application/json" \
-H "X-API-Key: YOUR_API_KEY" \
-d '{
"usernames": ["nasa"],
"scrape_posts": true,
"max_posts": 100,
"scrape_replies": true,
"max_replies": 50,
"replyScope": "author"
}'Open the API tab on the Store listing for Python, JavaScript, cURL, OpenAPI, and MCP snippets.
X Profile Posts & Replies Collector is available through the Scrapy.io MCP server — configure your API key in Cursor, Claude Desktop, or another MCP client, then invoke the tool from agent workflows. This is useful for ad-hoc research ("scrape these ten URLs and summarize the Output") without writing boilerplate HTTP code.
For production, prefer the publisher API or scheduled runs; use MCP for exploratory analysis and internal tooling where a human or agent supplies inputs interactively. See the API tab on X Profile Posts & Replies Collector for MCP connection snippets.
| Tool | Best for |
|---|---|
| LinkedIn Profile Lead Scraper | Thunderbolt companion tool — overview |
| Instagram Profile Bulk Extractor | Thunderbolt companion tool — overview |
| X Profile Insights Extractor | Thunderbolt companion tool — overview |
Disable scrape_media unless you need the media tab — it adds volume
Use replyScope: author to reduce noise on busy accounts
Dedupe on tweet_id when merging nightly snapshots
Inspect per-row errors in the Errors output view instead of failing an entire batch
Facebook-heavy runs failing in a pattern? Use Issues on this Thunderbolt listing and attach your run ID plus one post, page, or search query
max_posts / max_repliesX Profile Posts & Replies Collector collects publicly available data only. You are responsible for complying with platform terms, applicable laws, and data-protection regulations (including GDPR when personal data is involved). Consult your legal team for your specific use case.
$0.40 per 1,000 tweets — billed per successful row on Scrapy.io. You are charged only for successfully scraped rows. See Scrapy.io pricing for plan details.
Yes. Use webhooks, scheduled runs, or the publisher API to push data into your warehouse, CRM, or automation stack.
Yes. POST to https://thunderbolt.p.scrapy.io/x-profile-posts-and-replies-scraper/v1/api with your API key. See the API tab on the Store listing for ready-made snippets.
Yes. Configure the Scrapy.io MCP endpoint with your API key to query X Profile Posts & Replies Collector from AI assistants and agent workflows.
Thunderbolt focuses on Meta and social discovery workflows — leave a Reviews note if this actor saved you from browser scraping and which Facebook surface you use daily.
Pull posts, replies, and media items from public profiles in one run — toggle each timeline independently with per-user caps.
On Scrapy.io, X Profile Posts & Replies Collector by Thunderbolt is built for apify twitter scraper workflows — run from the Store, schedule recurring jobs, or POST to thunderbolt.p.scrapy.io from your stack.
scrape_posts, scrape_replies, and scrape_media independentlymax_posts, max_replies, and max_media with engagement on every rowX (Twitter) remains a real-time signal for news, brand sentiment, and creator distribution. A apify twitter scraper job on Scrapy.io hydrates handles and queries into JSON your warehouse can diff over time.
X Profile Posts & Replies Collector is built for repeatable extraction with caps you control — the same fast, API-first model Thunderbolt is known for on other platforms.
This apify twitter scraper on Scrapy.io exports structured fields including:
For your first run, keep caps low (maxResults, maxReviews, etc.) until you validate row shape in the Output preview.
Teams discover X Profile Posts & Replies Collector while researching apify twitter scraper and related terms such as python twitter scraper, twitter scraper python, python scrape twitter, twitter scraping python. This listing is structured to answer common questions — including — with concrete Input and Output examples you can run on Scrapy.io without maintaining your own scraper infrastructure.
If you arrived from SEO or paid search, start with the Input JSON example below, run once on the free tier, then scale with schedules or the publisher API once row shape and cost look right.
Use this checklist before your first production run of X Profile Posts & Replies Collector:
maxResults, maxReviews, or equivalent limits so a full batch stays within budgetthunderbolt.p.scrapy.io/x-profile-posts-and-replies-scraper/v1/api or create a scheduled jobMost teams keep a "golden" input file in git for X Profile Posts & Replies Collector so staging and production use identical payloads. Update that file when you add keywords, targets, or communities — not the orchestration code around it.
Supply X usernames, user IDs, or profile URLs. Toggle posts, replies, and optional media timelines.
Configure the run in the Scrapy.io input form or pass JSON to the publisher API.
{
"usernames": [
"example"
],
"replyScope": "author"
}| Field | Type | Required | Description |
|---|---|---|---|
usernames | string[] | Yes | One X screen name, numeric user ID, or profile URL per line. Usernames are resolved to user IDs automatically |
replyScope | string | No | Controls which items from the Replies tab are returned |
Results appear in the Scrapy.io run Output tab. Posts, Replies, Media, and Errors tables in the run output.
Each successful row is designed for warehouse loads: stable column names, explicit error rows, and caps you control in the input form.
[
{
"type": "post",
"tweet_id": "1234567890",
"text": "Launch day thread 🚀",
"created_at": "2026-08-20T10:00:00.000Z",
"favorite_count": 240,
"retweet_count": 42
}
]Download the full dataset as JSON, CSV, or Excel from the Output tab, or fetch results programmatically via the publisher API after the run completes.
track publishing cadence and top posts
Teams usually snapshot these rows on a schedule, store a scrapedAt timestamp in their warehouse, and diff week-over-week to spot new entries or metric changes. For first-time setup, run Thunderbolt with conservative caps, validate the Output preview against your schema, then promote the same JSON to a cron or API job. Document which Output view (Posts, Comments, Reviews, etc.) your downstream models consume so new teammates can reproduce the pipeline without tribal knowledge.
archive public statements with engagement context
Teams usually snapshot these rows on a schedule, store a scrapedAt timestamp in their warehouse, and diff week-over-week to spot new entries or metric changes. For first-time setup, run Thunderbolt with conservative caps, validate the Output preview against your schema, then promote the same JSON to a cron or API job. Document which Output view (Posts, Comments, Reviews, etc.) your downstream models consume so new teammates can reproduce the pipeline without tribal knowledge.
compare reply activity across rival accounts
Teams usually snapshot these rows on a schedule, store a scrapedAt timestamp in their warehouse, and diff week-over-week to spot new entries or metric changes. For first-time setup, run Thunderbolt with conservative caps, validate the Output preview against your schema, then promote the same JSON to a cron or API job. Document which Output view (Posts, Comments, Reviews, etc.) your downstream models consume so new teammates can reproduce the pipeline without tribal knowledge.
sample media-heavy posts before creative briefs
Teams usually snapshot these rows on a schedule, store a scrapedAt timestamp in their warehouse, and diff week-over-week to spot new entries or metric changes. For first-time setup, run Thunderbolt with conservative caps, validate the Output preview against your schema, then promote the same JSON to a cron or API job. Document which Output view (Posts, Comments, Reviews, etc.) your downstream models consume so new teammates can reproduce the pipeline without tribal knowledge.
Timeline export with separate caps per surface (posts, replies, media) — prefer Thunderbolt when you need predictable cost on busy accounts.
X Profile Posts & Replies Collector is rarely the only step in a data workflow. Teams typically:
See Related Thunderbolt tools below for same-publisher companions you can chain without leaving the Scrapy.io billing account.
Most production deployments follow the same shape:
postUrl, placeId, videoId, reviewId, …) plus scrape date where history mattersX Profile Posts & Replies Collector separates successful rows from per-input errors, so staging logic can WHERE type != 'error' (or the equivalent filter for your tool) without failing the whole batch. Join across Thunderbolt tools on those stable keys to build multi-step datasets without re-scraping upstream steps.
Maintaining Facebook, LinkedIn, Instagram, or X extractors in-house means handling rate limits, HTML or API changes, proxy rotation, and observability — work that rarely differentiates your product. X Profile Posts & Replies Collector on Scrapy.io outsources that operational burden: you supply inputs, Scrapy.io runs the job, and you pay per successful row.
Thunderbolt listings add API-first, warehouse-ready documentation (clear caps, field lists, and pipeline patterns) so data teams can onboard without reading executor source code. When requirements change, update the input JSON or schedule — not your scraper fleet.
X Profile Posts & Replies Collector runs on Scrapy.io support multiple ways to get data out:
For production pipelines, most teams land JSON in object storage, normalize in dbt or Spark, and schedule recurring runs so the Store listing becomes just another data source — not a manual step.
Run X Profile Posts & Replies Collector once from the Store to validate inputs, then promote the same JSON payload to a scheduled job on Scrapy.io. Common patterns:
thunderbolt.p.scrapy.io on a queueThunderbolt tools use pay-per-result billing, so scheduled jobs stay predictable when you cap maxResults, max_posts, max_comments, or equivalent limits in the input form.
curl -X POST "https://thunderbolt.p.scrapy.io/x-profile-posts-and-replies-scraper/v1/api" \
-H "Content-Type: application/json" \
-H "X-API-Key: YOUR_API_KEY" \
-d '{
"usernames": ["nasa"],
"scrape_posts": true,
"max_posts": 100,
"scrape_replies": true,
"max_replies": 50,
"replyScope": "author"
}'Bulk runs via the scraper endpoint:
curl -X POST "https://thunderbolt.p.scrapy.io/x-profile-posts-and-replies-scraper/v1/scraper" \
-H "Content-Type: application/json" \
-H "X-API-Key: YOUR_API_KEY" \
-d '{
"usernames": ["nasa"],
"scrape_posts": true,
"max_posts": 100,
"scrape_replies": true,
"max_replies": 50,
"replyScope": "author"
}'Open the API tab on the Store listing for Python, JavaScript, cURL, OpenAPI, and MCP snippets.
X Profile Posts & Replies Collector is available through the Scrapy.io MCP server — configure your API key in Cursor, Claude Desktop, or another MCP client, then invoke the tool from agent workflows. This is useful for ad-hoc research ("scrape these ten URLs and summarize the Output") without writing boilerplate HTTP code.
For production, prefer the publisher API or scheduled runs; use MCP for exploratory analysis and internal tooling where a human or agent supplies inputs interactively. See the API tab on X Profile Posts & Replies Collector for MCP connection snippets.
| Tool | Best for |
|---|---|
| LinkedIn Profile Lead Scraper | Thunderbolt companion tool — overview |
| Instagram Profile Bulk Extractor | Thunderbolt companion tool — overview |
| X Profile Insights Extractor | Thunderbolt companion tool — overview |
Disable scrape_media unless you need the media tab — it adds volume
Use replyScope: author to reduce noise on busy accounts
Dedupe on tweet_id when merging nightly snapshots
Inspect per-row errors in the Errors output view instead of failing an entire batch
Facebook-heavy runs failing in a pattern? Use Issues on this Thunderbolt listing and attach your run ID plus one post, page, or search query
max_posts / max_repliesX Profile Posts & Replies Collector collects publicly available data only. You are responsible for complying with platform terms, applicable laws, and data-protection regulations (including GDPR when personal data is involved). Consult your legal team for your specific use case.
$0.40 per 1,000 tweets — billed per successful row on Scrapy.io. You are charged only for successfully scraped rows. See Scrapy.io pricing for plan details.
Yes. Use webhooks, scheduled runs, or the publisher API to push data into your warehouse, CRM, or automation stack.
Yes. POST to https://thunderbolt.p.scrapy.io/x-profile-posts-and-replies-scraper/v1/api with your API key. See the API tab on the Store listing for ready-made snippets.
Yes. Configure the Scrapy.io MCP endpoint with your API key to query X Profile Posts & Replies Collector from AI assistants and agent workflows.
Thunderbolt focuses on Meta and social discovery workflows — leave a Reviews note if this actor saved you from browser scraping and which Facebook surface you use daily.