Twitter Post Scraper (by Profile URL)

What does Twitter Post Scraper (by Profile URL) do?

Twitter Post Scraper (by Profile URL) extracts recent tweets from any public Twitter/X profile. Provide one or more profile URLs and it will fetch the latest posts along with engagement metrics and author details.

• Scrape recent tweets from any public Twitter/X profile by URL
• Extract engagement data: likes, views, replies, reposts, quotes, and bookmarks
• Retrieve media attachments including photos and videos
• Capture hashtags, mentions, and external links from tweets
• Get quoted tweet data and parent post details for reply threads
• Fetch author metadata such as follower count, biography, and verification status
• Support multiple profile URLs in a single run with per-URL post limits
• Connect Twitter Post Scraper to any AI chatbot using Apify MCP server
• Export via SDKs (Python & Node.js), use API Endpoints, webhooks, or integrate with workflows

What data can you get from Twitter

Twitter Post Scraper (by Profile URL) can gather any kind of data from Twitter/X, such as:

How to scrape Twitter with Twitter Post Scraper (by Profile URL)?

Twitter Post Scraper (by Profile URL) is user-friendly, offering a smooth start even for those who have never extracted data from Twitter before. Here's how to scrape Twitter in 5 steps:

1. Create a free Apify account using your email.
2. Open Twitter Post Scraper (by Profile URL).
3. Add one or more profile URLs, and set the maximum number of posts per profile.
4. Click the "Start" button and wait for the data to be extracted.
5. Download your data in JSON, XML, CSV, Excel, or HTML.

Input

To start scraping Twitter, fill in the input form. Twitter Post Scraper (by Profile URL) recognizes the following input parameters:

• url (requestListSource): Twitter/X profile URLs. Each item contains a url field and an optional max_number_of_posts field.
• timeout (integer, default 20): Request timeout in seconds.

Input JSON

{
  "url": [
    {
      "url": "https://x.com/elonmusk",
      "max_number_of_posts": 10
    }
  ],
  "timeout": 20
}

Output

The results will be wrapped into a dataset which you can find in the Storage tab. Each tweet produces one output row. Here is what it looks like in JSON:

{
  "id": "1900000000000000000",
  "user_posted": "elonmusk",
  "name": "Elon Musk",
  "description": "Sample tweet text here",
  "date_posted": "2025-06-01T12:00:00.000Z",
  "photos": ["https://pbs.twimg.com/media/sample.jpg"],
  "url": "https://x.com/elonmusk/status/1900000000000000000",
  "tagged_users": null,
  "replies": 1234,
  "reposts": 567,
  "likes": 8901,
  "views": 234567,
  "external_url": null,
  "hashtags": ["tech", "AI"],
  "followers": 150000000,
  "biography": "Mars & Cars, Chips & Dips",
  "posts_count": 35000,
  "profile_image_link": "https://pbs.twimg.com/profile_images/sample.jpg",
  "following": 500,
  "is_verified": true,
  "quotes": 123,
  "bookmarks": 456,
  "parent_post_details": {
    "post_id": null,
    "profile_id": null,
    "profile_name": null
  },
  "external_image_urls": ["https://pbs.twimg.com/media/sample.jpg"],
  "videos": [
    {
      "video_url": "https://video.twimg.com/sample.mp4",
      "duration": 15000,
      "content_type": "video/mp4"
    }
  ],
  "quoted_post": {
    "post_id": null,
    "profile_id": null,
    "profile_name": null,
    "data_posted": null,
    "url": null,
    "description": null,
    "photos": null,
    "videos": null
  },
  "external_video_urls": ["https://video.twimg.com/sample.mp4"],
  "verification_type": "blue",
  "user_id": "44196397",
  "error": "",
  "error_code": ""
}

How can I use the data scraped from Twitter?

• 📊 Analyze engagement trends and identify your best-performing content
• 📋 Build competitor analysis dashboards by tracking rival accounts' tweets
• 🔬 Monitor brand mentions and public sentiment in real time
• 📈 Track influencer activity and measure campaign reach
• 🧠 Feed data into AI models for content analysis and trend prediction
• 🪧 Discover viral content patterns to optimize your own posting strategy
• 📚 Conduct academic research on social media discourse and behavior

Error items

When the scraper cannot retrieve data for a given input — for example a profile is private or a tweet has been deleted — it pushes an error item to the dataset instead of silently skipping it. Normal output items are never affected; you can tell them apart by the presence of a non-empty error field.

Error item structure

{
  "id": "",
  "user_posted": "",
  "name": "",
  "description": "",
  "date_posted": "",
  "url": "",
  "likes": "",
  "views": "",
  "error": "User not found",
  "error_code": "404"
}

Error codes reference

FAQ

How much does it cost to use Twitter Post Scraper (by Profile URL)?

Twitter Post Scraper (by Profile URL) uses the pay-per-event (PPE) pricing model. You're charged a fixed price for specific events. Your costs can be easily calculated using the information in the Actor's pricing tab.

Can I scrape multiple profiles at once?

Yes. The url input accepts an array of items. Each item can have its own url and max_number_of_posts, so you can control the depth per profile.

Can I use Twitter Post Scraper (by Profile URL) with the Apify API?

The Apify API gives you programmatic access to the Apify platform. The API is organized around RESTful HTTP endpoints that enable you to manage, schedule, and run Apify Actors. The API also lets you access any datasets, monitor Actor performance, fetch results, create and update versions, and more.

Your feedback

We're always working on improving the performance of our Actors. If you have any technical feedback or found a bug, please create an issue in the Issues tab.