Jobspy - Linkedin, Glassdoor Scraper

01KPQN6EJ7AMZ4CG319VAJVWX6

Stably scrape job postings from recruitment platforms including Indeed and LinkedIn. Supports remote/full-time/salary filtering, custom proxies, and multi-dimensional precise search. Deploy with one click to obtain overseas job data.

by Odin Kael

4.6

12runs

Last updated:2026-04-22

Try for Free

2,000 Free Results

What is Jobspy ？

A CoreClaw worker that aggregates job listings across multiple platforms using JobSpy.

Platform	Key	Status	Notes
Indeed	indeed	✅Stable	Best coverage, no rate limiting
LinkedIn	linkedin	✅Stable	May rate-limit after ~10 pages per IP
Glassdoor	glassdoor	⚠️ Unreliable	API changes, location parsing issues
ZipRecruiter	zip_recruiter	❌ Blocked	Cloudflare WAF 403 Forbidden
Google Jobs	google	⚠️ Unreliable	Requires specific google_search_term syntax
Bayt	bayt	❌ Blocked	403 Forbidden (anti-bot)
Naukri	naukri	❌ Blocked	Requires CAPTCHA
BDJobs	bdjobs	❌ Bug	Upstream bug: missing user_agent param

Recommended: Use ["indeed", "linkedin"] for reliable results.

Quick Start

Upload this folder to CoreClaw as a new Script
Configure parameters in the UI
Run the script

Examples

Example 1: Basic Search (Indeed, New York)

json

1{
2  "site_name": [{ "string": "indeed" }],
3  "search_term": "Software Engineer",
4  "location": "New York",
5  "country_indeed": "usa",
6  "results_wanted": 15
7}

Example 2: Multi-Platform Remote Jobs with Salary Comparison

json

1{
2  "site_name": [
3    { "string": "indeed" },
4    { "string": "linkedin" }
5  ],
6  "search_term": "Data Scientist",
7  "location": "San Francisco, CA",
8  "country_indeed": "usa",
9  "is_remote": true,
10  "results_wanted": 30,
11  "enforce_annual_salary": true,
12  "description_format": "markdown"
13}

Example 3: Recent Full-Time Jobs in London

json

1{
2  "site_name": [{ "string": "indeed" }, { "string": "linkedin" }],
3  "search_term": "Product Manager",
4  "location": "London",
5  "country_indeed": "uk",
6  "job_type": "fulltime",
7  "hours_old": 168,
8  "results_wanted": 25
9}

Example 4: Google Jobs with Custom Search Term

json

1{
2  "site_name": [{ "string": "google" }, { "string": "indeed" }],
3  "search_term": "Machine Learning Engineer",
4  "google_search_term": "ML Engineer AI jobs near Berlin since yesterday",
5  "location": "Berlin",
6  "country_indeed": "germany",
7  "results_wanted": 20
8}

Example 5: LinkedIn Company-Specific Search

json

1{
2  "site_name": [{ "string": "linkedin" }],
3  "search_term": "Software Engineer",
4  "location": "Singapore",
5  "country_indeed": "singapore",
6  "linkedin_fetch_description": true,
7  "linkedin_company_ids": "1441,2382910",
8  "easy_apply": true,
9  "results_wanted": 10
10}

Example 6: Full-Featured Search with Custom Proxy

json

1{
2  "site_name": [
3    { "string": "indeed" },
4    { "string": "linkedin" }
5  ],
6  "search_term": "DevOps Engineer",
7  "location": "Tokyo",
8  "country_indeed": "japan",
9  "distance": 25,
10  "is_remote": false,
11  "job_type": "fulltime",
12  "easy_apply": false,
13  "results_wanted": 50,
14  "description_format": "markdown",
15  "enforce_annual_salary": true,
16  "linkedin_fetch_description": false,
17  "hours_old": 72,
18  "offset": 0,
19  "verbose": 1,
20  "proxies": "socks5://user:pass@proxy.example.com:1080"
21}

Parameters

Parameter	Type	Default	Description
`site_name`	stringList	`["indeed", "linkedin"]`	Job boards to search (multiple allowed).Concurrency split field
`search_term`	string	`"Software Engineer"`	Job title or keyword
`location`	string	`"New York"`	City, state, or country
`country_indeed`	select	`"usa"`	Country for Indeed/Glassdoor (21 options)
`distance`	integer	`50`	Search radius in miles
`is_remote`	boolean	`false`	Filter remote-only jobs
`job_type`	select	`""`	Employment type (fulltime, parttime, contract, internship, etc.)
`results_wanted`	integer	`50`	Results per site
`description_format`	select	`"markdown"`	Job description format (markdown / html / plain)
`enforce_annual_salary`	boolean	`true`	Convert all salaries to annual
`linkedin_fetch_description`	boolean	`false`	Fetch full LinkedIn descriptions (slower)
`hours_old`	integer	`0`	Only jobs posted within N hours (0 = no filter)
`offset`	integer	`0`	Skip N results (pagination)
`google_search_term`	string	`""`	Separate search term for Google Jobs
`easy_apply`	boolean	`false`	Filter one-click apply jobs (Indeed/LinkedIn)
`linkedin_company_ids`	string	`""`	Comma-separated LinkedIn company IDs
`user_agent`	string	`""`	Custom User-Agent header
`verbose`	select	`1`	Log level (0=Errors, 1=Warnings, 2=Info)
`proxies`	string	`""`	Proxy URL (leave empty for platform built-in)

Output

Each row contains 35 fields:

Category	Fields
Job Identity	id, site, job_url, job_url_direct
Job Info	title, company, location, date_posted, job_type, is_remote
Salary	salary_source, interval, min_amount, max_amount, currency
Job Details	job_level, job_function, listing_type, description
Company	company_industry, company_url, company_logo, company_url_direct, company_addresses, company_num_employees, company_revenue, company_description, company_rating, company_reviews_count
Skills & Experience	skills, experience_range, emails
Other	vacancy_count, work_from_home_type
Status	status, error

Proxy

Three proxy modes (in priority order):

User-defined — set the proxies parameter (e.g. socks5://user:pass@host:port)
Platform built-in — auto-detected via PROXY_AUTH environment variable
Direct — no proxy

Troubleshooting

No results from a platform?

Platform	Solution
ZipRecruiter	Blocked by Cloudflare WAF. No workaround available.
Glassdoor	Try different location format (e.g. "USA" instead of "New York")
Google Jobs	Use `google_search_term` with specific syntax from Google Jobs UI
Bayt	Blocked by anti-bot. No workaround available.
Naukri	Requires CAPTCHA. No workaround available.
BDJobs	Upstream bug. Wait for JobSpy update or exclude from search.

Rate Limited (429)?

Reduce results_wanted
Use rotating proxies via proxies parameter
Wait between requests

Project Structure

text

1worker-jobspy/
2├── main.py              # Entry point (CoreSDK + asyncio)
3├── jobspy_worker.py     # Core logic (framework-independent)
4├── input_schema.json    # UI parameter definitions
5├── requirements.txt     # Python dependencies
6├── sdk.py               # CoreClaw SDK
7├── sdk_pb2.py           # gRPC protobuf
8├── sdk_pb2_grpc.py      # gRPC stub
9└── .gitignore

Dependencies

Package	Purpose
`python-jobspy`	Multi-platform job scraper
`pandas`	DataFrame processing
`PySocks`	SOCKS5 proxy support
`grpcio`	CoreClaw SDK gRPC communication
`protobuf`	Protocol Buffers runtime
`python-dateutil`	Date parsing

License

This worker wraps JobSpy which is licensed under the MIT License.

Price Estimation

Results Limit

101,000 results

Estimated:

~$0.15

100 results × $0.0015. You only pay for success.

Run Now

Buy Now

Quick Tips

New users get 2,000 free results
Failed requests are free
Export results in JSON or CSV

Explore more popular scrapers from our marketplace

View All Scrapers

Yahoo Finance Scraper

by Odin Kael

Get global stock market data from Yahoo Finance, supporting US stocks, Hong Kong stocks, and A-shares. Extract comprehensive data including historical OHLCV, company information, financial statements, dividend history, split history, and analyst ratings. No coding required. Export to CSV or JSON with one click.