Automate ScrapingBee for free on Stepper

Scrape URL

Fetch the HTML (or text/JSON) of any URL with optional headless-browser rendering, proxies, and waits.

• 19 parameters
• URL
• Render JavaScript
• Wait (ms)
• Wait For Selector
• Wait For Browser Event
• JS Scenario
• Use Premium Proxy
• Use Stealth Proxy
• Country Code
• Block Ads
• Block Images & CSS
• Window Width
• Window Height
• Device
• Cookies
• Return Page Source
• JSON Response
• Transparent Status Code
• Timeout (ms)

Extract Data

Scrape a URL and pull out structured fields using CSS or XPath rules.

• 8 parameters
• URL
• Extraction Rules
• Render JavaScript
• Wait For Selector
• Use Premium Proxy
• Use Stealth Proxy
• Country Code
• Device

Extract Data With AI

Scrape a URL and use natural-language or typed AI rules to extract structured data.

• 7 parameters
• URL
• AI Query
• AI Extract Rules
• AI Selector
• Render JavaScript
• Use Premium Proxy
• Country Code

Take Screenshot

Capture a PNG screenshot of a URL — viewport, full page, or a specific element.

• 11 parameters
• URL
• Screenshot Type
• Element Selector
• Window Width
• Window Height
• Wait (ms)
• Wait For Selector
• Block Ads
• Use Premium Proxy
• Country Code
• Device

Google Search

Run a Google search and return parsed organic, news, image, ad, and AI overview results.

• 10 parameters
• Search Query
• Search Type
• Country Code
• Language
• Device
• Page
• No Auto-Correct
• Light Request
• Include Raw HTML
• Extra Google Params

Fast Google Search

Cheap, low-latency Google search that returns only organic results and top stories (10 credits flat).

• 4 parameters
• Search Query
• Country Code
• Language
• Page

Get Amazon Product

Fetch parsed product details for an Amazon ASIN.

• 10 parameters
• ASIN
• Amazon Domain
• Country
• ZIP / Postal Code
• Language
• Currency
• Device
• Light Request
• Include Raw HTML
• Include Screenshot

Search Amazon Products

Search Amazon and return parsed result listings.

• 14 parameters
• Search Query
• Start Page
• Number of Pages
• Sort By
• Category ID
• Merchant ID
• Amazon Domain
• Country
• ZIP / Postal Code
• Language
• Currency
• Device
• Include Raw HTML
• Include Screenshot

Get Walmart Product

Fetch parsed product details for a Walmart product ID.

• 7 parameters
• Product ID
• Delivery ZIP
• Walmart Domain
• Device
• Light Request
• Include Raw HTML
• Include Screenshot

Search Walmart Products

Search Walmart and return parsed result listings.

• 14 parameters
• Search Query
• Start Page
• Sort By
• Minimum Price
• Maximum Price
• Fulfillment Type
• Fulfillment Speed
• Store ID
• Delivery ZIP
• Walmart Domain
• Device
• Light Request
• Include Raw HTML
• Include Screenshot

Search YouTube Videos

Search YouTube and return parsed video, channel, or playlist results.

• 10 parameters
• Search Query
• Result Type
• Upload Date
• Duration
• Sort By
• HD Only
• HDR Only
• Has Subtitles
• Creative Commons
• Live Only

Get YouTube Video Metadata

Fetch parsed metadata (title, channel, views, description, etc.) for a YouTube video.

• 1 parameters
• Video ID

Get YouTube Video Transcript

Fetch the transcript text for a YouTube video.

• 3 parameters
• Video ID
• Language
• Transcript Origin

Run ChatGPT Prompt

Send a prompt through ScrapingBee's hosted ChatGPT browser session and return the response. Costs 15 credits per call.

• 4 parameters
• Prompt
• Enable Web Search
• Country Code
• Include Raw HTML

Make HTTP Request

Make an HTTP request to any URL with full control over method, headers, and body.