Google Search Scraper

An Apify actor for scraping Google search results with customizable parameters. The actor extracts URLs, titles, and descriptions from Google search results pages.

Features

• Scrape Google search results based on your search terms
• Customize the number of results to retrieve
• Set language and region preferences
• Enable or disable Google's SafeSearch
• Filter out duplicate URLs
• Automatic proxy rotation using Apify Proxy (if available)
• Random user agent generation to avoid blocking
• Real-time processing: Results are pushed to the dataset as they are found, without waiting for all results to be collected

Input Parameters

The actor accepts the following input parameters:

Parameter	Type	Description
searchTerm	String	Required. The search query to look for on Google.
numResults	Integer	Number of search results to retrieve. Default is 10.
lang	String	Language code for the search results (e.g., 'en', 'es', 'fr'). Default is 'en'.
safe	String	SafeSearch setting: 'active' or 'off'. Default is 'active'.
region	String	Region code for the search results (e.g., 'us', 'uk', 'de').
start	Integer	Starting index for the search results. Default is 0.
unique	Boolean	Whether to filter out duplicate URLs. Default is true.

Output

The actor stores its results in the default dataset, with each item having the following structure:

1{
2  "url": "https://example.com",
3  "title": "Example Title of the Search Result",
4  "description": "A snippet or description of the search result as shown by Google..."
5}

Usage Examples

Basic Example

1{
2  "searchTerm": "apify web scraping"
3}

Advanced Example

1{
2  "searchTerm": "machine learning tutorials",
3  "numResults": 50,
4  "lang": "en",
5  "safe": "active",
6  "region": "us",
7  "start": 0,
8  "unique": true
9}

Proxy Usage

The actor automatically uses Apify Proxy if available in your subscription plan. This helps avoid IP-based blocking and provides more reliable results. If Apify Proxy is not available, the actor will run without a proxy.

Limitations

• Google may detect and block automated scraping attempts. The actor implements measures to minimize this risk, but successful operation cannot be guaranteed in all cases.
• The structure of Google's search results page may change over time, which could affect the actor's ability to extract data correctly.
• For heavy usage, consider implementing delays between requests or use a pool of proxies.