News Aggregator AI Agent

News Aggregator AI Agent

Scrapes and aggregates top news stories based on a given search query. It uses AI to extract the core topic from the query, fetch relevant articles, and compile a well-structured newsletter summarizing the most important stories.

AGENTSAINEWSApify

AI News Aggregator Actor

Overview

The AI News Aggregator is an Apify Actor that scrapes and aggregates top news stories based on a given search query. It uses AI to extract the core topic from the query, fetch relevant articles, and compile a well-structured newsletter summarizing the most important stories.

Features

  • Automated Topic Extraction: Uses AI to determine the most relevant topic from the user-provided query.
  • Web Scraping: Gathers articles from reputable news sources.
  • Content Summarization: Extracts key points from each article to create a concise, easy-to-read newsletter.
  • Formatted Output: Returns results in a structured JSON format or as a ready-to-send email template.

How It Works

  1. User Input: Provide a search query (e.g., "latest in AI research").
  2. Topic Identification: The AI extracts the primary topic from the query.
  3. News Collection: The actor scrapes and retrieves top news stories related to the extracted topic.
  4. Summarization & Structuring: Summaries are generated, and a newsletter is created.
  5. Output: The final newsletter is returned in JSON or HTML format.

Input Parameters

The actor expects the following input JSON:

1{
2    "OPENAI_API_KEY": "", //optional
3    "newsRequest": "What's going on with the USA tariffs?"
4}

Parameters:

  • newsRequest (string, required): The search term or phrase for which to fetch news.
  • OPENAI_API_KEY (string, optional): The OpenAI API key to use for summarization. You will be charged for usage if you don't provide your own key.

Output Format

Be sure to check the "Storage > Key-value store output tab for the HTML/MD report files.

HTML Newsletter The HTML content can be directly copied into an email message body to have a perfectly structed newsletter ready to send. HTML Newsletter

JSON Output:

1{
2  "topic": "What's going on with the USA tariffs?",
3  "articles": [
4    {
5        "title": "Trump vows to take back 'stolen' wealth as tariffs on steel and aluminum imports go into effect",
6        "source": "AP News",
7        "link": "https://apnews.com/article/e5a6295577275045db3484b71c979bfb?utm_source=openai",
8        "summary": "On March 12, 2025, President Trump announced new tariffs of 25% on all steel and aluminum imports as part of his economic strategy."
9    },
10    ...
11  ]
12}

HTML Output:

The HTML output is a fully formatted newsletter ready for email distribution.

1### Running on Apify
21. Deploy the actor to Apify.
32. Provide input via Apify’s web UI or API.
43. Retrieve results via Apify’s dataset API.
5
6## Use Cases
7- **Daily News Digests**: Automate newsletter creation for specific industries or interests.
8- **Market Research**: Track trends in technology, finance, or politics.
9- **Content Aggregation**: Generate curated content for blogs or social media.

Frequently Asked Questions

Is it legal to scrape job listings or public data?

Yes, if you're scraping publicly available data for personal or internal use. Always review Websute's Terms of Service before large-scale use or redistribution.

Do I need to code to use this scraper?

No. This is a no-code tool — just enter a job title, location, and run the scraper directly from your dashboard or Apify actor page.

What data does it extract?

It extracts job titles, companies, salaries (if available), descriptions, locations, and post dates. You can export all of it to Excel or JSON.

Can I scrape multiple pages or filter by location?

Yes, you can scrape multiple pages and refine by job title, location, keyword, or more depending on the input settings you use.

How do I get started?

You can use the Try Now button on this page to go to the scraper. You’ll be guided to input a search term and get structured results. No setup needed!