Virtuals.io Scraper

Overview

The Virtuals.io Scraper is a powerful tool designed to collect detailed data about agents and their associated tokens from Virtuals.io. Whether you’re a crypto enthusiast, researcher, or developer, this scraper simplifies data extraction, offering flexibility and precision.

Virtuals.io is a platform focused on virtual tokenomics and ecosystem analytics, enabling users to gain insights into agent performance, token values, and more. With this scraper, you can access data on sentient agents or prototype agents, tailoring your research or analysis to your specific needs.

Features

• Flexible Agent Selection:
  • Choose between Sentient Agents and Prototype Agents to target the specific data you need.
• Extract Comprehensive Data:
  • Gather information on agents, tokenomics, market capitalization, and ascension progress.
• Detailed Analytics:
  • Access market cap calculations, token reserve details, and formatted progress data.
• Configurable Settings:
  • Adjust scraping parameters like concurrency, retries, and delays to suit your requirements.
• Proxy Support:
  • Ensure reliable and anonymous scraping with built-in proxy configurations.
• Persistent Data Storage:
  • Use custom storage names to preserve data indefinitely, ensuring deduplication and flexibility.
  • Duplicate datasets easily by assigning unique names to storage, enabling long-term analysis or simultaneous projects.

How to Use

1. Set Up: Ensure you have an Apify account and access to the Apify platform.
2. Select Agent Type: Choose between Sentient Agents or Prototype Agents for targeted scraping.
3. Provide Input Data: Input specific scraping parameters, such as the maximum number of items or custom storage names.
4. Adjust Scraper Settings: Configure settings like maxConcurrency, minConcurrency, and maxRequestRetries as per your requirements.
5. Run the Scraper: Execute the scraper on the Apify platform.
6. Download Results: Export the scraped data in your preferred format (JSON, CSV, Excel).

Input Configuration

Here is an example of how to set up the input for the Virtuals.io Scraper:

1{
2    "agents": "sentient",
3    "maxItems": 10000,
4    "maxConcurrency": 10,
5    "minConcurrency": 1,
6    "maxRequestRetries": 100,
7    "storeName": "VirtualsDataStorage",
8    "proxy": {
9        "useApifyProxy": true,
10        "apifyProxyGroups": [
11            "RESIDENTIAL"
12        ]
13    }
14}

Input Fields Explanation

• Agents (agents): Specify the type of agents to scrape:
  • sentient: Scrape data for Sentient Agents.
  • prototype: Scrape data for Prototype Agents.
• Max Items (maxItems): Maximum number of items to process during a single run.
• Max Concurrency (maxConcurrency): Maximum number of pages processed simultaneously.
• Min Concurrency (minConcurrency): Minimum number of pages processed simultaneously.
• Max Request Retries (maxRequestRetries): Number of retries for failed requests before stopping.
• Store Name (storeName): Custom name for the storage to enable data deduplication and retention.
• Proxy Configuration (proxy): Proxy settings for anonymity and reliability during scraping.

Output Structure

The scraper produces a structured list of agent data with detailed information. Below is an example of the output:

1{
2    "name": "Bark Ruffalo",
3    "role": "CREATIVE",
4    "preToken": "0x2D656C595dF8db8526E2F075322ADFcE37F4367d",
5    "createdAt": "2024-11-23T14:32:59.403Z",
6    "holders": null,
7    "marketCap": {
8        "rawValue": "592549233513375",
9        "formatted": "$2,180,581.2k",
10        "isUndergrad": false,
11        "preTokenPair": "0x17Ed86287A52987AAD3fB7466699cc73ebE06416",
12        "calculationSteps": {
13            "originalValue": "592549233513375",
14            "baseValue": 592549233513375,
15            "supply": 592549.233513375,
16            "tokenUsdPrice": 3.68,
17            "fdvValue": 2180581.17932922,
18            "calculation": "592549233513375 / 1000000000 * 3.68"
19        }
20    },
21    "ascensionProgress": {
22        "tokenReserves": 124504236.88581388,
23        "virtualReserves": 48191.13108177,
24        "progress": 100,
25        "formattedProgress": "100.00%",
26        "priceInVirtual": 0.0003870641858233898
27    },
28    "description": "Why $PAWSY?
✨ We are creating an ecosystem and a community focused on making money...",
29    "link": "https://virtuals.io/agent/BarkRuffalo"
30}

Output Fields Explanation

• name: Name of the agent.
• role: Role or designation of the agent.
• preToken: Identifier for the token associated with the agent.
• createdAt: Timestamp indicating when the agent was created.
• holders: Number of token holders (if available).
• marketCap: Details of the market capitalization, including calculations and raw values.
• ascensionProgress: Progress metrics related to the agent's ascension.
• description: Detailed description of the agent and its purpose.
• link: Direct URL to the agent's profile on Virtuals.io.

Explore More Scrapers

If you found the Virtuals.io Scraper useful, check out other powerful scrapers and actors at memo23's Apify profile. We offer a wide range of tools to enhance your web scraping and automation needs.

Support

• For issues or feature requests, please use the Issues section of this actor.
• For further assistance, contact the author:
  • Author's website: https://muhamed-didovic.github.io/
  • Email: muhamed.didovic@gmail.com

Additional Services

• Request customization or a full dataset: muhamed.didovic@gmail.com
• Need other platforms scraped? Contact muhamed.didovic@gmail.com
• For API services of this scraper, reach out to muhamed.didovic@gmail.com