Business Benefits of Crawlers/Scrapers and RPA

Goals

To collect data on how the use of web crawlers/scrapers and/or RPA can benefit businesses in terms of increased revenue, productivity improvements.

Early Findings

Definition of Terms

  • Web crawler - according to Tech Target, a web crawler is "a program that visits websites and reads their pages and other information in order to create entries for a search engine index." Web crawlers are typically used to collect information from a website and the links that are related to the website.
  • Web scraper - web scrapers are applications that process the HTML of a web page so as to extract data for manipulation.
  • Robotic Process Automation (RPA) - according to Tech Target, RPA "is the use of software with artificial intelligence (AI) and machine learning capabilities to handle high-volume, repeatable tasks that previously required humans to perform." These tasks include queries, calculations and maintenance of records and transactions.

Business Benefits

Proposed next steps:

You need to be the project owner to select a next step.
From our initial research, we determined that qualitative and quantitative information on the benefits of web crawlers/web scrapers and RPA may be available in the public domain. Consequently, we recommend continuing research to identify 5-7 insights, information, data, and statistics on the benefits of web crawlers/web scrapers on business. The research focus will be global and quantitative data that backs up research findings will be prioritized.
Additionally, because RPA is a totally different technology, we also recommend conducting research to identify 5-7 insights, information, data, and statistics on the benefits of RPA on business. The research focus will be global and quantitative data that backs up research findings will be prioritized.