Table Of Contents
1. What Is Simple Scraper?
2. What Is Market Watch?
3. What Is Google Sheets?
4. What You'll Learn In This (No-Code) Tutorial
5. Initial Scraper Setup
6. Running The Web Scraper
7. Saving The Web Crawler
8. Integrating Google Sheets
9. Running The Web Crawler
10. Next Steps
What Is Simple Scraper?
Simple Scraper is an excellent Google Chrome extension that makes web crawling easy. It helps you to extract data from any website with no-code. You can crawl locally or in the cloud. And, every website that you crawl instantly becomes an API. Simple Scraper is a simple yet powerful web crawling tool.
What Is Market Watch?
Market Watch is a website that provides stock market data, financial news, and more. It's a helpful resource for researching public companies.
What Is Google Sheets?
Google Sheets is a spreadsheet program part of the Google Docs Editors suite. It's a powerful yet often overlooked no-code tool for building without code.
What You'll Learn In This (No-Code) Tutorial
By the end of this tutorial, you'll have created a web crawler to scrape data from Market Watch. The crawler will export the data to Google Sheets
Initial Scraper Setup
Go to Market Watch.
Search for 'AAPL' (or another stock).
Open Simple Scraper and click the plus (+) sign.
First, you'll want to scrape the name: select the stock name. Everything which gets highlighted is what'll get extracted. Name this data, 'Name'. Then, click the tick to set it for when you run the scraper.
Second, you'll want to scrape the yield. Again, click the plus (+) sign. Select the stock's yield. Everything which gets highlighted is what'll get extracted. Name this data, 'Yield'. And, click the tick to set it for when you run the scraper.
Running The Web Scraper
To run your scraper, click 'View Results'.
Once the web scraper has run, Simple Scraper will return the selected data. It will allow you to view that data in a table or as a JSON file. And, you will have the option of downloading the data as either a CSV file or JSON.
Saving The Web Crawler
To save your web crawler, click 'Save Recipe'.
You'll have to confirm the settings for your web crawler when saving it. The settings that got entered for this project are:
- Recipe Name - 'Yield Crawler'
- URL - Leave that as it is.
- Selected Properties - 'Name' and 'Yield'.
- Page Navigation - Leave that as it is.
Once you've entered the settings, click 'Create Recipe'.
Integrating Google Sheets
Click on the recipe you saved under 'My Recipes'.
Then, click 'Integrate'.
Select the toggle button to activate Google Sheets export. And, you will want the crawler to 'Replace Previous Results' for the save method.
Running The Web Crawler
Go to Market Watch.
Search for 'AAPL'. Copy the URL and paste it into 'Crawl URLs'.
Repeat the process for each stock you want data on. For this project, you'll want data on; Apple, Microsoft, IBM, and Intel.
To run your crawler, click 'Run Recipe'.
Once the web crawler has run, Simple Scraper will return the selected data. You can view the output of your crawler on the 'Results' page.
To view the data in Google Sheets, go to 'Integrate' and click 'Open Google Sheet'. Now, you can remove unnecessary columns and analyse your data.
Congratulations on completing this tutorial. Now, why not challenge your capabilities? Try implementing one of the suggestions below. Or try your own.
- Scrape more stocks.
- Scrape more data on each stock.
- Import your Google Sheet into Parabola to filter the data.