Web Scraping Financial Data
Project Title: Web Scraping Financial Data
I’ve worked with the data that someone else has scraped, cleaned the divs and HTML text out of it to pull what I need into pandas, but I’ve never been very successful doing my own web scraping.
This site https://tradingeconomics.com/commodities has a bunch of economic data and while they do have an API for a charge, I want to build a scraper that can access some or all of it. Right now I was going to get a book on web scraping and start but how do you approach web scraping a site like this?
I’m on a mac with safari and know how to muck around in the dev tools to “inspect element”, will likely use python, firefox/chrome, selenium, and the end goal is to put all this into pandas data frames.
For similar work requirement feel free to email us on email@example.com.