Web Scraping Coin Sites
Project Title: Web Scraping Values from Coin Sites
I would like to scrape popularity metrics from five crypto websites with an online script that resides on a LAMP server with Python3 installed. If you need other special libraries you will get SSH access data and could install them yourself there. The script should run once each day by scheduled command line (Cronjob) and save the data into a MySQL database for later analysis with Excel, MS Power BI or something like that.
Those are the source sites:
https://www.coingecko.com (“People like this”)
https://coinmarketcap.com (“On watchlists”, referred to as “CMC”)
https://coincheckup.com (Algo Score)
https://cryptocompare.com (Influence: Total Views)
https://cryptorank.io (“On Watchlists”)
Each one has some kind of “popularity” data for each coin when you click on the details of a coin. On e.g. Coinmarketcap it is the button under the coin name named “On xxx Watchlists” and e.g. on CoinGeck it is the number before “xxx people like this”.
So those data points should be extracted:
Date+Time (as MySQL Timestamp)
Coin URL (complete URL taken from CMC like https://coinmarketcap.com/currencies/bitcoin/)
Current symbol (taken from CMC)
Price (in USD, from CMC)
24h Price Change (in USD, from CMC)
24h Trading volume (in USD, from CMC)
24h Trading volume change (in USD, from CMC)
Market Cap (from CMC)
Popularity Metric (current value at crawl, from coingecko, CMC, coincheckup, cryptocompare)
Popularity Metric (change in % from previous day)
Save the extracted data in (My-)SQL database. You will get access data from me for it. I will process the data then from there.
The script should run once a day by command line batch and have the following settings possibilities.
For similar work requirements feel free to email us on email@example.com.