Scraping

Scraping in JS

August 3, 2024
2024, Engineering
Javascript, Scraping, Puppeteer

Introduction # For one of our client Midas Finance we had to implement stock quotes on their home page. There are existing API but we’re not sure of it usability. To solve this issue we use Moneycontrol’s undocumented APIs. Basically to scrape this we had to use two mechanisms: fetch based JSON scraping Puppeteer to scrape information form web pages. Along the way we had to solve few sub-problems: ...