YouTube Scraping with Puppeteer

April 16, 2020 1 min read puppeteer, nodejs, youtube, scraping

Written in 2020. Tools, APIs and prices may have changed since.

Lab note What I wrote down while learning this by building with it. Short by design; the code is in pfeilbr/youtube-scraping-puppeteer.

example of using Puppeteer Chrome browser automation to scrape youtube content

see src/index.js

Running

# install
npm install

# run
npm start

# output is stored as a json file for each channel in the `data/` directory
# create csv from json using `jq`
cat data/AmazonWebServices-channel-videos.json | jq -r '.[] | [.title, .url] | @csv' > data/AmazonWebServices-channel-videos.csv
cat data/AWSwebinars-channel-videos.json | jq -r '.[] | [.title, .url] | @csv' > data/AWSwebinars-channel-videos.csv

Keep learning