D4mations.com

Building a full stack WEB SCRAPING app with JAVASCRIPT tutorial



By request here is a full stack JavaScript app that uses web scraping — complete with a front end, API server, scraper and database.

Here’s the code:
https://github.com/aj-4/setuptourist

Our stack (100% JavaScript)
== HTML / CSS / Vanilla JS (no framework)
== Express
== Puppeteer
== TypeORM
== mySQL

Are you lost?
———————
Check out my “Web scraping made simple” video first:

Here’s some affordable JS Udemy courses I took to learn programming
——————————————————————————————————————
Javascript: The weird parts
https://bit.ly/37lJ9in

Advanced Javascript
https://bit.ly/39vbIf8

Modern React with Redux
https://bit.ly/2TBEDbI

(note these are affiliate links, same price for you but I may make a little $)

Social Media
———————
https://instagram.com/_aaronjack
https://twitter.com/_aaronjack

#javascript #webscraping #app

Original source

d4mer

, , , , , , , , , ,

37 responses to “Building a full stack WEB SCRAPING app with JAVASCRIPT tutorial”

  4. Coolest guy I've ever seen on youtube i am waiting for more advanced now i can store data in database can you explain how to make a code that auto scrap / skip pre loaded ones with schedule and panal to adjusting time also way to edit specific names for all at once like adding Youtuber: before names of each

  5. That what actually I've been looking for my idea was a bit different i want scrap content into database once only new products / prices and stock is updating hourly or so , i am kinda lost should i build it with python like django or php is pain in ass wordpress is unable to customize for my needs i can't effort to hire developer to transform my idea into project

  6. I know the purpose of this video is to demonstrate web scraping but for building real website like this would it make more sense to use the YouTube Data API to get information about the channel rather than Puppeteer? I'd imagine making API calls to YouTube would be much faster than making a bunch of headless browsers for getting new channel data.

  8. At 8:50, when trying to execute the scrapers.js code, I'm getting a (node:15308) UnhandledPromiseRejectionWarning: TypeError: Cannot read property 'getProperty' of undefined error. Anyone knows why? I checked the code, and even tried copying it from the github share exactly. Still unable to get past this error!

  20. Hey Code Drip, when I run headless puppeteer I get an error with grabbing the title,
    But when running in headless:false I get no errors at all?
    I am using the copy full x-path also….
    Send help 😛

  30. Awesome YouTube channel – easy to understand, reliable information and friendly caster. Keep up the great work, u already helped me a lot during my career shift from business to frontend! BR from GER!

Leave a Reply