• Saturday , 4 April 2020

Building a full stack WEB SCRAPING app with JAVASCRIPT tutorial

Code Canyon



By request here is a full stack JavaScript app that uses web scraping — complete with a front end, API server, scraper and database.

Here’s the code:
https://github.com/aj-4/setuptourist

Our stack (100% JavaScript)
== HTML / CSS / Vanilla JS (no framework)
== Express
== Puppeteer
== TypeORM
== mySQL

Are you lost?
———————
Check out my “Web scraping made simple” video first:

Here’s some affordable JS Udemy courses I took to learn programming
——————————————————————————————————————
Javascript: The weird parts
https://bit.ly/37lJ9in

Advanced Javascript
https://bit.ly/39vbIf8

Modern React with Redux
https://bit.ly/2TBEDbI

(note these are affiliate links, same price for you but I may make a little $)

Social Media
———————
https://instagram.com/_aaronjack

#javascript #webscraping #app

Original source

3d Ocean

Related Posts

37 Comments

  1. Code Drip
    February 19, 2020 at 17:54

    If you're lost check out the description — I've got a "web scraping made simple" video too
    Hope it was interesting.. remember to like it really helps 🙂

  2. --
    February 19, 2020 at 17:54

    "copy xpath".. I have been a developer for 5+ years and I'm just learning this now

  3. Mike Mc Cann
    February 19, 2020 at 17:54

    Getting this error.Anyone know what's going wrong? TypeError: Cannot read property 'getProperty' of undefined

  4. Karim Elkholy
    February 19, 2020 at 17:54

    Coolest guy I've ever seen on youtube i am waiting for more advanced now i can store data in database can you explain how to make a code that auto scrap / skip pre loaded ones with schedule and panal to adjusting time also way to edit specific names for all at once like adding Youtuber: before names of each

  5. Karim Elkholy
    February 19, 2020 at 17:54

    That what actually I've been looking for my idea was a bit different i want scrap content into database once only new products / prices and stock is updating hourly or so , i am kinda lost should i build it with python like django or php is pain in ass wordpress is unable to customize for my needs i can't effort to hire developer to transform my idea into project

  6. Talezus
    February 19, 2020 at 17:54

    I know the purpose of this video is to demonstrate web scraping but for building real website like this would it make more sense to use the YouTube Data API to get information about the channel rather than Puppeteer? I'd imagine making API calls to YouTube would be much faster than making a bunch of headless browsers for getting new channel data.

  7. Dr4kk0nnys
    February 19, 2020 at 17:54

    Boy do you deserve all the success in the world

  8. Himavad Gopal
    February 19, 2020 at 17:54

    At 8:50, when trying to execute the scrapers.js code, I'm getting a (node:15308) UnhandledPromiseRejectionWarning: TypeError: Cannot read property 'getProperty' of undefined error. Anyone knows why? I checked the code, and even tried copying it from the github share exactly. Still unable to get past this error!

  9. Frank Zachary
    February 19, 2020 at 17:54

    Hey there! I'm getting a TypeError referring to the name and avatarURL variables in the scrapeChannel function. They're both coming back as undefined. Any idea/ideas why?

  10. Xyvier Lau
    February 19, 2020 at 17:54

    This video is making me very hungry for some reason

  11. Compte Prive
    February 19, 2020 at 17:54

    This was really great, but you didn't cross the finish line!!! You gotta show how you would deploy this!

  12. Chad Thomas II
    February 19, 2020 at 17:54

    What font do you use?

  13. Andrew William
    February 19, 2020 at 17:54

    Subscribed. I hope I can learn more about full stack development from your videos, particularly the fundamentals.

  14. Desmond Singh
    February 19, 2020 at 17:54

    does anyone know how to do this in python???

  15. Tanner Campbell
    February 19, 2020 at 17:54

    Great video! Not sure if you mentioned or it's linked but can you drop a link to VS Code HTML previewer extension. Live Saver!!

  16. brute5o5
    February 19, 2020 at 17:54

    I keep getting an undefined error when trying to scrape the youtube pages

  17. WoodysVideos
    February 19, 2020 at 17:54

    Great work! More tutorials!

  18. IMPORTANT INFORMATION
    February 19, 2020 at 17:54

    Look Copernicus, Just beacuse you got mic and a camera dosn't make you an expert.

  19. ceghap
    February 19, 2020 at 17:54

    do we still need to import body-parser? express 4.16+ already have express.json() ?

  20. Draxen
    February 19, 2020 at 17:54

    Hey Code Drip, when I run headless puppeteer I get an error with grabbing the title,
    But when running in headless:false I get no errors at all?
    I am using the copy full x-path also….
    Send help 😛

  21. apetiss
    February 19, 2020 at 17:54

    Can you explain why you are using a schema?

  22. ngfox
    February 19, 2020 at 17:54

    I have just started learning web programming. I'm glad to see such a wonderful video.

  23. pierre pucheu
    February 19, 2020 at 17:54

    Great video man! Thanks!

  24. iamchets
    February 19, 2020 at 17:54

    You dont need bodyParser anymore to work with json tho. "express.json()" is a thing.

  25. Harry
    February 19, 2020 at 17:54

    Please what editor do you use to preview?

  26. Dane Miller
    February 19, 2020 at 17:54

    Hi Code Drip, what IDE are you using?

  27. Stefan Dili
    February 19, 2020 at 17:54

    Dude if you're still in Serbia PLEASE contact me. I'm about 50 miles from Belgrade in a beautifull village. Contact me at stefan.dili.021@gmail.com even if you left Serbia please.

  28. Honey Dijon
    February 19, 2020 at 17:54

    thank you man i really love your stuff thanks for sharing <3

  29. DRC Paintball
    February 19, 2020 at 17:54

    How to be a FULL STACK DEVELOPER, using premade libraries without having any fucking idea how any of them work.

  30. Jannis Ohlas
    February 19, 2020 at 17:54

    Awesome YouTube channel – easy to understand, reliable information and friendly caster. Keep up the great work, u already helped me a lot during my career shift from business to frontend! BR from GER!

  31. Liz Dix
    February 19, 2020 at 17:54

    craft d.i.y

  32. Adam Jean-Laurent
    February 19, 2020 at 17:54

    what theme and font do you use

  33. Jaime Rojas
    February 19, 2020 at 17:54

    Web scraping it's a lot of fun, this video gives me some project ideas thanks dude

  34. Jaison Baby
    February 19, 2020 at 17:54

    Awesome Content man. Please keep adding more such end to end apps. If you don't have a Patreon, please start one. I would love to support you.

  35. Mr_T3xaz
    February 19, 2020 at 17:54

    whar program is he using when he is writing the code

  36. scripteaze
    February 19, 2020 at 17:54

    Thanks code!

  37. Benjamin LaVallie
    February 19, 2020 at 17:54

    2 thessalonians chapter 1 verse 9 who shall be punished with everlasting destruction from the presence of the lord and from the glory of his power
    blueletterbible.org
    acts chapter 16 verse 30

Leave A Comment

You must be logged in to post a comment.