Day 92 is doing scraping. The idea is simple, and we have done amazon ones before, and that’s still my goal, so I am still working on it. During my down time before, I have done a similar thing, so I am using that as my base. Eventually, my code will use selenium instead of scraping only, I will read a google sheet to see what I should check, then check the amazon site to compare to my price range.
The project is overall one of the smallest one / easiest one. The harder part is actually coming up with ideas to see what I can scrap, and try to follow the robots.txt for each site to make sure I am not violating some site’s regulation.