This project was built to help people and I did not earn money from my work. But you can still support my work
Javascript is the most popular language today, and JSON format has become a very popular data structure to store data.
Try to extract this product detail such as title, desc and price.
Tips:
-
In some cases, the XPath expression or CSS expression which work in your browser can not work in your code because some DOM element might have been modified by frontend javascript.
-
Sometimes there are some Unicode char in the raw JSON string which might cause program raise
UnicodeDecodeError. You should remember before runningjson.loads, make the JSON string Unicode string type. If there is some syntax error when loading, you can use some took such as json lint to help you figure out where the error is.
SaaS Hammer helps you launch products in faster way. It contains all the foundations you need so you can focus on your product.
Exercise List
Web scraping using XPath or CSS expression
Load JSON string and extract data
Not only crawl products but also handle pagination
Inspect Ajax requests and mimic them
Learn to inspect the fields of HTTP request
Scraping Infinite Scrolling Pages (Ajax)
Learn to scrape infinite scrolling pages
Make your spider can work with the cookie
Scrape data behind login form
Learn to scrape data behind a captcha
Learn how to analyze minimized or compressed javascript