With 1.7 million freelancers, we'll match you with the perfect talent.
The client has made the following changes to the job.
Client prefers freelancers from:
You are still able to submit a proposal for this job.
The client prefers freelancers from
a different location.
I'm new to Python and am looking to write a scraping bot with Scrapy / Slybot. The best way for me to learn is by example so I am looking for someone to write a scraping bot that I can learn from.
I will share the url of the site and page levels to scrape once we agree to start.
The site has around 300 listing pages so the scraper has to be asynchronous. The page template is pretty simple to extract data from and there are about 8 fields to extract on the page template. And I'm more interested in entries that contain certain keywords if thats possible.
The extracted records should be exported to a mysql database and json file. Page load errors should also be exported to the same database. The end user will need the data in Excel.
As I'm looking to learn from this the code should be well documented explaining what each operation is doing. I'm not new to programming but new to Python and scraping.
Sign in or Register to see more