Find freelancers. Lose those costly delays.

With 1.7 million freelancers, we'll match you with the perfect talent.

or, Register with Elance »

Python data mining and web scraping using Scrapy
Sign in to Add to Watch List

IT & Programming > Software Application

View Change History

The client has made the following changes to the job.


Job awarded.

Apr 1, 2011

Job awarded.

Mar 31, 2011

Job Description

  |  Change History >>


  • Posted: Tue, Mar 29, 2011
  • Time Left: Closed
  • Location: Anywhere
  • Client prefers freelancers from:

    You are still able to submit a proposal for this job.

    The client prefers freelancers from
    a different location.

    You're still able to submit a proposal for this job, regardless of your location.
  • Start: Immediately
  • Budget: Less than $500
  • Fixed Price Job
  • Elance Escrow Protection
  • W9 Not Required
Sign in to view client's details

I am looking for a skilled Python programmer with knowledge of web scraping and data mining.

The task is to write a web crawler using the Scrapy framework (see   [obscured]  /). The crawler will extract detailed product information from a consumer website (see the detailed specification below).

I will provide examples of three existing, production-ready and fully working crawlers. You are to base your implementation on these examples but remain open to deviate from the template if the site's structure requires you to do so. I cannot make the existing crawlers public, so I will provide them to you privately. Please ask if anything is unclear.

You are expected to write clean and well-structured code that fits into my existing codebase.

Solid experience of Python is essential. A solid understanding of how modern consumer retailer websites works is essential. A solid understanding of Javascript, DOM traversal and XPaths is essential. Experience with Scrapy is a large plus but not es...

Sign in or Register to see more

Desired Skills
Python, Scrapy, Web scraping
Job ID: 23609653
Avg $ | High $ | Low $ — Show Pricing
  • Submit Date (Latest)

 Romania  |  
Hello, dear visitor. I'm Lucian, a Python developer specializing in web development. I have 4+ years of Python experience and 3 years of doing web...
 0.0   |  $0 Earnings   |  0 Jobs
Bid ID: 23623664  |  Submitted: Mar 30, 2011 02:59 ET 
Within 1 week

 Ukraine  |  
Seasoned sysadmin, Big Data developer/analyst.16 years of experience in IT area. Ph.D. in Applied Mathematics.
 0.0   |  Private   |  0 Jobs
Bid ID: 23616015  |  Submitted: Mar 29, 2011 14:18 ET 
Within 3 days
Elance is now an Upwork company.
Upwork is the choice of 4M+ clients. Get started working on Upwork today.
Are you ready to post a job like this one?
Post a Similar Job »