176985602337900

Find freelancers. Lose those costly delays.

With 1.7 million freelancers, we'll match you with the perfect talent.

or, Register with Elance »

Python data mining and web scraping using Scrapy
Sign in to Add to Watch List

IT & Programming > Software Application

View Change History

The client has made the following changes to the job.

Description
Date

Job awarded.

Apr 1, 2011

Job awarded.

Mar 31, 2011
Close

Job Description

  |  Change History >>

Updated

Close
  • Posted: Tue, Mar 29, 2011
  • Time Left: Closed
  • Location: Anywhere
  • Client prefers freelancers from:
    Anywhere

    You are still able to submit a proposal for this job.

    The client prefers freelancers from
    a different location.

    You're still able to submit a proposal for this job, regardless of your location.
  • Start: Immediately
  • Budget: Less than $500
  • Fixed Price Job
  • Elance Escrow Protection
  • W9 Not Required
Sign in to view client's details

I am looking for a skilled Python programmer with knowledge of web scraping and data mining.

The task is to write a web crawler using the Scrapy framework (see   [obscured]  /). The crawler will extract detailed product information from a consumer website (see the detailed specification below).

I will provide examples of three existing, production-ready and fully working crawlers. You are to base your implementation on these examples but remain open to deviate from the template if the site's structure requires you to do so. I cannot make the existing crawlers public, so I will provide them to you privately. Please ask if anything is unclear.

You are expected to write clean and well-structured code that fits into my existing codebase.

Solid experience of Python is essential. A solid understanding of how modern consumer retailer websites works is essential. A solid understanding of Javascript, DOM traversal and XPaths is essential. Experience with Scrapy is a large plus but not es...

Sign in or Register to see more

Desired Skills
Python, Scrapy, Web scraping
Job ID: 23609653
Proposals
Avg $ | High $ | Low $ — Show Pricing
  • Submit Date (Latest)

 Romania  |  
Winner
Hello, dear visitor. I'm Lucian, a Python developer specializing in web development. I have 4+ years of Python experience and 3 years of doing web...
3
  |  
 0.0   |  $7,696 Earnings   |  0 Jobs
Bid ID: 23623664  |  Submitted: Mar 30, 2011 02:59 ET 
Delivery
Within 1 week
$220.00

 Ukraine  |  
Winner
Seasoned sysadmin, Big Data developer/analyst.16 years of experience in IT area. Ph.D. in Applied Mathematics.
11
  |  
 5.0   |  Private   |  0 Jobs
Bid ID: 23616015  |  Submitted: Mar 29, 2011 14:18 ET 
Delivery
Within 3 days
$120.00
Sign in to Elance and start working on jobs today.
Sign in to view more of the job details and submit a proposal. Once registered, you'll have access to thousands of jobs online or through email.
Are you ready to post a job like this one?
Post a Similar Job »