176985602337900

Find freelancers. Lose those costly delays.

With 1.7 million freelancers, we'll match you with the perfect talent.

or, Register with Elance »

Very simple website scraping program (Python, Scrapy)
Sign in to Add to Watch List

IT & Programming > Software Application

View Change History

The client has made the following changes to the job.

Description
Date
Close

Job Description

  |  Change History >>

Updated

Close
  • Posted: Thu, Feb 21, 2013
  • Time Left: Closed
  • Location: Anywhere
  • Client prefers freelancers from:
    Anywhere

    You are still able to submit a proposal for this job.

    The client prefers freelancers from
    a different location.

    You're still able to submit a proposal for this job, regardless of your location.
  • Start: Immediately
  • Budget: Less than $500
  • Fixed Price Job
  • Elance Escrow Protection
  • U.S. freelancers must have W9
Sign in to view client's details

I'm new to Python and am looking to write a scraping bot with Scrapy / Slybot. The best way for me to learn is by example so I am looking for someone to write a scraping bot that I can learn from.

I will share the url of the site and page levels to scrape once we agree to start.

The site has around 300 listing pages so the scraper has to be asynchronous. The page template is pretty simple to extract data from and there are about 8 fields to extract on the page template. And I'm more interested in entries that contain certain keywords if thats possible.

The extracted records should be exported to a mysql database and json file. Page load errors should also be exported to the same database. The end user will need the data in Excel.

As I'm looking to learn from this the code should be well documented explaining what each operation is doing. I'm not new to programming but new to Python and scraping.

Sign in or Register to see more

Desired Skills
HTML, PHP, Python, Scrapy
Job ID: 38171373
 
Proposals
Avg $ | High $ | Low $ — Show Pricing
  • Submit Date (Latest)

 United States  |  
Been away from Elance for a while, but the feedback I do have is good. I'm returning mainly interested in responsive front-end web development, or...
1
  |  
 0.0   |  $0 Earnings   |  0 Jobs
Bid ID: 38375605  |  Submitted: Feb 27, 2013 04:48 ET 
Proposal SEALED

 Bangladesh  |  
High throughput and low maintenance system and network architecture is our specialty. We believe that systems should be resilient to failure and...
6
  |  
 4.9   |  Private   |  48 Jobs
Bid ID: 38286025  |  Submitted: Feb 25, 2013 08:23 ET 
Proposal SEALED

eGrove Systems      
One or more team members at  are verified.  Learn More
 United States  |  
eGrove Systems is global IT solution provider located in USA - Parlin, NJ. We provide both onsite and offsite IT solutions at a very competitive...
3
  |  
 3.7   |  Private   |  50 Jobs   |  3 verified credential(s)
Bid ID: 38201827  |  Submitted: Feb 22, 2013 13:52 ET 
Proposal SEALED

 China  |  
I'm a freelancer with good experience in web app development and mobile app development. Python or flash(actionscript 3) or iOS related projects...
1
  |  
 0.0   |  $0 Earnings   |  0 Jobs
Bid ID: 38193346  |  Submitted: Feb 22, 2013 10:06 ET 
Proposal SEALED

 United States  |  
Skills include Objective-C (iOS), Java (Android), Ruby/Rails, Python/Django, Javascript, HTML5/CSS3, Go, Scala, and many others.
4
  |  
 5.0   |  Private   |  3 Jobs
Bid ID: 38190484  |  Submitted: Feb 22, 2013 08:45 ET 
Proposal SEALED

 India  |  
I got my Bachelor's Degree in Computer Science and Engineering the year before last. For a year after that I worked for a start up named Notikum,...
1
  |  
 0.0   |  Private   |  0 Jobs
Bid ID: 38187094  |  Submitted: Feb 22, 2013 06:57 ET 
Proposal SEALED

Kapor Z.      
Kapor Z.'s identity has been verified.  Learn More
 China  |  
INVITED
8 years Python experience 5 years Django experience #Web Dev Tech# Python, Django, TastyPie, Haystack, Solr, MySQL, PostgreSQL, SQLAlchemy,...
10
  |  
 4.9   |  Private   |  5 Jobs
Bid ID: 38174097  |  Submitted: Feb 21, 2013 23:40 ET 
Proposal SEALED

 United States  |  
I've been developing since 2001 with a focus in PHP. My focus is with technology and entrepreneurship. In late 2001 I created a social website...
1
  |  
 0.0   |  $0 Earnings   |  0 Jobs
Bid ID: 38171560  |  Submitted: Feb 21, 2013 21:57 ET 
Proposal SEALED
Elance is now an Upwork company.
Upwork is the choise of 4M+ clients. Get started working on Upwork today.
Are you ready to post a job like this one?
Post a Similar Job »