176985602337900

Find freelancers. Lose those costly delays.

With 1.7 million freelancers, we'll match you with the perfect talent.

or, Register with Elance »

PHP Webcrawler fertig stellen -Finish PHP crawler
Sign in to Add to Watch List

IT & Programming > Other IT & Programming

View Change History

The client has made the following changes to the job.

Description
Date

Job awarded.

Nov 9, 2010
Close

Job Description

  |  Change History >>

Updated

Close
  • Posted: Wed, Nov 03, 2010
  • Time Left: Closed
  • Location: Germany
  • Client prefers freelancers from:
    Germany

    You are still able to submit a proposal for this job.

    The client prefers freelancers from
    a different location.

    You're still able to submit a proposal for this job, regardless of your location.
  • Start: Immediately
  • Budget: $500 - $1,000
  • Fixed Price Job
  • Elance Escrow Protection
  • W9 Not Required
Sign in to view client's details

Ich suche jemanden, der einen teilweise vorhandenen Webcrawler (PHP) fertig programmiert.

Das soll der Crawler können:

1.) Man gibt ihm eine Liste mit URLs, die er nacheinander (oder parallel?) abarbeitet. Der Crawler verfolgt alle internen Links, bis er nicht mehr weiter kommt. Alle externen Links, die er findet, schreibt er in eine Datenbank.

2.) Für alle externen Links wird der HTTP Statuscode überprüft.

3.) Externe Links, die keinen Statuscode haben, werden weiter überprüft: Whois-Check, um zu prüfen, ob die Domain frei ist.

4.) Wenn sie frei ist, dann die DOmain auf Archive.org-Alter und Backlinks (Yahoo) überprüfen.

Die Geschichte soll einigermaßen performant sein und dann auf einem eigenen Server laufen.

Multithreading müsste also hinzugefügt werden.

Es wurde bis dato ein OpenSource Crawler Script verwendet. Der Crawler kann schon folgendes: Man gibt ihm eine URL, er läuft die URLs nacheinander durch und prüft den Statuscode. Alles weitere fehlt...

Der Service Provid...

Sign in or Register to see more

Desired Skills
MySQL Administration, PHP
Job ID: 21789263
Proposals
Avg $ | High $ | Low $ — Show Pricing
  • Submit Date (Latest)

 Germany  |  
INVITED
I’am a Senior WordPress Specialist with 9 years of experience in OpenSource technologies and software packages.
1
  |  
 0.0   |  Private   |  1 Jobs
Bid ID: 21817236  |  Submitted: Nov 5, 2010 19:52 ET 
Proposal SEALED

 Germany  |  
INVITED
Short description about yourself or your company
1
  |  
 0.0   |  $0 Earnings   |  0 Jobs
Bid ID: 21800368  |  Submitted: Nov 4, 2010 08:26 ET 
Proposal SEALED

 Germany  |  
INVITED
I'm a german Junior Software Developer (Ausbildung Fachinformatiker / Anwendungsentwicklung) with 5 years of experience in Java and Web Development...
Skills: Drupal, PHP5
1
  |  
 0.0   |  $0 Earnings   |  0 Jobs
Bid ID: 21799210  |  Submitted: Nov 4, 2010 06:04 ET 
Proposal SEALED

Introduction: Data Crops, a unit of Aruhat Technologies Pvt. Ltd., been formed to serve global customers with a basket of multiple business...
2
  |  
 0.0   |  Private   |  0 Jobs
Bid ID: 21797677  |  Submitted: Nov 4, 2010 02:57 ET 
Proposal SEALED

 Germany  |  
INVITED
14 years web-development experience. I don't make design, but I can program you anything: from a Web 2.0 guestbook to custom-built web-based CRM...
1
  |  
 0.0   |  $0 Earnings   |  0 Jobs
Bid ID: 21793615  |  Submitted: Nov 3, 2010 17:03 ET 
Proposal SEALED

 Germany  |  
INVITED
I'm a young, motivated, friendly, efficient PHP developer.
1
  |  
 0.0   |  $0 Earnings   |  0 Jobs
Bid ID: 21790083  |  Submitted: Nov 3, 2010 11:53 ET 
Proposal SEALED

 Spain  |  
Winner
11 years of experience in the development of websites and deployment of server infraestructures. Experienced system administrator on Unix and...
1
  |  
 0.0   |  $0 Earnings   |  0 Jobs
Bid ID: 21789482  |  Submitted: Nov 3, 2010 11:01 ET 
Delivery
Within 1 month
$800.00
Sign in to Elance and start working on jobs today.
Sign in to view more of the job details and submit a proposal. Once registered, you'll have access to thousands of jobs online or through email.
Are you ready to post a job like this one?
Post a Similar Job »