Develop a scraper to analyze information about a website

$30-250 USD

Concluído

Publicado

há mais de 7 anos

$30-250 USD

Pago na entrega

The code will run via API (No UI needed). Input: a list of website URLS Out put: The list of URL's with this extra data about the site: - Company type: Manufacturer / Online Store / SMB (Suggestion to how to find this data is below). - Is the website mobile friendly: yes / no - Load speed (Homepage load speed in msec) - Is Google analytics installed: yes / no - Is there a link to facebook: yes/no - What CMS is used: Wordpress / Joomla / Wix / Drupal/ ExpressionEngine / TextPattern / Radiant CMS / other. - Contact form link (The URL where a contact form is, if there is one). Finding the "company type": In order to find this information, first analyze the text on the homepage. 1- Look for links with the text "products" "our products" "product catalog" also look for "distributors" "find a distributors" and so on. Usually companies that have a link with this language are "manufacturer". 2- Look for "cart" "checkout" or "add to cart" links. If these are present, this is an "online store" 3- Look for "opening hours" or "directions" in the website. Usually if this text is present, this is an "SMB" (small/medium business).

Data Processing

PHP

Python

Software Architecture

Web Scraping

ID do Projeto: 11741982

Sobre o projeto

15 propostas

Projeto remoto

Ativo há 8 anos

Quer ganhar algum dinheiro?

Endereço de e-mail

Benefícios de ofertar no Freelancer

Defina seu orçamento e seu prazo

Seja pago pelo seu trabalho

Descreva sua proposta

É grátis para se inscrever e fazer ofertas em trabalhos

Concedido a:

@mwarrenschultz

Hello! I am a professional programmer with many years of web scraping experience using Python. I have read your project description, and I can create the website analysis program you require. To do so, I will use the libraries Requests (for web automation tools), BeautifulSoup (for parsing html), and Selenium (for working with AJAX and Javascript). I have written very similar programs in the past, and I would be happy to show examples. Please contact me so we may speak further and so I can send files. Thank you for your consideration.

$133 USD em 3 dias

4,9

(69 avaliações)

6,5

15 freelancers estão ofertando em média $118 USD for esse trabalho

@mantislin

Dear sir, I am scraping expert, I have did too many scraping projects, please check my reviews then you will know. Can you tell me more details? then I will provide example data/script for you. Thanks, Kimi

$68 USD em 2 dias

5,0

(447 avaliações)

7,9

@amitarai

Hello My name is Pranav I have checked the details shared by you will do done exactly what you want Please consider my bid and we can discuss more so that i can assist you in better way our services always with you even we complete the project My Portfolio https://www.freelancer.com/u/amitarai.html

$155 USD em 7 dias

4,9

(84 avaliações)

6,2

@sanidhayy

Hello, I am a Highly Experienced Freelancer from India. I have read your project description and I have some questions regarding your project. I would like to talk to you directly to discuss more about the project. You can message me directly from this screen. Looking forward to your response. Thanks.

$165 USD em 1 dia

4,8

(13 avaliações)

4,1

@arthurbarros

Pretty straight forward we could even use Google Pagespeed API to extract even more meaningful data. I intend to use Python 2.7, python-mechanize, requests lib, RabbitMQ as a Queue broker and MongoDB as the database while parsing data.

$140 USD em 2 dias

5,0

(1 avaliação)

0,2

@shumiakter

Dear sir Your project is based on..............................I have done many job like as your project. Provide me your budget, time frame and more detail's please ! Thanks.

$35 USD em 3 dias

0,0

(0 avaliações)

0,0

@saymajahan

Hi, I'm Sayma Jahan. I have enough experience in this field. I can easily complete this project as per your instructions. How much is your budget and how long will be the time frame? Thank you.

$30 USD em 3 dias

0,0

(0 avaliações)

0,0

@muhamedze

A proposal has not yet been provided

$55 USD em 1 dia

0,0

(0 avaliações)

0,0

@halilceliksu

I and my friend are python proggramer. We wrote some codes that get and analyse urls and informations from different news web sites. So we can do what you want.

$88 USD em 3 dias