Develop a scraper to analyze information about a website

The code will run via API (No UI needed).

Input: a list of website URLS

Out put: The list of URL's with this extra data about the site:

- Company type: Manufacturer / Online Store / SMB (Suggestion to how to find this data is below).

- Is the website mobile friendly: yes / no

- Load speed (Homepage load speed in msec)

- Is Google analytics installed: yes / no

- Is there a link to facebook: yes/no

- What CMS is used: Wordpress / Joomla / Wix / Drupal/ ExpressionEngine / TextPattern / Radiant CMS / other.

- Contact form link (The URL where a contact form is, if there is one).

Finding the "company type":

In order to find this information, first analyze the text on the homepage.

1- Look for links with the text "products" "our products" "product catalog" also look for "distributors" "find a distributors" and so on. Usually companies that have a link with this language are "manufacturer".

2- Look for "cart" "checkout" or "add to cart" links. If these are present, this is an "online store"

3- Look for "opening hours" or "directions" in the website. Usually if this text is present, this is an "SMB" (small/medium business).

Habilidades: Processamento de dados, PHP, Python, Arquitetura de software, Captura de dados na web

Ver mais: website develop company in rajasthan, develop company website, develop website content for software development company, website develop company, software write mq4, software write chip epson, useful software write book, software write web specs, free software write user guide, software write edid, free software write company profile, software write websites idea, css based website develop company recent project, software write book images, software write books, software write protection, free software write book, software develop company profile bangladesh, excel website information, vba excel capture website information, software write book, website information excel, develop company knowledge base, update website information automatically php, siemens information systems ltd good company work

Acerca do Empregador:
( 24 comentários ) San Francisco, United States

ID do Projeto: #11741982

Premiar a:


Hello! I am a professional programmer with many years of web scraping experience using Python. I have read your project description, and I can create the website analysis program you require. To do so, I will use the l Mais

$133 USD em 3 dias
(52 Avaliações)

16 freelancers are bidding on average $121 for this job


Dear sir, I am scraping expert, I have did too many scraping projects, please check my reviews then you will know. Can you tell me more details? then I will provide example data/script for you. Thanks, Mais

$68 USD in 2 dias
(259 Comentários)

Hello Dear, HERE Ready to start!!! I can perfectly do it. I have lot of experience related and different types of projects. I am waiting to your quick positive reply. Feel free ask me question if any. I Look for Mais

$250 USD in 3 dias
(197 Comentários)

hi sir i had very high and fresh quality 2016 list may be u interested of it [url removed, login to view] 2016 150,000 email list [url removed, login to view] [url removed, login to view] 2016 150,000 Mais

$50 USD in 3 dias
(70 Comentários)

Hello My name is Pranav I have checked the details shared by you will do done exactly what you want Please consider my bid and we can discuss more so that i can assist you in better way our services always with Mais

$155 USD in 7 dias
(65 Comentários)

Hi! While reading your project description, It’s proud to say that I can demonstrate my professionalism on the highest level. I am ready to assist you day and night, 24/7. Your queries/questions will be answered promp Mais

$105 USD in 3 dias
(61 Comentários)
$272 USD in 5 dias
(44 Comentários)

Python programmator since 2012. I used to create a lot of applications about Web Scraping/Crawling with BeautifulSoup/Selenium/PhantomJS/lxml I love Computer&Hack and I'd like to share my passion helping someone with c Mais

$277 USD in 3 dias
(18 Comentários)

Hello, I am a Highly Experienced Freelancer from India. I have read your project description and I have some questions regarding your project. I would like to talk to you directly to discuss more about the project. You Mais

$165 USD em 1 dia
(12 Comentários)

Pretty straight forward we could even use Google Pagespeed API to extract even more meaningful data. I intend to use Python 2.7, python-mechanize, requests lib, RabbitMQ as a Queue broker and MongoDB as the database wh Mais

$140 USD in 2 dias
(1 Comentário)

I mainly create eye catching eCommerce sites and high quality service websites. I love WordPress and social media. I will create website in WordPress platform for you and promote using social media. I also know sear Mais

$30 USD in 3 dias
(0 Comentários)

A proposal has not yet been provided

$45 USD in 2 dias
(0 Comentários)

I and my friend are python proggramer. We wrote some codes that get and analyse urls and informations from different news web sites. So we can do what you want.

$88 USD in 3 dias
(0 Comentários)
$155 USD in 3 dias
(0 Comentários)

A proposal has not yet been provided

$55 USD em 1 dia
(0 Comentários)

Hi, I'm Sayma Jahan. I have enough experience in this field. I can easily complete this project as per your instructions. How much is your budget and how long will be the time frame? Thank you.

$30 USD in 3 dias
(0 Comentários)

Dear sir Your project is based on..............................I have done many job like as your project. Provide me your budget, time frame and more detail's please ! Thanks.

$35 USD in 3 dias
(0 Comentários)

Hello there! My name is Dasha, i'm Business Development Manager in InternetDevels company. We are located in Ukraine and having 100+ developers with 9+ years of experience in the Drupal and around 11 years of experien Mais

$155 USD in 3 dias
(0 Comentários)