Create a web crawler connected to gmail

Concluído Postado Feb 23, 2016 Pago na entrega
Concluído Pago na entrega

The project is very simple.

Here is the full and exact description:

It should be a web script, running from a linux server via cronjob once every 15 minutes doing the following:

1. Login via IMAP to a gmail account

2. Grab all the emails with a spesific label

3. For each email extract 1 unique URL located within the contents of the email - it will be always the same domain name, different ending. for example: [url removed, login to view] or [url removed, login to view]

4. Each Email grabbed need to:

4.1 Change the label of the email to a different label

4.2 Create a new line in a simple mysql DB with the following data: Email date, Email title, the extracted link, Status

5. Each link is leading to a page that has 2 variations only - it's easy to distinguish which is it when crawling the URL because there are certain phrases to look for in the page, according to the variation the "Status" of this URL is determined and updated in the database

6. The script has to run every 15min and also check if the status of the "pending" has changed - if it did, change that status in the database, if not - check again in 15min and so on.

7. The page which will show the data in the database should be a simple page with a table that is sort-able, showing the emails with the "pending" status first, and there should be a pagination system which will make sure to show only 15 emails per page, so it will load fast, also there should be an option to search for the data in this table via 1 general search.

This is it, The person to do this task has to have an experience in web crawling, and can create this simple system within a few single days.

We are looking to pay no more than 100$ for this project. Please bid only if you are able to do this project now within this price range.

Thanks in advance!

HTML5 JavaScript MySQL PHP Captura de dados na web

ID do Projeto: #9743124

Sobre o projeto

17 propostas Projeto remoto Ativo em Mar 1, 2016

Concedido a:

anmok

I can write node.js app for solving this task. It will no require cronjob. I understand a most things you want to get except of status. Is script should detect status using the extracted link? Should a script page use Mais

$111 USD em 3 dias
(5 Comentários)
3.3

17 freelancers estão ofertando em média $184 nesse trabalho

mistersoft

Hello! I am expert PHP/MySQL programmer with over 10 years experience with different API. I can write this script for you very quick and with best quality.

$200 USD in 3 dias
(480 Comentários)
7.9
mantislin

Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi

$325 USD in 6 dias
(319 Comentários)
7.4
techwelfare

Dear Sir we are capable of performing the required task perfectly with accuracy, please let us know if you want to clarify in details.. if you want us to share our skill and previous work please initiate the chat b Mais

$222 USD in 9 dias
(152 Comentários)
7.0
ferozstk

Hello, Thank you very much for this Web Scraping Project. I read through the job details extremely carefully and understand your required, for this I am absolutely sure that I can do the project very well. I can compl Mais

$155 USD in 3 dias
(92 Comentários)
6.4
Verz1Lka

Hello! I'm web scraping expert. I use python language and scrapy framework. My scripts works on windows, mac or linux, but linux is preferably. I can schedule scripts on server if it is required. I have more 200 fi Mais

$200 USD in 10 dias
(105 Comentários)
6.5
WebDeveloperBR

Hi, I can do it.. already made a few scripts with IMAP and Gmail before.. I'm a web scraper expert (please check my reviews: 5 stars with 100% completion rate).. I have computer science degree + specialization in we Mais

$200 USD in 5 dias
(24 Comentários)
5.5
RajakScripts

Hi, I can help you to do that, below are my responds/questions: #4.1 Is it a fix/constant label? Or, is there a convention/rule to provide the label (please inform)? #4.2 I assume the line you mean is a new Mais

$100 USD in 4 dias
(39 Comentários)
5.2
mervf

I have read over your project description and I'm interested in completing your task. If you check my site or portfolio you will see that I am of a higher quality than most freelancers on here. I get it done quickly, e Mais

$216 USD in 3 dias
(20 Comentários)
4.0
sayli2

Hello, I can write web crawler for gmail with your mentioned features. --- Thanks Warm Regards Sayli

$300 USD in 7 dias
(9 Comentários)
2.9
ravivadadoriya

I have read ur description and can able to do this

$100 USD in 6 dias
(0 Comentários)
0.0
namitmahuvakar

A proposal has not yet been provided

$222 USD in 40 dias
(0 Comentários)
0.0