Build/configure bot to scrape data from php website behind login

Encerrado Postado há 5 anos Pago na entrega
Encerrado Pago na entrega

I am working with a membership organisation that has recently launched a new membership site.

The legacy site allowed users to create 'Learning Diaries', to which they added 'Activity' records. These need to be extracted to a CSV file in order to migrate them, but the legacy site has no export function.

The steps the bot would need to take:

-Log in as admin

-Click on a link that says 'Members'

-This will return a page with a search box

-Search for member by membership number (these are unique and can be provided)

-The search query returns a page with links to each of the 'diaries' that member has created. Each 'diary' spans a three year cycle and users have between 1 and 3 diaries.

-Click on the link to one of the diaries

-The resulting page displays a page with: member name and diary data (i.e., date activated), and underneath this is a table with all 'activities' that user has added to that diary.

-The bot needs to search for each membership number and scrape the diary header and activity data from each of the diary pages for all members. There is an estimated 8000 entried.

-The activities data should map to a csv file with the diary header fields, including the unique identifier for each memer, and the activity details on each row, so that a join can then be created to the new database based on the unique member identified on each activities.

JavaScript MySQL PHP Arquitetura de software Captura de dados na web

ID do Projeto: #18391413

Sobre o projeto

25 propostas Projeto remoto Ativo em há 5 anos

25 freelancers estão ofertando em média £158 nesse trabalho

mhmhz

Hi I can create the bot that search for the membership numbers. The tool can be ready in 1-2 days Do you want to have the tool or just the data? Thanks

£250 GBP em 1 dia
(219 Comentários)
7.9
mantislin

Hi sir, This is Lin and I am scraping expert, please check my reviews then you will know. Can we discuss more details about this project? Thanks, Lin

£250 GBP in 5 dias
(428 Comentários)
7.8
uumarkhalid31

​I specialize in web scraping jobs like this one. You can see on my profile that I have completed many similar jobs. Don't make the mistake of hiring an amateur, who doesn't have the skill set to properly complete Mais

£200 GBP in 3 dias
(237 Comentários)
7.2
DevStar925

Hello. I read your project description carefully, and I am very interested in your project. I have full experience in web scrapping, automation bot in several sites. I can show my simple sample via teamviewer if you Mais

£150 GBP in 3 dias
(63 Comentários)
7.1
schoudhary1553

Hello sir, I can help you with your project Build/configure bot to scrape data from php website behind login. I have the good experience in Javascript, MySQL, PHP, Software Architecture, Web Scraping. Please see my Mais

£150 GBP in 3 dias
(84 Comentários)
6.7
novepi1

Hi there, The requirements are quite clear and straightforward to implement so no questions really. I just need the list of that membership numbers so that bot can run the search for each user. Also, to make sure th Mais

£100 GBP em 1 dia
(47 Comentários)
6.1
mladenbiz

Hello, I read the description of your project, and I'm interested in working with you. I'm experienced in building all kinds of scraping software in Python, usually using libraries like Scrapy and Selenium. I also have Mais

£150 GBP in 3 dias
(33 Comentários)
5.5
anislazaar

Hello. I'm a Java developer and I've worked on many similar projects like this. I can provide you with a nice and powerful java bot that will scrape the data you want in no time thanks to the async and parallel pr Mais

£80 GBP in 2 dias
(18 Comentários)
5.1
arjun366333

Ready to start the work to scrape data from php website, We can discuss more over chat, Thanks Regard Kanta S.

£110 GBP in 3 dias
(27 Comentários)
5.5
ayozerb

Hello! I am Ayoze, a Spanish senior developer with wide experience in data scrapping, as you can check in my profile. I am sure I can do this job for you but if you can share some more information (webpage, creden Mais

£177 GBP in 3 dias
(4 Comentários)
4.7
JinxinMa

Dear client, Thank you very much for viewing my proposal! I have great experience in web scraping and data mining. I will use Python as my primary tool for the project. I am an expert at Python and its various Mais

£150 GBP in 3 dias
(3 Comentários)
4.2
iGTTech

Hello There, I have 7+ years of hands-on experience efficiently coding websites and applications using modern HTML, CSS, JavaScript, Bootstrap, jQuary, CakePHP, PHP, WordPress, WooCommerce, Laravel, Yii2, MySQL, SQL, Mais

£210 GBP in 3 dias
(10 Comentários)
3.2
readymakers

I am confident I am the right candidate for this project as I have done many similar projects in the past. With years of experience in this field, I believe this project will be very easy for me.

£357 GBP in 6 dias
(3 Comentários)
2.8
fahmidj

Hi, To develop the bot what language do you prefer? In case you consider my bid can you please provide me with URL of the legacy site? Thanks

£77 GBP in 7 dias
(3 Comentários)
1.8
nkrfreelancer

My bid is for One Website Automation ... And... one set of bot tasks doing a robotic process automatically. I have used Workfusion Automation in many of my recent projects. and, you would save lot of cost on auto Mais

£54 GBP em 1 dia
(0 Comentários)
0.0
RhinoTech

Hi! I have gone through your job post. I am a dedicated Software developer based out of Lawrence, MA Our expertise in Ecommerce & CMS Build websites using WordPress. Provide technical support to clients. W Mais

£111 GBP in 3 dias
(2 Comentários)
0.0
jacobien

i will make a java spring boot programme that uses phantomjs so i can performe any web scénario you want if it's not ajax web site i can use jsoupe To make a fast programme

£111 GBP in 3 dias
(0 Comentários)
0.0
MrTefke

Hey! i can get it done sounds like a easy project i can get you a windows software with all your requirements within 3 days done a bunch of php website scrapers in the past sound like a nice little christma Mais

£111 GBP in 3 dias
(0 Comentários)
0.0