I need some scraping software for gettig property information from estate agents onto my website.
I have a new website which is free to use so im on a tight budget. The data needs to be taken from each website and put into a blm file(within a zip file) in a certain format. The sample file on rightmove shows the format [login to view URL]
Some fields i will keep blank but for those the symbol for an empty field will need to be present (^) I will then be able to either manually add the blm file to my website using browse or preferably it would be automatically added to my ftp is possible.
each agent will have a different ID which i create manually in my website but this would need to appear in the blm file each time, To keep data refreshed id need new data either weekly or fourtnightly. Im happy to manually set up a project for each new agent/branch and to manually add agency ID and click on sections on their website to scrape from but i need every project result to come out the same and in the same format so that it smoothly updates my website with no problems.
My website is pads4people.co.uk. My website has been set up so that it can recieve mass upload blm files in Rightmove format. Im going down this road because feed agents wont feed to me in rightmove format without a huge fee so i need to cut them out of the process. Im looking to pay a small payment per agent set up and for script to sit on my ftp. The data needs to be automatically rescraped every 24 hours to my ftp. This is an ongoing job where id pay per agent so please dont quote me a large one-off payment.
Hi,
I am a Perl programmer with more than 8 years of experience. And webscraping is my domain. I am confident of providing you high quality service.
Thanks,
ppan279.