I am posting a similar request that I found previously.
I would like to scrape the data from the following websites every 5 minutes. Some have an XML feed and some just have live lines on their site without having to login.
I need the event name, date, time the game starts, rotation number, what teams are involved (and which is home/away), type of bet, odds. I'm a little familiar with XML and could work with that, but it doesn't seem like all the sites have a XML feed and I don't know how to scrape the data from those places. I also don't know how reliable XML feeds are. I would prefer that you scrape the tables, some sites might require you to log in. Eventually I plan on comparing the odds that are scraped from each site so that I can see which odds are the best.
Also, I'd like for it to check if the line changed. If it did add the new entry to the database with the time it checked, if not then don't bother to add it.
Some of the sites I want to get data from are:
[login to view URL] / [login to view URL] / [login to view URL] / [login to view URL] / [login to view URL] / [login to view URL] / [login to view URL] / and maybe others, we can talk about this.