Bulk WHOIS Parser and crawler PHP OR Python

Hello. I have worked on a similar project before. See here: https://www.freelancer.com/projects/PHP-MySQL/Bulk-DNS-WHOIS-checkup/ You can send only 100 requests per day with a single proxy/IP. So with 500 proxies just 50,000 per day and 30*50k=1.5M per month. So with 500 proxies you can check just 1.5M domains per month that is very far from what you need. But don't worry! :) I know some ways to bypass the limits. If you give me a powerful server, I can handle everything else. Please contact me for more details. Thanks, Helmot

yes i am familiar with whois limits by TLD/CCTLD, i have no questions as i understood what u need and its clealrly explained by you in project description

Hello, I understood the initial scope of this project. Although i want to discuss further this job in order to prepare the final concept for this project. After Complete discussion over the call or in chat, i will prepare following things for you - Technical Project Proposal - Flow chart for this Project - Execution plan (Step by step procedure with explanation how and at what that we are going to execute a particular task)

Hello, I have gone through your outsourced requirements "Bulk WHOIS Parser and crawler PHP OR Python" and have analyzed that I have right skills (MySQL, PHP, Python, Software Architecture) to execute your esteemed project. I will complete your project within 2 weeks, LIFETIME error free guarantee and provide 365 days (ONE YEAR) support... ===== Why choose me? ===== 5.0 / 5.0 rating, 100% completion rate, 100% on-time completion, 100% on-budget :) Kindly, check my profile: http://www.freelancer.com/u/BitLabs.html I work smart, hard, and strictly bid only what we can do! No sub-contracting... ever! You will never go wrong choosing me :)

Hello! I am a professional programmer with many years of web scraping experience using Python. I have read your project description, and I can create the WHOIS querying program you require. To do so, I will use the libraries Mechanize (for web automation tools), BeautifulSoup (for parsing html), and Selenium (for working with AJAX or Javascript, if necessary). I have written very similar programs in the past, and I would be happy to show examples. Please contact me so we may speak further and so I can send files. Thank you for your consideration.

Hello, I've done similar project for validating emails and I would like to mention few issues that you will tackle. Whois response depends not only on the client (script host) but it depends even more on NIC server. If you have a lot of domains for which whois request is sent to the same server you will slow down that server. Using proxy (I've used SocksiPy) might slow down query execution as well. It ended up in bying IPs (2$-3$ per IP) and directly connecting to whois server using available IPs on that server. Also, I would like to have more details about storing and displaying results. I would like to suggest distributed DB where you would have master server which will distribute tasks to other ones (workers). Multipocessing on each worker might enable you to have even more requests per second. Can you please specify me how many servers do you have. I'm willing to write you simple demo script but I would like you to understand the scope of this task. Thanks, Stevan

The project is in the areas of my experties and I would like to discuss this further. Please note that this bid is just and estimate and I would need to discuss the details before I give a more accurate estimate.

Hi My name is Michael I have read your brief and can see that you need a bulk WHOIS parser and crawler. I have 6+ years Python development experience, particularly good at parser and crawler. I'd like to discuss further with you about taking this project on. Michael

I am a fast and diligent programmer who is proficient in Python. Not only that, I am eager to prove myself, which means that I will spend the next three days working day and night to get this done for you for the cheapest price possible in your budget range.. Once you contact me, I will get to work immediately and will not stop until I finish for you. Looking forward to it.