Add Spider Feature to PHP website

SPIDER, INDEXING, DIRECTORY I want my website [login to view URL] to be index, spider, and directory at the same time. I already have the directory feature, but I need to make my website able to spider and index websites. Must provide fast and relevant search results. add spider to my website directory. I want my website to be able to spider up to 100 or 500 links per site submitted. The links spidered does have to be in the directory, but in the database for searching. The search result must be very relevant. The website must search in keywords, title, and descriptions. The script must be scalable and been able to handle more than 1,000,000 websites. Only the administrator will be able to choose which sites to spider. The spider must be able to retry title, description, and keywords, from websites. A good spider example is "Sphider" at [login to view URL]~ando/sphider/ but the problem with this script is that it only can add 100,000 websites which is not enough. AJAX I want some ajax on the script also. The ajax part should suggest as you type. Like the example here: [login to view URL]~ando/sphider/[login to view URL] When users type a word, the script will display the same and similar keyowrds to search and will display the amount of result too. Just like the example of the URL above. NO need advanced search. In other words, I want you to integrate Sphider features at [login to view URL]~ando/sphider/[login to view URL] to my website at [login to view URL] But remember that the links spired will not appeared in the category sections, but only in the search result. Search result must be very fast and relevant.