I have created many similar utils in Java for dumping databases, parsing files and data mining from websites. I bided little high, because I dont know exact specifications about how many links will enter process, rate of recursion in newly found links, etc. I offer simple Java *.jar file with sources for easier portability between different OS. Have a nice day, Marek.