Ogni
asked on
Searching online (for a file) without an url... Possible ?!
Hi !
I want to look after a function that's work like the google-picture-searches. In other words: I want to look after a file online without having an url... A webrobot without a starting url...
Thanks a lot for your help!
Sincerly,
Ingo
I want to look after a function that's work like the google-picture-searches. In other words: I want to look after a file online without having an url... A webrobot without a starting url...
Thanks a lot for your help!
Sincerly,
Ingo
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
oh .. do it the hard way :)
finding all the sites your way would be very very hard
there are "unlimited" number of combinations
you could search your nameserver, get the nameservers in it's list and so on (dunno how to actually do this)
get the host names from all these dnss
upto here you can only get domain names
every domain can have tons of sites hosting
so you'd also need to get every domains sites
this 'big search' should be done at start, then you should cache the found addresses
IMO the search engines like google are basically a huge mirror for all the sites
so sometimes you can get results from google, when you check the link your results are not there because google has a local copy of the site
that was just an idea .. I have no idea how to realize that
have fun :)
finding all the sites your way would be very very hard
there are "unlimited" number of combinations
you could search your nameserver, get the nameservers in it's list and so on (dunno how to actually do this)
get the host names from all these dnss
upto here you can only get domain names
every domain can have tons of sites hosting
so you'd also need to get every domains sites
this 'big search' should be done at start, then you should cache the found addresses
IMO the search engines like google are basically a huge mirror for all the sites
so sometimes you can get results from google, when you check the link your results are not there because google has a local copy of the site
that was just an idea .. I have no idea how to realize that
have fun :)
ASKER
Hi Lee !
Your answer don't help me really but there's no other... So it's yours ;-)
Thanks,
Ingo
Your answer don't help me really but there's no other... So it's yours ;-)
Thanks,
Ingo
sorry couldn't help more .. it's just not my 'territory' :)
ASKER
Thanks a lot ... I know it - d.bolton wrote the same in his article using google for an own web-crawler...
For me it's not a solution ... perhaps another one's using my prog ;-)
At google you have to be registered for a license-key and an account is necessary, too.
A complete download-function is not the problem yet...
I'm looking for an algorithm getting all the urls...
Something like starting with "aaa.cc"... "aab.cc"... "aaa.com"... and ending with "zzz...tv"... or so ;-)
Perhaps there are more ideas ?
Best regards,
Ingo