I have a number of pages of a site that have a paramater that I would like, when a robot finds it, will ignore it.
Can I make one disallow to cover anything that ends in /foobar.raw ??
Specifically, can I put the following in the robots.txt file
....and then it would take care of all instances where /foobar.raw is the last item in a url?