Solved

Interpreting entry in raw access log

Posted on 2014-10-30
2
141 Views
Last Modified: 2014-10-30
We have the following entry in our log:

 [09/Oct/2014:15:23:20 -0700] "GET /location1/location2/location3/doc1.pdf HTTP/1.1" 404 - "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
157.55.39.165

This entry is referencing a file that we removed from the server about 4 weeks earlier for security reasons.  In fact, the whole directory was removed.  Trying to get some info on this entry--does it just mean that the Bing Bot was previously aware that the file existed and was just trying to re-verify it or ?

Thanks.
0
Comment
Question by:Jason92s
2 Comments
 
LVL 34

Accepted Solution

by:
Seth Simmons earned 500 total points
ID: 40413761
that's what it looks like; trying to verify the link is still valid but returned a 404 so it probably removed it from it's index
0
 
LVL 84

Expert Comment

by:ozo
ID: 40414654
A web link to that entry may have previously existed somewhere (and may still exist somewhere even though the file and directory are removed)
Some bots may also construct links ex nihilo just to see if they can dig up something.
I might even construct a link to it in this post, if I could guess an address for the server
0

Featured Post

Complete VMware vSphere® ESX(i) & Hyper-V Backup

Capture your entire system, including the host, with patented disk imaging integrated with VMware VADP / Microsoft VSS and RCT. RTOs is as low as 15 seconds with Acronis Active Restore™. You can enjoy unlimited P2V/V2V migrations from any source (even from a different hypervisor)

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Anti-virus for Linux Server 15 124
Error installing extension Linux 4 58
add some character at the end of line in vi 7 61
Linux VM 6 36
Article by: kevp75
Hey folks, 'bout time for me to come around with a little tip. Thanks to IIS 7.5 Extensions and Microsoft (well... really Windows 8, and IIS 8 I guess...), we can now prime our Application Pools, when IIS starts. Now, though it would be nice t…
If you are a web developer, you would be aware of the <iframe> tag in HTML. The <iframe> stands for inline frame and is used to embed another document within the current HTML document. The embedded document could be even another website.
Learn how to get help with Linux/Unix bash shell commands. Use help to read help documents for built in bash shell commands.: Use man to interface with the online reference manuals for shell commands.: Use man to search man pages for unknown command…
Get a first impression of how PRTG looks and learn how it works.   This video is a short introduction to PRTG, as an initial overview or as a quick start for new PRTG users.

912 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

22 Experts available now in Live!

Get 1:1 Help Now