About LastModBot
LastModBot
checks if the server returns the last modification time of the page (last-modified
) and correctly responds to the If-Modified-Since
request.
What User-Agent does LastModBot use
Mozilla/5.0 (compatible; LastModBot/0.1; +https://last-modified.com)
Mozilla/5.0 (compatible; LastModBot/0.1; +https://last-modified.com/en)
How to block LastModBot
User-agent: LastModBot
Disallow:/
How to allow access LastModBot
User-agent: LastModBot
Allow: /
How to allow access LastModBot and block others
User-agent: LastModBot
Allow: /
User-agent: *
Disallow: /