Crawler Disclosure

This page is the public disclosure for the automated agent that identifies itself as:

LeMayCivicRegister/1.0 (+https://massachusettstimes.us/crawler)

What it is

It is the civic services verification instrument of the publications of The United States Society of the Press, of which The Massachusetts Times is a member. The civic register publishes the telephone numbers and addresses of public services. This agent is how the register checks that what it prints is still what the government itself publishes.

What it fetches

It fetches named official government pages, the specific pages the register cites as its sources, to verify the telephone numbers and addresses the register publishes. It fetches one page at a time, at the pace of a person reading.

How it identifies itself

Every request it makes carries the one identity string shown above, unchanged. It never presents itself as a browser or as any other agent. The address inside that string is this page.

How it treats robots.txt

Before it fetches from a site, it reads that site's robots.txt. It reads the rules written for its own name and the rules written for every agent, and where the two differ it follows the stricter. If robots.txt cannot be read, it does not fetch.

Refusals

It never works around a refusal. When robots.txt closes a page or a server declines a request, it does not fetch that page by another identity or by any other route.

Licensing and contact

Licensing and every other inquiry about this agent run through the License Desk, at license@uspress.institute. The terms of record are published at https://license.uspress.institute, and the terms that govern automated access to this publication are its Machine Terms.