RepleaderBot

RepleaderBot is the program that collects public records for Repleader. It identifies itself with this user agent:

RepleaderBot/1.0 (+https://repleader.net/about/bot)

What it reads

• Open court data from Free Law Project CourtListener, through its published API.
• Official feeds and newsroom pages of federal agencies and state attorneys general.
• Public SEC EDGAR filings and company data.
• News publisher RSS feeds, for headlines and links only. It never fetches article pages.
• Public job board feeds, for counts of open roles.

How it behaves

• It obeys robots.txt and skips any feed whose terms forbid reuse.
• It sends conditional requests, so unchanged pages are not downloaded again.
• Agency and publisher sites: at most one request every 10 seconds per site.
• SEC EDGAR: at most 2 requests per second, under the SEC fair access limit of 10.
• CourtListener: well under its published API limit.
• When a server answers that it is busy, it waits as asked, or at least a minute, and doubles the wait each time.
• It does not log in, get past access challenges, read paywalled pages, or buy court documents.

Contact

To ask RepleaderBot to slow down or stop visiting your site, write to editor@repleader.net, or disallow it in your robots.txt.