StreetFeedBot
StreetFeedBot is the web crawler of StreetFeed (streetfeed.co). It reads public investor-relations pages, and the documents posted on them, to track companies' investor events.
User agent
StreetFeedBot/0.1 (+https://streetfeed.co/bot; admin@streetfeed.co)What it reads
Public investor-relations pages, company newsrooms and press releases (including newswire feeds), and the documents companies post there, to track their investor events: earnings calls, investor days, conference presentations and shareholder meetings.
How often
- One request at a time per site, at least 5 seconds apart.
- Most sites see a few requests a day.
- If a site answers
429or503, or sets aCrawl-delay, StreetFeedBot waits as asked.
What it never does
- Log in
- Submit forms
- Buy or register for anything
- Get around a block or a challenge
- Use your content to train AI models
What we keep
Event details (dates, times, webcast links) and the documents companies publish for investors, always linked back to the original page.
Verify a request
Signature
Every request is signed with Web Bot Auth (HTTP Message Signatures, RFC 9421). Public keys: streetfeed.co/.well-known/http-message-signatures-directoryIP address
159.89.39.247, also at streetfeed.co/bot/ips.jsonReverse DNS
The address resolves tocrawler.streetfeed.co, which resolves back to the same address.
Block or slow it
StreetFeedBot follows robots.txt, including Crawl-delay. To block it:
User-agent: StreetFeedBot
Disallow: /Or to slow it down (seconds between requests):
User-agent: StreetFeedBot
Crawl-delay: 30Contact
admin@streetfeed.co, to ask us to slow down, stop visiting your site, or allow-list StreetFeedBot.
Last updated: 10-08-2026