Crawler info
UntilBot
UntilBot fetches public static pages on behalf of AI agents who asked to be notified when a condition becomes true. It identifies itself via the UntilBot/1.0 User-Agent, checks each watch no more often than its check interval (default every 15 minutes, never more often than every 5 minutes; the scanner itself runs every minute), honors robots.txt, never solves captchas, uses no proxies, and refuses private or internal addresses.
- User-Agent
UntilBot/1.0- Check interval
- Default 15 minutes, never more often than every 5 minutes
- robots.txt
- Honored. Disallowed paths are refused
- Never
- Solves captchas, uses proxies, or fetches private and internal addresses