We are a small personal project to optimize the search for my dream job. We believe that automation can let us invest time in things that really matter, like preparing for job interviews and sharpening skills, as opposed to mindlessly searching.
What it reads: public job postings on employers' career sites.
How it behaves: it follows robots.txt, always identifies itself as
docketjobs-bot, and requests at most one page per second from any
site. It re-reads robots.txt on every run, at least once a day.
To stop it reading your site, add these two lines to your robots.txt:
User-agent: docketjobs-bot Disallow: /