For site owners
JobworthyBot
JobworthyBot is how Jobworthy reads job postings for the people who use it. If you've seen it in your logs, here's what it does and how to control it.
How it identifies itself
Every request carries a user agent containing JobworthyBot and a link to this page, for example:
JobworthyBot/1.0 (+https://jobworthy.app/bot; job-posting reader for one user)
What it reads
- A job posting that someone pastes into Jobworthy or our free ghost-job checker: that one page, fetched when they ask.
- A page someone shares to add detail to their own profile, such as a portfolio or project page.
- Public job-board feeds published by Greenhouse, Lever, Ashby and SmartRecruiters, to check whether a posting is still open and to spot new roles at companies people choose to watch.
- LinkedIn's public job pages, the versions anyone can see without signing in, for LinkedIn job links people paste and for Discover, which shows people new roles that match their targets.
What it never does
- Sign in, create accounts, or read anything behind a login.
- Submit forms or apply for jobs.
- Crawl your site. It reads the specific pages above and nothing else.
robots.txt
Before it reads a page someone pastes in or shares for their profile, JobworthyBot checks that site's robots.txt. It follows the rules for JobworthyBot, or for * when there are none, and won't read a page they disallow. To keep it out of your whole site:
User-agent: JobworthyBot Disallow: /
The job-board feeds above are APIs those platforms publish for reading job listings, so they're read directly.
The exception is LinkedIn: Jobworthy reads LinkedIn's public, signed-out job pages for the uses above without applying LinkedIn's robots.txt, and leaves a pause between requests.
Questions or problems
If JobworthyBot is causing you trouble, or you'd like us to stop reading your site, email hello@jobworthy.app with your domain.