Crawler Information

What We Do

Rollie Jobs works with chambers of commerce, economic development organizations and workforce partners to promote local job opportunities. We find publicly posted jobs and bring them together so job seekers can find them and regional leaders can understand their local job market.

Crawling Practice

  • Frequency: We check most companies for new jobs once a day. Some companies are checked weekly or monthly, depending on how often they post and how their careers site is built.

  • Rate limits: If a site asks us to slow down, we do. When a server rate-limits our requests, we back off and try again later.

  • Public data only: We only collect job postings that anyone can see without signing in.

  • No logins or paywalls: We never use accounts, sign in to sites or get around paywalls.

How We Use The Data

  • Job postings are combined into local job-market insights for our partners.

  • Partners use them to understand local workforce and economic trends.

Where Job Seekers Go

  • When a job seeker clicks a job we found, we send them to the original posting, usually in the employer's applicant tracking system.

  • If we can't link to the posting itself, we send them to the company's general careers page.

  • If a company has no careers page, we send them to the page with the contact information they need to apply.

  • Rollie Jobs does not accept applications for jobs we collect from other sites. Job seekers always apply through the employer.

Opt Out of Crawling

Rollie Jobs only collects job postings that are publicly available without an account or login.

Employers

If you would prefer that we not collect your job postings, email info@rolliejobs.com with the subject line "No Crawl Request" and include your company name and careers site. We honor every employer request: once confirmed, we stop collecting your postings, wherever they are hosted, and remove the ones we have.

Job Boards and Applicant Tracking Systems

If you host postings for other employers and have concerns about our crawling, contact info@rolliejobs.com

Rollie Jobs is committed to ethical web crawling practices and building mutually beneficial relationships with job boards and employers.