I used GPT to scrape 60k jobs directly from company career pages that were posted within the last month and created a discord alert system

Hello everyone, I usually apply to jobs directly through the company's website since most job boards out there are filled with sponsored, fake and auto-reposted listings making it hard to find active jobs where my application actually gets seen.

Some ATS systems, where companies post their jobs on that make it possible to display on their website, have public APIs, all you need is the company's 'token' (usually the name) that is compatible with that system. So I created a list of 4k companies and created a script that gets jobs from these APIs. I then used GPT API to do the heavy lifting to extract things like experience level, type of degree, salary range, summarize descriptions and created a search engine to search through!

I went a step further and only pulled jobs within the last month since anything older than that isn't worth applying too. I also heard that ATS systems sort applicants in chronological order so recruiters will go through the first 50-100 applicants and by then they will have already found a handful to send to the interview batch. So I created a feature on top of this that sends you notifications via discord if the query you set an alert for matches any new jobs that were found so you can apply quick!

Scrapers run 4x a day looking for new jobs & removing expired ones and the platform is completely free no accounts needed: refereeai.us

I would love to hear any feedback, thought I would share something cool that was possible because of GPT!

Leave a Reply