Since it uses spiders, how does JobCentral avoid duplication of jobs in its National Labor Exchange database?
Currently, JobCentral obtains jobs into two ways: 1) it indexes (scrapes) jobs from employer websites and; 2) it allows employers to enter single jobs directly through a web interface. Only registered employers can post jobs. No duplicates are generated in these two processes. Duplicates may occur when the JobCentral NetworkJobster, Indeed, SimplyHired, and Google–is searched. However, these search results are not co-mingled with those from the JobCentral National Labor Exchange.
Related Questions
- So JobServer uses a database for persistence, what happens if the database crashes? Will jobs still run properly?
- Since it uses spiders, how does JobCentral avoid duplication of jobs in its National Labor Exchange database?
- How will the JobCentral National Labor Exchange and state self-service websites be governed?
