Introduction
Knowing the importance of quality, we perform a benchmark on the external data. It helps us assess the quality of results we get when we identify skills automatically against how it is done by the most established provider.
Here is what we do:
- We take 363 random job postings in English (from all industries, and all countries).
- We manually identify with experts which skills should be detected as the 100%-quality baseline.
- We compare which skills were identified by HRForecast and the most established provider.
- We use the skill extractor offered on the website of the most established provider.
- We used the skill extractor of smartPeople to add skills to a user profile.
As a result of benchmarking, we get the following:
- Extensive, valuable, and complete skill library
- High-quality algorithm of skill extraction
Our algorithm does not just extract skills, it also takes into account the context. Let’s consider the following example:
A pipeline refers to the Data Engineering topics. With that, pipelines take both natural gas and oil over vast distances, and thus, they are a topic in the Energy structure engineering. So the algorithm is smart enough to know that it is:
a data pipeline in the IT domain OR an oil or gas pipeline in the energy industry
Overall benchmark result
The test was conducted in April 2023 with 363 random job postings in English.
HRForecast accuracy
Leading provider accuracy
skills extracted from a job posting
skills extracted from a job posting
Job profile sample
Let’s consider an example of the job profile taken from one of the worldwide job postings.
Where do we position against leading provider?
Below you can find the results of extracting skills by HRForecast and a leading provider. You can compare them and discover the differences or similarities.
HRForecast accuracy
Leading provider accuracy
skills extracted from a job posting
skills extracted from a job posting
Extracted skills
Total number of skills to identify | ||
Correctly identified skills |
Next step
Well done! You can use our Help Center anytime as your resource for guides, troubleshooting, and tips about smartData.