Tengai is continuing to develop and is now entering into a validation study, conducted by Associate Professor Anders Sjöberg, CEO at Psychometrics Sweden AB. The psychometric study is a way to scientifically measure how consistent, effective and objective the robot interview is. And assess how accurately Tengai is predicting future candidate performance, which is a key factor to ensure client satisfaction.
The last couple of months have been critical to Tengai AB as the start-up chaos is finally settling. And it has been a busy time for Tengai and the team! Tengai got her first client and is now recruiting a new Digital Coordinator for the Swedish municipality Upplands-Bro. As well as, attending various events and seminars around Sweden, Europe, and the US. But with the fast development, we think it’s important to also have scientific evidence and do an objective evaluation. So that we can prove that Tengai’s interview methodology and ensure that the process actually works. And the validation study is especially important since the robot interview is an objective tool for recruiters and hiring managers to mitigate bias.
“Throughout the validation study, we will be assessing the robot’s unbiased methodology. And ensuring quality assurance by measuring the correlation between the candidate’s answers and other objective information.”
The research has now started and will continue through the fall of 2019. The purpose is pretty straight forward: to understand how the robot’s unbiased software interprets candidates’ answers during a job interview. And how that translates over to candidate performance. Associate Professor Anders Sjöberg, CEO at Psychometrics, is overseeing and leading the project forward. Sjöberg is working at the Department of Psychology at Stockholm’s Universitet, where he is teaching and researching selection processes. And he has been working with validation studies and psychological testing for many years. If you are interested in hs research and want to read more, check out his blog.
”I have been very skeptical when it comes to using AI to mitigate unconscious biases. And especially when the purpose is recreating human abilities. But Tengai is the first serious attempt I have come across where the development team is open to be scientifically evaluated. And actually, want to measure how effective and useful Tengai is during a recruitment process.”
The study will objectively measure if Tengai accurately and appropriately is interpreting the interview answers and if the results are consistent and reliable over time. And while we are learning about the correlation we also identify mistakes we see in other projects. So we can avoid making similar miscalculations and accidentally include unconscious and conscious bias in Tengai’s algorithm. The psychometric study will provide us with data-driven insights to establish Tengai as a recruitment tool in various stages of the recruitment funnel.