It is common to not have perfect alignment between Expert Contributors. This is because each person likely sees the role slightly differently based on their exposure to it, the role they hold in relation to it, and their own personal biases as to what success looks like.
Let’s clarify the concept of alignment and misalignment in Match Criteria, by discussing the impact of the Match Criteria Survey results have on the Match Score of a candidate. An important aspect to consider in assessing alignment is the rank order weighting of the five top Talents that results from the Match Criteria Survey. The most important Talent selected by the Expert Contributors will account for about 33% of the Match Score of a candidate, and this goes decreasingly for the second Talent (27%), third (20%) and so on. This means that misalignment on the 4th or 5th Talent in the hierarchy will only have mild impact on the overall Match Score of candidates. Therefore, we encourage you to focus more of your attention on the top three Talents As a rule of thumb, if the majority of the Expert Contributors have identified these Talents as important with three or more dots filled out of 5, one can consider their responses aligned. It is rather common to observe less alignment in the 4th and 5th Talents in the hierarchy.
What should I do to prevent or resolve misalignment?
We typically encourage the Expert Contributors selected for a role to fill the Match Criteria Survey while they have the job description in hand, to ensure that everyone is in tune with the requirements of the role. If despite that step, one observes misalignment in the top two Talents after the Match Criteria Survey has been filled by the Experts, we recommend inviting all Expert Contributors to sit together in a discussion and explore the similarities and differences in their perception of the role. This may shed light on certain aspects of the role that some of the Contributors did not consider while they answered the Match Criteria Survey. For example, a high performer might consider Team Work as unimportant in their daily tasks whereas the perception from their direct manager is that it is a necessary Talent to be successful in the role. Usually, an Expert Contributors roundtable will clarify the situation. You can then invite a Contributor who rethought their answers to go back and edit their Match Criteria Survey answers, which can then result in more alignment in your Match Criteria.
If you observe that one Expert Contributor appears to be clearly misaligned with the rest of the team, you always have the option to untoggled their input form weighting towards the Match Criteria. We do not typically recommend this option, as you want to be mindful that the intention of "increasing alignment" between results from different Expert Contributors may induce bias. It is normal to have discrepancies between your Experts’ results, and this is the beauty of the Match Criteria Survey as a tool to reduce bias as much as possible in the selection of candidates.
- Perfect alignment amongst the Expert Contributors of a Match Criteria is rare. This is because everyone has their own way to view the role.
- Not all misalignment impacts the Match Score of candidates equally. The top two Talents have the greatest weight in the assessment of a candidate's Match Score.
- Ensure that the Expert Contributors have a job description in hand and receive clear direction when they complete the Match Criteria Survey.
- Gather the team in a discussion to address grey areas if you observe considerable misalignment.