If anybody gets to judge their colleagues, it should be someone as close as possible to that person. In other words, their teammates. The further someone is from that person, the less right they have to be judging, assessing, or measuring them.
Looking at you, HR.
Second best is their direct manager, especially if they have had a long-term relationship. This is yet another reason to separate people management from work management. Work structures may change fluidly all the time, but let’s keep people structures stable so that personnel managers get to know their people.