emtel 6 months ago

Formal performance reviews are the worst method for evaluating your workforce that has ever been tried, except for all the others.

For me, performance reviews are the single most demoralizing aspect of working at a large company. They are doubly demoralizing because I can see so many things wrong with them, but also can't imagine any system that would work better.

So what's wrong with them?

1. Over the long term, they incentivize people to work on things that have easily measurable short term costs and benefits. More difficult to measure costs and benefits get ignored. They also encourage sunk-cost fallacy. In almost any company, you're better off, at least in the short term, if you ship something that turns out to be a huge waste of resources later on, than if you make the decision "this isn't turning out the way we wanted, we should just cancel this project".

2. They pretend to be a relatively objective system, when in fact your performance rating at most companies is strongly (though not entirely) dependent on how your manager views you. Attempts to lessen the impact of point 1 above will generally increase the impact of this point. Research suggests that most of what passes for rational justifications are made up after the fact to support gut-level emotional decisions.

3. They replace intrinsic motivation with extrinsic motivation, which at least some research has shown can lead to much less durable motivation over the long run.

At one point I was very enamored of the way Valve does things, but now it seems that that sort of management approach produces super toxic cultures in the long run.

Ultimately it seems like the only way to get away from this stuff is to work for yourself or in a very small team with trusted partners.

  • ryall 6 months ago

    Wholeheartedly agree. I ended up scrapping our company's PR document and rewrote it for my department.

    Now it's more a performance review of the company and myself, and attempts to encourage my team to think about how we could improve the company. "What do you hate about your job? What do you like about your job? How could we apply some of the good points to other areas of the company?" Stuff like that.

    If you're underperforming, I should already know (if I'm worthy of my position). And I definitely shouldn't be waiting a year to talk to you about it.

  • snarf21 6 months ago

    I agree with what you are saying but I think performance reviews can be extremely valuable. The issue is that at all big companies they are used for promotions, raises and bonuses. They aren't designed to accurately measure or predict these things.

    To me, the right kind of review (and done every six months) is something that takes an employee only an hour and the same for the manager. Its only purpose is to set and review goals specific to the function and success of the team(s) the employee is/was on. The scores are more like pass/fail or exceeds/meets/doesn't meet expectations. It gives a regular structured time for employee growth review and can help with correcting communication and other soft skills.

    • SatvikBeri 6 months ago

      How do you decide promotions, raises, and bonuses then? I'd think of that as the main purpose of performance reviews.

      • snarf21 6 months ago

        That's a fair question. I think reviews shouldn't be about performance but rather about employee growth. It is a touch base to make sure everyone is on the same page. It should also direct an employee in their career path. These are discussions that also lead to "Would you like to manage people or remain an individual contributor?" "Okay, to do that you need to improve your skills at X".

        As far as bonuses, I think they should just be split regardless of performance. I think raises are tied to promotion but if it is CoL, then people just get it.

        As far as promotions go, this should be a broader discussion with lot of ancillary group managers as well and should focus on "Has this individual contributed at a level above their current pay and role?" "Do we all think this individual can handle this new role/level and be effective?" "Do we need more people at this role/level?"

  • johan_larson 6 months ago

    I've seen various performance management systems at eight different employers now. My conclusions:

    1. Some feedback is useful. Sometimes it's hard to be sure how you're doing, particularly if you're not super-sensitive socially.

    2. More is not better. Once a year is plenty.

    3. It's mostly subjective. Trying to draw clear lines is probably a waste of time. A very experienced organization may be able to create some guidelines, but they should be guidelines, not rules.

    4. In the end it's all about whether you are making the boss happy. The only reason to involve anyone other than you two in the process is when some of your work is genuinely out of view of the boss.

  • dunkelheit 6 months ago

    Good summary. For me the triply demoralizing factor is that (at least where I work) performance reviews are hugely hypocritical. There are some officially stated rules but they don't describe what is actually happening. E.g. officially admitting that there is any kind of stack ranking is a big no-no, but there is now way a team leader can get away with "well, every one on my team has exceeded expectations this year, give them all raises". Or the term "exceeds expectations" itself - actual expectations of your boss play little role compared to the perceived importance of your work.

    All of this is a kind of open secret, so the system is "fair" for some definition of fairness. Still, a novice will spend a couple of cycles to understand the unwritten rules of the game. At this point they will either start playing by the real rules or recoil in horror and suffer a blow to their motivation. Of course staying ignorant is also a possibility.

  • megous 6 months ago

    I haven't worked for a corp yet, but wouldn't another problem be that you're a team/system, but perf. review is focussed on the individual, and assumes that's where the problems or the success of the team arises from? So it's a bit reductionist.

    • eggpy 6 months ago

      Hopefully the manager of the team is also subject to performance reviews. Generally the manager of the team is responsible for the performance of the team, meaning the manager fails if the team fails or has significant problems.

      This is highly dependent on company environment however and obviously can come with it's own set of motivations and problems.

      • nradov 6 months ago

        Many organizations, especially larger ones, have a matrix structure in which project teams pull in resources who report to multiple different managers. So there may be a disconnect between the reporting manager and the team.

        It's also just as difficult to evaluate team performance as individual performance. With knowledge workers everything is so subjective, and trying to put objective metrics on it ends up being self defeating due to people gaming the system in ways that harm the broader organization.

  • mkobit 6 months ago

    I read about the culture of Valve a few years ago and it seemed interesting. What have you seen come out that changed your opinion?

deegles 6 months ago

"When a measure becomes a target, it ceases to be a good measure."

In this case, the measure is your position on the career ladder, not e.g. the success/failure of your product or company as a whole (unless that is required to advance). I feel that because of this, performance management at big companies leads to unnecessary product churn. Think about how many messaging apps Google has released, or how every product seems to get a top-to-bottom redesign every year or two... having been on the inside, I think this is definitely a symptom of employees optimizing for climbing the career ladder. Promotion Driven Development is a real phenomenon and is in the long-term detrimental to everyone. I don't know an easy solution to it, since bigger and bigger projects are required to "prove" that you should be promoted. Maybe in a few years people will have experienced this enough to think of a better way.

  • donavanm 6 months ago

    The phrase at my current work place is Promtion Oriented Architecture. Ive seen three general approaches, that I like.

    First the role descriptions & leveling guidelines have deemphasized complexity. Words like complex, large, feature, or new have been reduced or replaced where possible.

    Second there an emphasis on (business) value delivered. Fixing a broken system can provide as much or more long term value than building an additional or replacement system. Building a baroque ivory tower is actually a negative. This also ties back to point one.

    Third all senior role promotions include target level peer review, alongside the manager/candidate “promo doc.” The candidates potential peers perform an assessment of the body of work, leadership contributions, and results delivered. This is not limited to the most recent delivery/project/team. There are typically two assessors; one organizationally “near” the candidate and one “far.” For senior staff/principal/distinguished engineer positions theres also a mandatory peer review board.

    • babesh 6 months ago

      No wonder so many people are kissing up to the senior engineers.

shadester88 6 months ago

I find the obsession with performance reviews interesting. I manage teams of developers in a large organisation, and I have been doing so for many years now.

I hate performance reviews. I think they do not achieve what people think they do, they take up a lot of time and effort to decide and perform, and they often have quite a negative effect on the staff member.

I think performance reviews and KPIs for individuals just need to go. Get rid of them. If someone isn't performing, you can manage that without a KPI system. If someone is performing well, you can provide that feedback without a KPI system. We need to start having meaningful conversations, not scoring people.

People, like in this article, seem to double down on them and make them more complex and intricate in an effort to make them effective. They are going in the wrong direction. Just get rid of them altogether.

  • all2 6 months ago

    My gut tells me that these metrics are in place because upper management does not trust you to be objective or consistent when it comes to your people. Rather than actually trust your judgement, they give you a checklist and tell you to check the boxes.

    Along with a lack of trust, there's also the need for a paper trail in some states if it comes down to firing someone who needs firing. Without an appropriate paper trail the company would be on the hook for paying that individual's unemployment.

    I'm not saying you're wrong. In fact, I think you are right. Most people will rise to the expectations set for them (or fall, according to the expectations set).

    • shadester88 6 months ago

      You are correct in assuming the fact that you need a paper trail to fire someone. I work in Australia and firing someone for poor performance requires a fair bit of work.

      But for performance management, I basically have to put them on a performance management plan and set expectations. If they fail to regularly meet those expectations, then they can be let go. This generally takes a few months to progress through, giving the staff member the opportunity to prove us wrong.

      But this process is very different to KPIs. An important one, nonetheless.

    • tilolebo 6 months ago

      That and the fact that upper management also wants a way to compare employee performance ACROSS teams or departments to decide who's a "rising star", who deserves a promotion or a raise (because the raise budget is always limited so they want to pick the most valuable performers).

      Hence the "need" for a standardized performance review, which is bullshit anyway because a true equal assessment would mean that all employees are assessed by the same person/group, which never happens.

    • walshemj 6 months ago

      No its really because:

      1 In order for hr to justify themselves.

      2 As a hypocritical way to cut the pay quanta.

      • giobox 6 months ago

        I think HR can justify its existence probably just fine in the absence of annual performance reviews.

        Off the top of my head: Healthcare (especially in the US - as a non-native I was truly shocked the amount of HR time that is spent managing this...), benefits, immigration issues, legal disputes, compliance, pay, hiring and firing, disabilities... there’s plenty for a competent HR team to do at most medium or larger sized enterprises that isn’t performance reviews.

      • all2 6 months ago

        Just for giggles, lets say that a large company doesn't need an HR person or department.

        What are the alternatives? Is this something we could build an automated system around? Could the functions be moved to managers (hiring, firing, pay, etc.)? It seems like moving this way would be somewhat like implementing the officer/NCO relationship in the US military.

        Are there benefits for non-specialized decision making as it applies to employees?

        > pay quanta.

        What's that?

        • NewsAware 6 months ago

          >> pay quanta.

          > What's that?

          "paying a lot". So basically as away to combat a (perceived) inflation in salaries

          • all2 6 months ago

            So, amongst other things, it could refer to salary and raise confidentiality agreements as a way to reduce employee negotiating power?

        • walshemj 6 months ago

          Its the amount the pay bill increases sorry its a HR/IR term

pdimitar 6 months ago

With the risk of getting roasted, here are my top three impressions of the article:

(1) The guy is very deep in the management / higher-level business bubble and is extremely disconnected from the day-to-day work that enables his lifestyle. He seeks to optimize things that are mostly managerial / consultant lingo and don't have much connection to things in the real world. That's not 100% true of course but it mostly strikes me as such.

(2) Instead of de-formalizing the process he seeks to find more and more micro ways to measure people. This can probably work long-term, maybe, but many people have tried and failed many times in the past and I think it's arrogant to not take that into account in your supposed solution.

(3) He is not accounting for humans, like at all. I knew programmers that worked quietly for 3 weeks and then showed us all a gem that made us go "wowwwwww". In traditional systems like Scrum and any agile-based nonsense this is severely frowned upon. Truth is however, people are different and as long as you are happy with the average ($result / $month) of somebody then you should leave them the hell alone to find and optimize their own way of being productive.


The above is overly simplified and I am well aware there is a lot of nuance. But I didn't want to write a book so I settled for a condensed and partially inaccurate summary.

johnrob 6 months ago

Fundamentally, are performance systems done objectively or "on a curve"? Meaning, if 100% of the engineers are operating at say Staff Engineer level, do they all end up with that title? Or does the Staff Engineer title really come down to some sort of percentile in a stack ranking?

  • geofft 6 months ago

    For almost any company, if 100% of your engineers are senior, you're overpaying for talent (and probably burning out some talent, too) because not all the work that needs to be done is senior-level work.

    This is not the same thing as 100% of your engineers being good, by any means, so it's not quite a stack ranking problem. In particular you can solve it by hiring good junior people, as long as you're not overstaffed (and if you are overstaffed, you need to find a way to figure out who to get rid of, other than getting rid of all the junior people).

    • wpietri 6 months ago

      > not all the work that needs to be done is senior-level work

      Personally, I'm very suspicious of this theory. Whenever I've worked with a team that's all pretty senior, we work to automate away the boring stuff.

      • geofft 6 months ago

        Is automating away all the boring stuff actually the highest net business value approach you can take?

        It might be necessary to let people do it to retain senior people and keep their morale up, and I've certainly seen companies be successful by letting good people overengineer things simply because it lets them attract good people and have them around when they're needed, so if that's your strategy, go for it. But you might be better off having a person with market salary $X spend a week doing something they don't yet find boring (and will learn from so that they can become senior) than having a person with market salary $2X spend three days automating and writing tests for their automation.

        And there are a lot of interesting real-world problems (as in would-produce-business-value problems) that can't be automated, like gracefully remediating a legacy system where each user was able to get their own weird requirements supported. In the process of getting all the users onto a system you can automate, you need actual human time to work with each user and understand what they need out of your API surface, and while having senior people available is necessary for the complicated cases, it's unlikely to be necessary for all of them (and again, the ones that senior folks would find boring are good opportunities for junior folks to gain experience).

        • wpietri 6 months ago

          You seem to have two arguments here: training people up and short-term economics. The former is irrelevant to your point. Yes, if you have junior people, it's good to find things for them to do that are at their skill level. But that doesn't mean that there's no high-skill way to do the same work.

          I don't think the short-term economic perspective really means much in the long term. Sure, if you spend $6x automating something a junior person can do for $5x, then your apparent extra cost is $x. But that's only true if a) the problem never comes up again, and b) no problem particularly like that one comes up again. Given the history of our field, that sounds like a poor bet to me.

  • Cookingboy 6 months ago

    >if 100% of the engineers are operating at say Staff Engineer level

    Then you need to re-evaluate your definition of "Staff Engineer" at your company. Those titles are all relatively defined internally in the first place, just like junior/senior/staff/senior staff.

    There is no industry-wide benchmark for those levels, so an internal curve is the only system that makes sense.

    In the imaginary case where everyone in the company is a super high performer and everyone is equally as good, then it's not crazy to do away with those titles entirely as long as that's the case. But obviously that scenario won't last long as the company grows, and that's why titles/levels are gradually introduced.

    • vonmoltke 6 months ago

      > But obviously that scenario won't last long as the company grows, and that's why titles/levels are gradually introduced.

      For better or worse, Bloomberg does not have this. There are no formal levels or titles for ICs, despite having thousands of them. I thought it worked fairly well there.

    • kelnos 6 months ago

      If everyone actually is operating at a high level -- or at least enough to make a curve difficult -- keeping people under-titled is just a great way to allow your high performers to become discouraged and leave the company.

      • pbecotte 6 months ago

        Titles, in my mind, reflect duties and responsibility rather then level. Not everyone can be in charge of the same things and have leadership responsibilities...therefore they cant all be staff engineer.

        They CAN all be top performers at their responsibility list...

        • wpietri 6 months ago

          To me, "in charge" is a dominance relationship. It imposes artificial scarcity. Leadership and responsibility, on the other hand, aren't zero-sum quantities. I think one of the best things you can do with junior people is to find things for them to lead on as early as possible.

        • babesh 6 months ago

          Salary isn't the only thing people covet. Titles and responsibilities are also coveted since they increase future earning potential. When people don't feel that they can get them, they leave.

          • User23 6 months ago

            Neurotypical humans all crave social status. The higher expected future compensation is a nice bonus, but it's the status that draws people to higher titles.

  • munchbunny 6 months ago

    if 100% of the engineers are operating at say Staff Engineer level, do they all end up with that title? Or does the Staff Engineer title really come down to some sort of percentile in a stack ranking?

    If you actually have 100% of engineers operating at the Staff Engineer level, then it is what it is. However, the only case I can think of when that should ever be true is when you can count your developers on one hand. Once you grow any bigger, it's just not an efficient use of your money or the engineers' time to have that much experience concentration (as opposed to talent concentration, since more junior people can be talented too).

dammitcoetzee 6 months ago

I think we all tend to focus on building the system which is the most point of failure resistant rather than the point of failure itself. I've found performance reviews to be fantastically valuable and motivating when I have a good manager.

Rather than endless optimization of the system. Train your managers. Everything from giving good feedback to ignoring or forgetting a bias is a skill that can be learned.

Renaud 6 months ago

I liked the idea of Objectives and Key Results (OKR), a system that was started at IBM and brought over by John Doerr to Google and others[1]: short term goals alongside long term goals, set at the company level and the individual level, constant review and adjustment of the short term goals, disconnection of these metrics from employee bonus.

The idea is to get to you goals faster and re-evaluate them for relevance as you go along. Since they are not directly connected to pay there is less of a perverse effect where people are incentivised to work on improving their KPI at the expense of the rest.

[1]:"Measure what matters", by John Doerr

  • pdimitar 6 months ago

    > The idea is to get to you goals faster and re-evaluate them for relevance as you go along.

    I cannot see how this might be true in any situation except when your core product and efforts are always in one particular direction and a very particular area.

    Many companies shift focus -- partially or completely -- as they grow, so I cannot see the wins in the quoted approach. You might gain a perfect understanding of an area and how a feedback loop improves productivity there but is that such an universal wisdom that it applies everywhere else you might go in the future?

  • Draiken 6 months ago

    Then people create objectives like:

    O - Improve team efficiency

    KR - Increase test coverage by X%

    KR - Update at least Y outdated dependencies

    Which are complete bullshit, easily gamed and don't actually make the company move forward or the team better.

    But according to almost any OKR believer, these are great OKRs.

    Making KRs measurable a lot of the times corrupts the OKR system. However if they aren't measurable, their value is sometimes questionable. Kind of a paradox.

    Perhaps for huge corporations this kind of system is absolutely needed, but I'm experiencing this on a small company and it's honestly tiring and inefficient.

timdellinger 6 months ago

I think I missed the author's design goals for a performance management system: what it's supposed to accomplish.

Performance management systems have a natural tendency to degenerate into sources of toxic behavior... one of the most important design goals would be to avoid this, and one of the most instructive parts of a "how to" would be strategies in that vein.

As an aside: I've noticed that people who run performance management systems are under the impression that their system does a good job. After all, it chose them, didn't it?

simon_000666 6 months ago

Should be titles : “How to demotivate your workforce and kill your productivity 101”

supergeek133 6 months ago

There are two aspects to any system like this: 1) The "carrot" - goals you set to rate yourself on to (in theory) get a raise at the end of the year. Or qualify for a promotion.

2) Career feedback.

Now I've found for both of these if any review with your manager take longer than 10-20 minutes, something is amiss. This usually means you don't see eye to eye on either the state of your goals, or your performance.

That being said, without the carrot, I think most people wouldn't execute these at all.

anonymousJim12 6 months ago

Career ladders and 360 performance reviews? Deming would be disappointed...

  • zachrose 6 months ago

    I’ll bite, what did Deming say about this kind of thing?

    • ricardo_ramirez 6 months ago

      "The performance appraisal nourishes short-term performance, annihilates long-term planning, builds fear, demolishes teamwork, nourishes rivalry and politics… it leaves people bitter, crushed, bruised, battered, desolate, despondent, dejected, feeling inferior, some even depressed, unfit for work for weeks after receipt of rating, unable to comprehend why they are inferior. It is unfair, as it ascribes to the people in a group differences that may be caused totally by the system that they work in."

    • analog31 6 months ago

      Deming told a story of visiting a business and seeing a plaque on the wall honoring the "employee of the month." He asked how many employees the business had. The number was exactly 12.

User23 6 months ago

This is assuming that the input data is high quality. It isn't.

trhway 6 months ago

i wonder what the guinea pigs have to say about their experience there.

iddan 6 months ago

This website's scroll is unbearable.

tschwimmer 6 months ago

This site somehow manages to interfere with trackpad gestures on my MBP. I could not swipe back or forward. How is this even possible?

  • have_faith 6 months ago

    They've written their own scrolling logic (why...) which involves cancelling or stopping propagation of the normal gesture and events. They broke scrolling on purpose and accidentally broke other things in the process.

    • aaaaaaaaaab 6 months ago

      The absolute state of web development...

      • noir_lord 6 months ago

        I wish there was a single flag to disable all that crap such that developers had to consider users who have the flag set, better still if it's on by default or behind a permission check

        'This site would like to hijack your scroll wheel/touchpad', it's genuinely infuriating.

        • aaaaaaaaaab 6 months ago

          That flag is called “Disable JavaScript”.

  • chriswait 6 months ago

    I decided to use the feedback/chat mechanism at the bottom right to suggest they don't do this. Maybe with enough feedback...

  • draw_down 6 months ago

    Works great in reading view!

superioritycplx 6 months ago

Can everyone in Silicon Valley just stop trying to disrupt humanity and let humans be humans? Please?

draw_down 6 months ago

What I've run into is that the evaluation works the same even if your situation doesn't match up with what's assumed by the evaluation.

The evaluation assumes you are part of a staffed, functioning team, with a manager who is actively engaged in what you're working on and can help you navigate the organization to achieve things. But if you're by yourself, working under a manager whose "real job" is something totally different and thus has no time for you, the evaluation amounts to a farce.

Sadly for you in this case, the organization must feign "objectivity" and so there's no way to admit that for your case the evaluation doesn't make sense. Or to put it another way, the organization is interested in evaluating you, but uninterested in evaluating itself, ie, the extent to which it provides an environment you can succeed in. They didn't hold up their end of the bargain but still expect you to hold your end.

And if you're senior enough, they will turn all this back around on you as problems you should be proactive in solving. So not only do they evaluate how you "perform" in the middle of a big mess they made, they're expecting you to clean up the mess at the same time, with no credit.

It sucks. It's demoralizing, and really makes the whole process feel like a sham.