Why Are There So Many Bad Bosses? (Update)

2024/4/11

Chapters

How can I remember to invest every month? With the Fidelity app, you can choose a schedule and set up recurring investments in stocks and ETFs. Oh, that sounds easier than I thought. You got this. Yeah, I do. Now, where did I put my keys? You will find them where you left them. Investing involves risk, including risk of loss. Fidelity Brokerage Services LLC, member NYSE SIPC.

Hey there, it's Stephen Dubner. This week we wanted to share an episode from our archives that's one of our most popular episodes. Perhaps because...

It talks about a problem that many of us have had. It's called, why are there so many bad bosses? I hope you enjoy it. And if by chance you have already listened to this episode, do stick around to the end for a career update from this person. My name's Katie Johnson, and I'm a data scientist. Johnson is 33 years old and lives in England. She grew up near Bristol, went to university in Birmingham, and held a series of increasingly impressive jobs

at a series of companies. These were all what are known as IC jobs, IC standing for individual contributor, which means what? It is someone who makes as opposed to managing people who make. Johnson loved being an IC. She loved analyzing data and she was really good at her job.

But after a while, she thought it might be nice to become a boss. Yeah, I wanted to manage more and more people. And you wanted to manage more people because why? You were just power hungry like the rest of us? I think there's a couple of reasons. So the first is that I wanted to start getting more autonomy over what I was working on. I would be working on stuff in my IC role and I think this isn't the most important thing. And I thought that if I became the leader of the team, then I would get to pick...

what I worked on. Okay, that seems sensible. The other reason was to have more impact at the companies I was working at. So you could describe this as having a seat at the table. Also sensible. I guess

I guess the final reason is that we all kind of, not everyone, I guess, but I was included in this, have a concept that being more successful means being more senior. And so in order to not necessarily show others, but definitely myself that I had achieved and become successful, I needed to keep moving upwards within a company. Johnson's father in his own career had seen things differently.

So my dad has been a network engineer. He recently retired, but he's been that for his whole career. And he had absolutely no aspiration to become the manager. He's like, why would I want to do that? But Katie Johnson did want to become a manager and several firms were willing to make her one. She took the most appealing offer at a software firm that helps companies acquire new customers. And I was sent on some management training and had to do what can only be described as a very long personality test.

And the idea was to tell me what I was good at being good at. And what was she particularly good at? Critical thinking, attention to detail, courage, all these internal thinky type characteristics. You can see why Katie Johnson would seem to be a great boss. Her new job title was head of data and analytics. She had roughly 10 people reporting to her. The promotion came with more money, more prestige, more leverage to set the agenda.

Also, however, more meetings. Oh, so many meetings. Like compared to being a data scientist, I'd maybe have a half hour meeting in the morning and then I'd just be free to do coding and thinking and making stuff. But I was in meetings. I think Tuesdays I used to be in meetings for like seven hours. No offense, but did you not see that coming? No.

No, I really didn't. I thought it would just be like my normal data scientist job with a few one-to-ones on the side. That was okay because it's quite interesting. You're talking about the work, you get into quite depth and problems with my team. It's more like the meetings, like an hour's coffee with someone to try and set up a better working relationship with their team. Times that by like five or 10 other teams. It's just draining.

Keep in mind, this was happening during the pandemic shutdown. So all these meetings were virtual. And as drained as Johnson was from all those meetings, she was getting good reviews as a manager. Yes, people would tell me what a great job I was doing. I was coming across well. But she found that being a boss made her better.

I would finish my day and my study, walk into the living room, put a blanket over my head and cry because I was in so much pain at how bored I was. In retrospect, Katie Johnson had plainly erred in wanting to become a boss. But she'd also felt that management was the only sensible way to advance her career. And if you look at how most firms and institutions around the world operate, you'd have to agree with her.

The question is, does this standard operating procedure produce good bosses or bad bosses or even horrible ones? The horrible boss is a familiar caricature. We all know the stereotypes, the screamer, the sadist, the idea stealer, the passive aggressivist. These are some of our most enduring characters in film. You remember Blake from Glengarry Glen Ross, played by Alec Baldwin? Put that coffee down.

Coffee's for closers only. Do call yourself a salesman, you son of a... Or in the film Office Space, when Peter is trying to escape the office on Friday afternoon and he gets snagged by the boss. Hello, Peter. What's happening? Um, I'm going to need you to go ahead and come in tomorrow morning.

So if you could be here around nine, that would be great. Okay? Oh, oh, and I almost forgot. I'm also going to need you to go ahead and come in on Sunday, too. Then there's Miranda Priestley, played by Meryl Streep, in The Devil Wears Prada. You have no style or sense of fashion. Well, I think that depends on what you're... No, no.

That wasn't a question. The horrible boss motif is so attractive that the director Seth Gordon made a film called Horrible Bosses. Yeah, we got to trim some of the fat around here. Trim the, what do you mean by trim the fat? I want you to fire the fat people.

Truly horrible bosses do occasionally turn up in real life, especially in Hollywood itself. The producer Scott Rudin, for instance, has been accused of years worth of alleged abuses, like smashing an assistant's hand with a computer monitor. But even in Hollywood these days, and especially in more normal industries, this sort of grotesquery is harder to get away with. Bosses who are outright monsters are more likely to lose their jobs.

But how much attention are we paying to the more common type of bad boss? Someone who's simply incompetent or overstretched or even just miserable being a boss like Katie Johnson was? Do we even know how many bad bosses are out there?

The more you dig, the more you learn that the science of boss behavior is not very scientific. One Gallup poll shows that roughly 50% of American employees have at some point in their career left a job because of a bad boss. But an employee might have 10 or 20 bosses over a career, so maybe that number isn't so bad. A survey of European employees found that only 13% rated their current boss as bad.

So maybe the Hollywood caricature is way off. Still, considering that nearly all of us will at some point in our lives have a boss or be one, we thought there might be some boss questions worth asking. And so today on Freakonomics Radio, when a boss is a bad boss, have you ever wondered why? There's no reason to believe that a great salesperson will be a great manager. And yet this kind of promotion happens all the time.

Why is that? So there are two ways to motivate people. We can pay them a whole lot more, or we can give them an opportunity for promotion. Today on the show, why good employees become bad bosses, and whether that will ever change. Spoiler alert, probably not. This is Freakonomics Radio, the podcast that explores the hidden side of everything, with your host, Stephen Dubner. Whoa!

One of the reasons I became a writer years ago is because I didn't particularly like having a boss. Like Katie Johnson, I prefer to set my own agenda, my own pace. I also really like working alone. Also like Katie Johnson, I am not particularly fond of meetings, so I wouldn't be a very good boss either.

Fortunately, at Freakonomics Radio, there are a couple other people who do all the bossy stuff, leaving me pretty much free to do this, what we're doing right now, asking questions, trying to find answers. So here's a question I've always been curious about. How important are bosses anyway?

I don't mean CEOs, the ultimate boss. If you're interested in that, we once did a series called The Secret Life of CEOs. Today, we are just talking about your standard issue middle manager. Do they really matter? Yes. Broadly speaking, managers matter. Bosses matter for outcomes. That is Steve Tadellas. He's an economics professor at UC Berkeley's Haas School of Business, a training ground for future bosses.

Management is not something that Tadellas himself aspires to. Tell me how close you are to administration so I know how far away to be from you. But he has spent time, while on sabbatical, working as a boss at some well-known firms. When I was at eBay and Amazon, I managed teams and I enjoyed it very much. How do you assess yourself as a manager in that realm? I'm blushing, so...

Because you're the best ever? No, but I'm pretty good, so I'm feeling a little uncomfortable. Your positive self-assessment is based on direct feedback or just a general warm glow feeling? At eBay and Amazon, the feedback was actually formal through surveys. Surveys, that is, with questions like, on a scale of one to five, how much do you agree with the following statement? My boss generates a positive attitude in the team.

Or my boss is someone I can trust. Or my boss provides continuous coaching and guidance on how I can improve my performance.

These surveys led Steve Tadellas to ask his own bigger questions about bosses. For instance... Does it really matter? Do these measures of manager skills or characteristics, do they really have any value for the firm? Is there some way in which managers who score higher on these surveys are actually contributing more?

These are eternal questions in the field known as personnel economics. You could ask the same questions about any manager, the head coach of a football team, the chairperson of your homeowner's association, the president of the United States. But as I mentioned earlier, the academic literature on the impact of bosses is not particularly advanced.

You can see why, if you think about it. There are so many variables in the relationship between a boss and their employees that it can be hard to pinpoint the effects of the boss. This is why most research focuses on one single quantifiable metric, productivity. For example, there is a paper by the late, wonderful economist Eddie Lazier, Catherine Shaw, and Chris Stanton,

where they show that there is variation in output of employees based on the managers that are in charge of them. That paper from 2015 analyzed data from a single firm that the researchers were not allowed to identify, but it appears to be something like a call center. The analysis looked at what happened when a worker moved from what the researchers identified as an average boss to a high-quality boss.

Such a move, they found, increased productivity by as much as 50%. So if this were a call center and a given worker handled 100 calls per shift under an average boss, an excellent boss could boost that to 150 calls. So at least in this type of setting, a quote good boss is doing something right. But the data couldn't say what.

Steve Tadellas wanted to learn more, so he teamed up with Mitchell Hoffman, an economist at the University of Toronto's Rotman School of Management, to write a research paper. I had access to interesting data and people in this company that will have to be unnamed because when it comes to personnel data, companies are very hesitant. Tadellas would only say that this firm did high-tech, knowledge-based work.

Maybe, given his history, you might picture a firm like an eBay or an Amazon. In any case, he is looking at a very different type of work than the earlier research with its narrow measure of productivity. What we're doing is opening the hood up a little bit. And what sort of data did they have access to? We have data that allows us to measure the impact of a particular manager skill that we're calling people management skills.

as opposed to just do managers matter. People management skills, meaning the sort of things you find on those employee feedback surveys, how well the manager coaches and communicates, how trustworthy they are.

So that's the boss data. On the employee side, Tadellas and Hoffman had a lot of concrete data, subjective performance scores, as well as how often a given employee was promoted or given a raise, the number of patents they filed, and whether they stayed at the firm or left. In these high-tech, knowledge-based companies, retention is a very, very important focus because...

Getting these high-skilled workers is not easy, and there's a lot of competition. And when you lose an employee, especially an employee that's very valuable, then it could take months to replace them. So Tidelis and Hoffman set about to sort through all this data to look for any causal relationships between the rating of a given manager and the various outcomes of the employees working under them. What'd they find?

For the most part, it was a big bag of nothing. We didn't find that the ratings of the managers seemed to impact the subjective performance of their employees, their income, their promotions, or patent applications in a meaningful way. That's right. On all those employee outcomes, performance, earnings, patents, it just didn't seem to matter whether the manager was highly rated or poorly rated. But...

But there was one other outcome to look at. Employee retention. Bingo. Tadellas and Hoffman looked at employees at this one firm who moved from a manager with a poor rating to one with a high rating. That's associated with an attrition drop of about 60%. That is huge. And within that huge effect was an important nuance. What we see then is

is that managers help retain better employees more than worse employees, which shows that the impact of being a better manager is strongest where it matters the most. So, a good boss seems capable of keeping the best employees happy and presumably productive. Conversely, a bad boss might drive away the best employees.

The Tedellus-Hoffman paper was published in 2021 in the Journal of Political Economy, one of the best econ journals. So, OK, the economics literature on bosses and management just got a little bit deeper. But remember, employee retention was the only outcome where it seemed to matter whether a boss was good or bad.

And if you ask Steve Tadellas a more fundamental question, like what does a good boss actually do to instill this loyalty? This is where I have to take a step back and say that there are certain things that may be outside the scope of what economists should be dealing with. If you were to make a list of things that you would like to measure, were it possible, given the data, what would some of those things be? Really good question.

Something that's very hard to measure that I believe is important is compassion. I guess if this is going to be on the radio, I might lose my economist card. Steve Tedellis is not the only economist who's been frustrated by the lack of evidence for what makes a good boss good. Maybe compassion is as important as he suspects, but we just don't have any large-scale empirical evidence yet.

The Stanford economist Nicholas Bloom has been studying leadership and management for years. And yet...

No one could really give us a straight answer on what defined a good or a bad leader. You look at the data and there's 10 different recipes for success. Maybe they each work for a particular case study, but I've still 20 years later struggled to find anything that's the secret recipe beyond saying, sure, there are some people that are better than others, but it's damn hard to tell what it is. This has not stopped leadership gurus from promoting their pet theories.

As Bloom puts it, there is a ton of BS around this from airport bookstore pulp fiction. And here's another reason to question the literature on management and bosses. As we've been hearing, most of the boss data comes from employee surveys. Have you ever taken a survey that rates your manager? If so, were you told it was anonymous? Did you believe it was anonymous?

Were your answers objective? Or did you maybe think, well, my boss thinks I'm good at my job, so I'm going to say they're good at theirs? Or vice versa. I don't think my boss likes me, so I'm sure not going to give them a good rating. As we have said before on this show, survey data can be the lowest form of data. Here again is Steve Tadellas. I'm sure you know that economists are very wary about using surveys.

And economists believe in what we call a revealed preference approach, meaning how you behave is telling me a lot more about you than what you say about yourself. Just how big is the gap between what people say and how they behave? Over the years, I have heard many economists give many examples of this gap. Steve Tadellas' example is my all-time favorite. There is a lot of discussion about privacy and privacy regulation these days.

and you hear a lot of people saying how their privacy is important to them, and then you turn to them and say, "Here's a Snickers bar. Could I have your mother's maiden name?" And they say yes. So it's a little bit confusing when you tell me that you really care about privacy and then you just scroll down on every app you download and click "Yes, yes, yes." That doesn't tell me that you really care about privacy. So the same is true for many other types of behavior.

So let's keep in mind that much of what we have been told in the past about good bosses and bad bosses is not exactly evidence-based. Researchers like Tadellas and Hoffman and Bloom have been chipping away at the black box of boss behavior, but we've got a long way to go. This means we need to keep looking for good data and asking good questions. So coming up after the break, who becomes a boss and why?

If so many people think the boss selection process is stupid, why do firms keep doing it? And whatever happened to Katie Johnson? I get to the end of the day and the last thing I want to do is talk to someone else. I'm Stephen Dubner. This is Freakonomics Radio. And remember, you can get our series, The Secret Life of CEOs, and all our past episodes on any podcast app. We'll be right back.

Freakonomics Radio is sponsored by Range Rover Sport. Range Rover Sport leads by example, combining assertive on-road performance with signature Range Rover refinement and commanding all-terrain capability. The third generation Range Rover Sport is the most desirable, advanced, and dynamically capable yet. Range Rover Sport redefines sporting luxury, an instinctive drive with engaging on-road dynamics and effortless composures.

Combining dynamic sporting personality with the peerless refinement you expect, Range Rover Sport communicates power, performance, and agility.

Advanced cabin technologies such as active noise cancellation and cabin air purification offer new levels of comfort and refinement. The purposeful cockpit-like driving position sets the tone for a focused interior that promotes exhilarating driver engagement. Award-winning PIVI Pro infotainment is at the heart of the experience and provides intuitive control of the vehicle systems. Design your Range Rover Sport at LandRoverUSA.com.

T-Mobile has home internet on America's largest 5G network for 50 bucks per month. It's how I stream the game. Oh, yeah, that one's out there.

It's how I knock out the shopping list. Hey, hon, the delivery's here. Oh, cool. That was easy. It's how I level up. Yes, double points. Get T-Mobile 5G home internet for only 50 bucks per month with auto pay and any voice line. And with price lock guarantee, your last month of service is on us if we ever raise your internet rate. Plus, there are no exploding bills or annual contracts.

T-Mobile, it's how you internet. Check availability today at T-Mobile.com slash home internet. Price lock exclusions like taxes and fees apply. See guaranteed details at T-Mobile.com. Price after $10 monthly bill credit while you maintain a nationally available postpaid voice line. Qualifying credit required. Regulatory fees included for qualified accounts. Plus $5 per month without auto pay. Debit or bank account required.

Freakonomics Radio is sponsored by Lufthansa Allegris. Lufthansa Allegris is the new way of flying with all four classes thoughtfully redesigned.

Lean back without disturbing the passenger behind you with Premium Economy's fixed shell seats. Plus, business class seats include Bluetooth and all aisle access. Starting this summer, Lufthansa Allegris will fly from Chicago and San Francisco. All other Lufthansa gateways will follow. Visit Lufthansa.com and search Allegris to learn more. Lufthansa Allegris. It's your journey. It all starts with a yes.

Have you ever thought about where a boss comes from? What I mean is why a given employee will rise from the ranks to become a manager. Here's someone who's been thinking about that a lot. My name is Kelly Hsu. I'm a professor of finance at the Yale School of Management. Kelly Hsu, along with Alan Benson and Danielle Lee, published a paper in the Quarterly Journal of Economics, another top journal, called Promotions and the Peter Principle.

So The Peter Principle is a very funny and popular management book written by Lawrence J. Peter, and his book offers an explanation for why we might see incompetent bosses everywhere. Incompetent bosses everywhere?

Okay, I'm listening. What is this explanation? Let's go back to Lawrence J. Peter himself. This is from a 1973 documentary. The Peter Principle states very simply that in any hierarchy, an employee tends to rise to his level of incompetence. I'm sorry. As many times as I've heard that phrase, I still laugh at it just because...

It sounds like it's going to be not irreverent, and then it turns immediately irreverent, which makes me chuckle. Oh, exactly. I think it's a funny idea, but it also rings true. And it's funny in a kind of unpleasant way because it reminds people how much they dislike their bosses. Peter was a Canadian education scholar. He used his daily observations to form a theory about job promotions. I saw that very often a competent individual was promoted...

to something he couldn't do. I saw a competent mechanic where he used to take my car. He was terrific. He was very responsible, very precise, knew exactly what he was doing, so they made him foreman. Now he's no longer fixing cars and he's trying to manage other mechanics and he's very incompetent. The more Peter looked around, the more he saw people who were good at their jobs routinely stumbling into bigger jobs they weren't good at. In any organization,

where competence is essentially eligibility for promotion and incompetence is a bar to promotion, people will rise to the level of incompetence and tend to stay there. The book he wrote with Raymond Hull was called The Peter Principle, Why Things Always Go Wrong. It wound up selling millions of copies. The book was meant to satirize corporate strategy,

Nevertheless, a variety of big firms tried to recruit Peter to become their management guru. He declined, saying that he didn't wish to rise to his own level of incompetence. Kelly Hsu again. His idea is that firms and organizations tend to promote people based upon their performance so far. What that means is a worker who is good at her job will be quickly promoted to a new job role, which might require a different set of skills.

If she's good at that new role, she's going to be promoted again until she reaches a position where she's actually a bad match for that new job role. And then she will no longer be promoted. On the one hand, it would seem to make perfect sense that you promote someone who's good at their job. You don't want to promote the bad workers. On the other hand, managing is not the same as doing. There's no reason to believe that a great salesperson who knows how to negotiate deals would be a great manager.

That, again, is the Berkeley economist Steve Tedelis. I look here in my company, Berkeley. Great researchers often make for lousy department chairs. Great engineers often make for lousy engineering managers. But here's the thing about the Peter Principle. Even though the theory had been around for half a century, no one had ever checked with real data from real companies whether Lawrence Peter was right.

A few observations about a car mechanic or an academic researcher turned department chair, those do not constitute empirical proof, especially in the realm of management and all that airport bookstore pulp fiction. This is where Kelly Hsu and her co-authors come in. They wanted to see if the Peter Principle actually exists, and if so, what should be done about it. First step?

get hold of some data. We got our data from a company that offers sales performance management software and services. Shu can't tell us the name of the company, but picture something like Salesforce. A typical client of our data provider is a firm that employs business-to-business sales workers.

And that client firm would input the sales numbers and the whole organizational structure into a software program. And what we're doing is we're studying the data that these client firms uploaded into the software program. How many firms and how many workers?

We see data for about 40,000 business-to-business sales workers at over 130 different U.S.-based firms. And how many of those were in managerial roles? 5,000 managers and about 1,500 promotion events. So in terms of empirical studies in your realm, this is considered a pretty large and robust data set, or would you have liked it to be even bigger than that? I

I would always prefer a bigger data set, but for this type of question, a very large and comprehensive data set. So these are sales workers and sales managers. What makes sales a good business function to study? One is important to study sales workers because almost 10% of the U.S. labor force are somehow involved in the sales function.

The other benefit is that we have a very good measure of their performance. So we can test, are the stronger performers more likely to be promoted? So that makes a lot of sense from your perspective as the scholar. From my perspective as someone who's not in sales, I would think, well, your findings may not translate very well. That in a field like journalism or in health care or in many other fields,

the measurables aren't nearly as measurable as they are in sales. So how generalizable do you think your findings are? I believe it's likely to apply to other settings where the skills required to succeed at one level differ from skills required to succeed in the next level. So some examples are science, manufacturing, academia, entrepreneurship,

Can you think of industries or sectors where this problem wouldn't apply? It's actually hard for me to think of a setting in which this problem wouldn't apply at all. I've also seen it in the context of government structures. A good example is actually the ancient Chinese imperial examination system.

It's famous for being a meritocracy even thousands of years ago. So you would take a test and the top scorers on the test would become administrators within the government bureaucracy. But their problem was they would make the test based upon familiarity with classical poetry. And the people who are best at that test would then become tax collectors, which is a different skill set.

But ancient Chinese poetry was an incredibly rich and diverse body of literature, yes? So I could imagine how a mastery or even a deep appreciation of that could theoretically apply across a number of skills. Theoretically, yes. You sound unconvinced. And to be fair, I do not have the historical data to prove that being...

The best at classical poetry means you're not the best at tax collection. Since you don't have that data, let's look at, say, modern U.S. politics. How would you assess the relationship between a person who's electable and a person who will govern well?

Oh, that is a very good point. So someone who is electable might be very charismatic, very good at public speaking, whereas the actual function once someone has been elected might involve being good at deal-making, back office politics, or understanding the actual details of the policies that they're passing.

Do you know anything about that question empirically? I'm drawing a blank, but you really did raise a very good research idea. Maybe I will look into this. We've been thinking about settings where this type of problem might apply for a long time, but somehow I never thought about the government or elected official example you just raised. But it seems like spot on for having potential as a problem.

OK, before I hijack this conversation with Kelly Hsu to talk about politics and ancient Chinese poetry, we were talking about her research paper that tried to identify the Peter Principle in the wild. As Hsu told us, she had performance data on roughly 40,000 sales workers and around 130 companies.

The next step was to confirm that companies indeed use an employee's job performance as a trigger for promotion. The answer? Yes. We find that doubling in worker sales corresponds to a 30% increase in their probability of being promoted. Another way to look at it is if someone is the top sales worker within their team of five or six people,

then that top sales worker has about triple the probability of being promoted relative to the average sales worker. Now, is that alone evidence of the Peter Principle?

No, just to promote based upon past performance isn't necessarily a Peter principle problem, because it could be that the best salespeople really are the best managers of salespeople. In that case, you want to promote the best salespeople. Okay, so the next step, I guess, is seeing whether the best salespeople indeed do become the best managers. How do you do that? So first, we're going to measure the quality of each manager.

Managers in our data are no longer directly involved in sales. Their job as a manager is to coordinate and facilitate the sales of their subordinates. And presumably those subordinates are people they worked with side by side and maybe competed against just the week before they were promoted. Is that the case often? We actually see for the most part people when they're promoted, they're rotated to a different team, possibly because the

the firm overall is exactly afraid of those internal team dynamics that you've just described. So we don't want to call someone a good manager just because her team sells a lot, because we're worried that maybe she was lucky and she was assigned to great sales workers, and those sales workers could have been great regardless of her managerial input.

To get around that problem, we're going to measure manager quality as the manager's value added to her subordinate sales. If my subordinates sell more when they work under me than when they worked under other managers, then I would be considered a high quality manager. So here's the key question Kelly Hsu is asking. Does being a good salesperson make you a good manager of other salespeople?

Here's what she found. The manager with double the pre-promotion sales as another manager leads to about a 6% decline in subordinate sales. Oh my goodness. Yes. What we find is that among promoted managers, those with low sales prior to their promotion, they are actually better at managing their subordinates. Let me say that again. Oh my goodness.

When these firms select people to be managers based on their current job performance, they are actively making themselves worse off. In other words, the Peter principle is as real as Lawrence Peter said it was. And, I'm editorializing here, it would also seem to be incredibly stupid. If the firm's only goal were to have the best possible managers,

then the firm could, by putting more weight on collaboration experience and less weight on sales numbers, the firm could promote better managers and raise overall firm sales numbers by about 30%. That's assuming that collaboration experience is in fact more important for a manager than just high sales numbers. Still, a 30% increase in revenue simply by killing off the Peter Principle? That would seem to be a no-brainer.

So does this mean that modern firms simply aren't aware of the age-old Peter Principle? Most firms are aware of the Peter Principle problem, and it's a problem that they purposely choose to live with. Some evidence we have indicating that in situations when the firm is trying to select a new manager who is going to be in charge of a very large team. So that's a situation in which manager quality matters a lot.

In those situations, firms put less weight on a worker's sales numbers, probably because they know you're going to end up with a bad manager. So Hsu is arguing that firms know they will get worse managers by simply promoting people who've been good at their previous jobs rather than people who might actually be good managers. And yet, for the most part, they continue to do it, even though it hurts their profits. Why would they do that?

Economists are always telling us that companies are, by definition, profit-maximizing machines. Knowingly promoting a bad manager does not sound very profit-maximizing. So are companies just making a mistake? A firm having a Peter Principle problem doesn't necessarily mean that the firm doesn't understand what it's doing or it's making a mistake. So what is going on?

After the break, Kelly Hsu gives us some answers. You don't want to brag about your pay on your resume. I'm Stephen Dubner. This is Freakonomics Radio. We'll be right back. T-Mobile has home internet on America's largest 5G network for 50 bucks per month. It's how I stream the game. Oh, yeah, that one's out there.

Freeconomics Radio is sponsored by Jif. The peanut butter group and Chocolaty Corp have merged to create PBC Inc. And the byproduct of the merger is the new delicious Jif peanut butter and chocolate flavored spread. Critics tried to say it creates a monopoly on craveability, but obviously it's not illegal to be irresistible. This is going to revolutionize the snack industry and the contents of pantries across America. Visit PBCincorp.com.

PBC Incorporated to try the flavor merger of the century, GIF, PB, and C. Take your business further with the smart and flexible American Express Business Gold Card. It offers flexible spending capacity that adapts to your business. You can also earn up to $395 in annual statement credits on eligible purchases at select business merchants. That's the powerful backing of American Express.

Terms apply. Learn more at AmericanExpress.com slash business gold card. Before the break, the Yale finance professor Kelly Hsu was telling us about a study she and her colleagues published about the Peter Principle. That's the idea that a good employee will be promoted to bigger and bigger jobs until they get to a job they're not good at. And then they tend to stay there. But for years, the Peter Principle was just a theory. Kelly Hsu wanted to see if it's real.

Using data on thousands of promotions, she did find that when top performing salespeople were promoted into management, the sales performance on the teams they manage declined. In other words, just because somebody is good at their job doesn't mean they'll be good at managing people doing that same job.

Hsu also found evidence that firms know that the best salespeople make bad managers and they choose to promote them anyway. So what is happening? What we believe is happening is the firm is doing its best to motivate workers and they face a tradeoff. OK, this is where it gets really interesting.

Promoting based upon past performance is very motivating to workers. So it's a very strong incentive system. We can also work out that it's in some ways cheaper than offering really strong pay for performance. So there are two ways to motivate people. We can pay them a whole lot more, or we can give them an opportunity for promotion, which they might value a whole lot because that's something that they can put on their resume and it increases their status in society.

You don't want to brag about your pay on your resume. I mean, the minute you say that, it makes me think, wait, maybe we should make it more acceptable for people to brag about their pay, because wouldn't that be more efficient in the end and encourage less promotion of people who are going to be bad managers?

That's a fantastic idea. I don't know of research testing that directly, but I do know in other cultures, there's differences in it being more socially acceptable to talk about your compensation. I mean, I was kind of half joking, but...

It would be interesting if there was some metric or badge you get saying, I'm really good at what I do, and I'm so good that I've been rewarded a lot of raises. And plainly, I'm very valuable to the firm, and I could be a manager if I wanted, but I'm better than that. That's an incredibly ham-handed, naive way of putting it. But is there any mechanism in managerial science for that kind of reward?

delineation between success on a financial level and success on a managerial level? There have been some interesting attempts in that direction. So I've heard of many technology-focused firms, especially those in Silicon Valley. They face this problem that they have a pool of very talented and skilled engineers, and those engineers may not be the best managers of engineers. Many of those firms offer something called a dual career track,

where someone can rise in the ranks of being an engineer, basically having a higher and higher title. So you can start as engineer, then distinguished engineer, then lifetime distinguished engineer. And that's a way for the firm to recognize someone's contributions in a public way without moving them over to management.

The Berkeley economist Steve Tadellas has also noticed this movement. In companies like eBay, Google, Amazon, Facebook, there's the term of IC, or independent contributor. And you will have people who are at the level of VP not managing a single person because they are just gods in their realm of engineering or coding or architecture and so on.

By distinguishing between ICs and the so-called management talent, the firm is saying, look, we are going to promote people in ways that reward them for what they're great at. You're not a great manager. You're not going to get incentivized by becoming a manager. Has that model trickled out at all of that high-tech realm? One area where I have seen it

The fact that Kelly Hsu and Steve Tedellis can identify a handful of cases where career success is not tied to a promotion into management is a very important factor.

Well, those are exceptions that prove the rule. As Xu found in her research, the Peter Principle is alive and well, as absurd as that may seem.

It is yet another confirmation that management science, as lovely a phrase as that may seem, is not yet very scientific. Most firms stick with what they've always done. When an employee is good at what they do, you turn them into a manager to oversee other people who do what they used to do, even if they are not cut out to be a manager.

Like our friend Katie Johnson, the English data scientist we met earlier. I didn't see that there was another path whereby I could be director level but not have direct reports. I just didn't ever see that. Looking back, there were some clues that Johnson wasn't quite manager material.

You remember during management training, she took that personality test and she told us the areas where she got high scores. Critical thinking, attention to detail, courage, all these kind of internal thinky type characteristics. Well, those were not the only results of this test.

Things that I can do but I struggle with was compassion, empathy, relationship building. I saw this output and I was like, why didn't anyone do this to me before I got this job? Because this just screams great data scientist, not so great manager. But it was too late.

She'd already been made a manager. And as you'll recall, it was not going well. I would finish my day and my study, walk into the living room, put a blanket over my head and cry. So let's say we're talking a scale of zero to 10. Where would you put your median satisfaction when you were an IC or a maker? When I was a maker, I'd put myself as an eight and a half.

I actually loved what I did. I absolutely loved it. The only reason I would even deduct 1.5 points is because there were some frustrations, as I mentioned, about not being heard and not being autonomous. And then where would you put it, 0 to 10, when you'd become a full-on manager? I would say I'd put myself more at like a 4 or a 5. A 6 would be a great day.

Okay, that's your personal satisfaction. I do see, however, on LinkedIn, a review from your manager

He writes, Katie is a rounded and passionate data leader with all the qualities required to inspire, manage, and lead a team. Plus, she has got brilliant IC skills to boot. And he notes that you are a real unicorn in the data analytics field. So that sounds like you were the best manager ever. Yeah. Yeah.

It's really nice, isn't it? It's really nice. Did he write that before or after you decided to quit? He wrote that after. You heard that right. Katie Johnson quit that management job. She quit being a boss entirely.

She went back to working as a data scientist at a different firm. I don't know if you can ever be successful at something you don't like. I want to do something that I love and I'm really passionate about because that's the only way. Maybe other people are different, but I have to love it. I have to be like on a Sunday night, I can't wait to start my work tomorrow and get back to what I was doing. And I was never, ever, ever going to have that in my management job. So before you ever became a manager, as a maker, you said you're

average satisfaction or happiness was around eight and a half. When you became a manager, it dropped to let's call it five, six on a great day.

What is it now? I'd say it's a nine and a half now. I'm super happy. Are you getting paid less now as a data scientist than you were as a manager? I'm getting paid more. How did that happen? I think there are more individual contributor roles now that pay good money. I think that this technical specialist route is becoming more prominent and more rewarded. And people do realize that there are going to be a lot of people who don't want to become the manager. And how do you motivate them?

I believe you looked at the Peter Principle paper. Is that right? Yeah, I did. The way the Peter Principle is usually described is to me almost comical. It's that people rise to the level of their incompetence, which I find is a bit cruel sounding because one could also say that people rise to their ceiling of competence. Right. And then maybe they're not as good at that. It's not like they suddenly turn into idiots.

But I am curious, just your thoughts on the notion of promotion into management as a reward for being good at what you've been doing all along. For me, this is where the idea of splitting out those levels of seniority. So maybe you don't become the manager, but you can become a technical expert and you are paid and rewarded for that is something that helps with the incentives. What I would say on that, though, is often people,

We have this dual career tract of, OK, you can be a manager or you can be a technical specialist. But even though you might get a quote unquote promotion and be paid more, the technical specialist still might be excluded from high level conversations. So being a manager just has this connotation of seniority that a technical specialist doesn't necessarily and you still might be overlooked in terms of just seniority.

the respect. And I think that is motivating more than just, hey, here's a promotion, here's a new job title. I think people want that autonomy and that having a seat at the table, people caring what you think, it has to come with that.

I would think that many people who are promoted from some sort of maker to some sort of manager, that it would be hard to step back if for no other reason than it seems like a loss of status. Yes, it definitely feels like a loss of status. I guess for me, I'm lucky that I don't care what people think as much as other people or at all. I'm sure that was identified in your personality test as well. Yeah, complete rogue doesn't care what others think.

People judge you, which I find interesting because I don't know anyone who likes their job as much as I do. So for people to look upon me and feel sorry for me in a sense that I have chosen to go backwards in terms of career hierarchy, it's kind of telling in terms of what we value out of a career.

And you can tell them that if you hadn't done this, you wouldn't be on Freakonomics Radio. Well, exactly. I got what I wanted. Was this the plan all along? Yeah, this is a big long game.

Thanks to Katie Johnson for sharing her boss and back story. Recently, she became her own boss, working as a freelance data coach. She wrote to us, I am optimistic that my new venture will allow me to grow as a data professional, focusing on the elements of leadership I value while minimizing my exposure to the parts of leadership that I did not enjoy.

Thanks also to Kelly Hsu, Steve Tedelis, Nick Bloom and all their collaborators for trying to make this thing we call management science a bit more scientific. Coming up next time on the show, it's time to take a look at one of our favorite laws, the law of unintended consequences. In this case, applied to the modern workplace.

We will hear how laws and rules that are meant to protect certain workers don't. That's next time on the show. Until then, take care of yourself. And if you can, someone else too.

Freakonomics Radio is produced by Stitcher and Renbud Radio. You can find our entire archive on any podcast app, also at Freakonomics.com, where we publish transcripts and show notes. This episode was produced by Ryan Kelly. We had help from Jared Holt. Our staff also includes Alina Kullman, Augusta Chapman, Eleanor Osborne, Elsa Hernandez, Gabriel Roth, Greg Rippin, Jasmine Klinger, Jeremy Johnston, Julie Canfor, Lyric Bowditch, Morgan Levy, Neil Carruth, Rebecca Lee Douglas, Sarah Lilly, and Zach Lipinski.

Our theme song is Mr. Fortune by the Hitchhikers. The rest of our music is composed by Luis Guerra. As always, thank you for listening. Do you ever want to tell your dean, thanks so much for giving me all this managerial responsibility, but I don't want it. I don't want my reward for being a good scholar to be that I have to do a bunch of management. I haven't thought about that.

The Freakonomics Radio Network. The hidden side of everything. Stitcher.

Freakonomics Radio is sponsored by Amica Insurance. Amica knows how important it is to protect your biggest assets, whether it's auto, home, or life insurance. Amica has policies to fit your specific needs, and their friendly and knowledgeable representatives will work with you to make sure you have the right amount of coverage in place. As they say at Amica, empathy is our best policy. Go to amica.com and get a quote today.

Hey there, Stephen Dubner from Freakonomics Radio here to tell you the national sales event is on at your Toyota dealer. Now is the perfect time to get a great deal on a dependable new SUV like an Adventure Ready RAV4.

Available with all-wheel drive, your new RAV4 is built for performance on any terrain. Or check out a stylish and comfortable Highlander with seating for up to eight passengers. Available with a panoramic moonroof, you can sit back and enjoy the wide-open views with the whole family. Check out more national sales event deals when you visit buyatoyota.com. Toyota, let's go places.

Hear that? That's what cooked when you order juicy beef sounds like. The steaming hug of two slices of melted cheese, the crunch of tangy pickles and sliced onions, all topped with a toasted sesame seed bun. That's the sound of a quarter pounder with cheese. First Beef at participating U.S. McDonald's. Excludes Alaska, Hawaii, and U.S. territories.

Why Are There So Many Bad Bosses? (Update)

Freakonomics Radio

Chapters