AI Search Summary
This follow-up video reviews viewer attempts to define Goodhart’s Law and distinguishes Goodhart’s Law from perverse incentives and the Cobra Effect. The strongest definitions emphasize that when a metric becomes the goal, people optimize for the metric and corrupt or degrade the underlying system it was supposed to measure.
- Main question: What is Goodhart’s Law and how does it manifest in real-world examples?
- Short answer / core takeaway: Goodhart’s Law is about measurement corruption: a useful indicator loses informational value when it becomes a target people optimize around.
- Evidence type: Social-science concept clarification using viewer examples and definitions.
- Search topics: Goodhart’s Law examples, metric becomes target, perverse incentives, Cobra Effect, measurement corruption, proxy metric, incentive design, social systems.
Common Search Questions
How is Goodhart’s Law different from a perverse incentive?
The caption says perverse incentive is the broader category: any incentive that produces the opposite of the intended outcome. Goodhart’s Law specifically involves a metric becoming a target and losing its value as a measure.
What is the Cobra Effect?
The caption describes the Cobra Effect as a type of perverse incentive where the incentive directly increases the problem it was supposed to solve.
What was the best viewer definition?
The video highlights definitions such as: when measures of success become goals in themselves, they corrupt the systems being measured; and when people optimize a simple metric for a complex system, results get worse.
Key Takeaways
- The video responds to viewer definitions from Instagram and TikTok.
- The creator values succinctness, accuracy, and capturing the gap between the metric and the true objective.
- Strong definitions mention that optimizing a metric can create an illusion of progress while the system degrades.
- Goodhart’s Law does not always require a formal incentive; close attention to a metric can be enough to distort behavior.
- Perverse incentive is a broader umbrella concept.
- The Cobra Effect is a narrower form of perverse incentive.
- The caption notes a platform-label mix-up: every time the creator said TikTok, they meant Instagram, and vice versa.
Transcript
Reviewing viewer definitions
I asked you guys to figure out Goodhart’s Law from three examples.
You had to be accurate and succinct.
There were a lot of good responses and way too many cheaters who obviously either knew it or looked it up, based on the specifics of the language that they used.
But here are the top three examples from Instagram and TikTok.
Definition examples: third place
Number three, from Instagram: when a metric chosen as a proxy becomes the desired outcome.
Cleanly, succinctly stated. But it doesn’t quite encapsulate how this can create a functional gap between the new desired outcome and the original.
Number three from TikTok: attaching scores or ratings to a particular part rather than a whole system causes the part that is being treated to be prioritized, leading to the illusion of progress or growth while the system as a whole degrades or declines.
It’s wordy, but I actually really like how it captures a key part, which is the illusion of progress.
Thoughtful.
Definition examples: second place
Number two from Instagram: from Chris Hope, what you measure becomes the goal, regardless of alignment to the true objective.
Nice, but still doesn’t talk about the true objective being detracted from.
And number two from TikTok, Benedict Duda: if you incentivize a certain behavior and reward the fulfillment, you create a system that is based around fulfillment rather than the original intended behavior.
Solid deduction. Encapsulates the gap. A little bit wordy.
Definition examples: first place
And number one from Instagram, Union Thug: when measures of success become goals in and of themselves, corrupting the systems that were being measured.
Well put, succinctly covering both parts.
And number one from TikTok, check-ch-rum: when you reward a simple metric for a complex system, people optimize for the metric and you get worse results.
Honorable mentions and close
Honorable mentions: this is well-reasoned and clearly not cheating, but a little bit verbose.
This is succinct, but a little bit extreme and might be a cheater.
And this nails it, but also enough to be a bit suspect. But well done if not cheating.
Good job, everyone.
Additional Notes
The caption says these were the top responses available when the creator started making the video, though more good responses came later.
The creator also says they mixed up platform labels while posting: every time they said TikTok, they should have said Instagram, and vice versa.
Caption definition notes:
- Perverse incentive is the broad umbrella: any incentive structure that produces an outcome opposite to what was intended.
- The Cobra Effect is a specific type of perverse incentive where the incentive directly increases the problem it was designed to solve.
- Goodhart’s Law is about measurement corruption: a metric starts as a useful indicator, becomes a target, and then people optimize for the metric rather than the underlying thing it was supposed to represent.
Hashtags: #Thinking #science #economics #tiktoklearningcampaign
References
- Goodhart’s Law, perverse incentives, and the Cobra Effect discussed in caption/transcript; source links not listed in workbook.