← Back to overview

tools for truth finding

~ find articles directly hating on things you love

~ important problems are often impossible to define clearly by thinking

Many important problems are poorly defined, and will never become clearly defined purely by thinking hard about the issues

—The Power of Intuition

~ ask﹕ what evidence would I need to change my interpretation﹖

Test for Fixation The strategy here is to challenge yourself. You can ask: “What evidence would it take to convince myself that my interpretation is wrong?

— The Power of Intuition

> For every complex problem, there is an answer that is clear, simple, and wrong

— H. L. Mencken, found on HN

finding opposing papers

  • keywords:
    • controversy
    • "no effect"
    • criticism, critique, critical
    • opposing

construct-irrelevant variance

degree to which test scores are affected by processes that are extraneous to the test’s intended purpose

— 📝Evaluating the Unintended Consequences of Assessment Practices﹕ Construct Irrelevance and Construct Underrepresentation

"I don't actually believe this but here is an alternative explanation"

construct validity

  • extent to which a test measures the concept or construct it claims to measure

~ main threats to construct validity are construct underrepresentation and construct-irrelevant variance

— 📝 The interplay of evidence and consequences in the validation of performance assessments

ask: What's the real question﹖

  • attributed to Feynman

construct underrepresentation

a situation in which the essential aspects of a given construct have not been captured

— 📝Evaluating the Unintended Consequences of Assessment Practices﹕ Construct Irrelevance and Construct Underrepresentation

test failing to fully capture breadth and depth of construct*

~ questioning assumptions is really hard

— 📖 Designing Games

~ read quickly by reading a lot on one topic

The basic principle is easy to grok: once you’ve read enough books about a single topic, it becomes trivially easy to read a new book on that topic. This experience should be familiar to computer programmers: for every n programming language you know, the n+1 programming language you adopt becomes easier to learn

Reading Quickly is Reading a Lot

~ set tripwires

One way to recognize how much effort and map-bending it’s taking you to hold on to your fixation is to establish tripwires—events that should not be happening or levels that are not supposed to be exceeded—that would indicate that your interpretation of the situation may be inaccurate. For example, one physician described to us how he performs a risky type of surgery. He estimates how long the procedure is supposed to take and if the operation exceeds this time he takes that as an indicator to reexamine whether to proceed or to convert to a more traditional technique. The tripwire is the fact that he has exceeded the typical amount of time for the procedure.

— Power of Intuition