tools for truth finding

— H. L. Mencken, found on HN

The basic principle is easy to grok: once you’ve read enough books about a single topic, it becomes trivially easy to read a new book on that topic. This experience should be familiar to computer programmers: for every n programming language you know, the n+1 programming language you adopt becomes easier to learn

— Reading Quickly is Reading a Lot

degree to which test scores are affected by processes that are extraneous to the test’s intended purpose

— 📝Evaluating the Unintended Consequences of Assessment Practices﹕ Construct Irrelevance and Construct Underrepresentation

• attributed to Feynman

• extent to which a test measures the concept or construct it claims to measure

~ main threats to construct validity are construct underrepresentation and construct-irrelevant variance

— 📝 The interplay of evidence and consequences in the validation of performance assessments

a situation in which the essential aspects of a given construct have not been captured

— 📝Evaluating the Unintended Consequences of Assessment Practices﹕ Construct Irrelevance and Construct Underrepresentation

test failing to fully capture breadth and depth of construct*

Test for Fixation The strategy here is to challenge yourself. You can ask: “What evidence would it take to convince myself that my interpretation is wrong?

— The Power of Intuition

• keywords:
  • controversy
  • "no effect"
  • criticism, critique, critical
  • opposing

One way to recognize how much effort and map-bending it’s taking you to hold on to your fixation is to establish tripwires—events that should not be happening or levels that are not supposed to be exceeded—that would indicate that your interpretation of the situation may be inaccurate. For example, one physician described to us how he performs a risky type of surgery. He estimates how long the procedure is supposed to take and if the operation exceeds this time he takes that as an indicator to reexamine whether to proceed or to convert to a more traditional technique. The tripwire is the fact that he has exceeded the typical amount of time for the procedure.

— Power of Intuition

Many important problems are poorly defined, and will never become clearly defined purely by thinking hard about the issues

—The Power of Intuition

— 📖 Designing Games