The Observer Effect: An Abstraction (Part 2 of 6)
Bach – Ricercar A 6
Audio clip: Adobe Flash Player (version 9 or above) is required to play this audio clip. Download the latest version here. You also need to have JavaScript enabled in your browser.
On Friday, I begin this series1 by introducing a phenomenon known as the Observer Effect.
To recap, the Observer Effect describes the fact that the mere act of observing or measuring something actually affects what we are observing. We also saw that the Observer Effect is not inherently a bad thing, especially when we desire a certain outcome to be measured, and the act of measuring it actually helps achieve the measurement we want. The classic example of this in the classroom setting was announcing an upcoming test, in the hopes that the test will not only measure student achievement, but that by merely announcing it, student achievement will be improved because many students will then study.
Today, we’ll take a step back and look at the general form of the Observer Effect, including the mechanisms by which it occurs. [Disclaimer: This post, as the title suggests, is fairly abstract, though not at all difficult to understand (i.e. it may satisfy your inner geek). If you are denying your don’t have an “inner geek”, then I strongly suggest skipping this post, and re-joining in with Part 3.]
To restate the Observer Effect in a different way, it makes sense to begin with the classic question “If a tree falls in the forest, and there is no one there to hear it, does it make a sound?” The answer is, of course, “yes”, however, the sound that an observer hears it make is different than the sound it makes when no observer is present2.
So our question for today is, what is the general form of the Observer Effect and how does it change that which is observed, whether physical changes (like the tree in the forest), or behavioral changes (in a classroom setting)?
To ease this meta-view, lets first look at the specific, then generalize. The following chart explains (using the “giving a test” example) how the observer effect actually works.
|
Not Observing |
Observing |
|
|
|
Notes: The major issue with this is that no one knows to what extent Johnnie has mastered this material. His teacher doesn’t know, his parents don’t know, prospective colleges don’t know, and to a certain extent, he himself doesn’t know. This untenable situation is one of the reasons we have assessments in the first place. |
Notes: The primary takeaway here is that (a) Johnnie’s demonstrated level of mastery is a function of the option he takes, and (b) the options he considers are a function of the teacher’s method of observation. A further (and perhaps more interesting) corollary is that the specific option Johnnie takes is a function of both the observation itself and its process. Namely, the way Johnnie prepares for the test is a function of its content (how difficult he thinks it will be) and its form (computer? pen and paper? multiple choice? essay? will it be proctored? How will it affect the overall grade?) |
|
Let’s set up some variables and functions:
Having defined our variables, it turns out that they are functionally related in the following ways.
In other words: The desired student achievement affects the way the teacher designs the observation which affects how the student perceives his options for studying which affects which options he takes which affects his actual demonstrated achievement.
The absolutely fascinating part of this is when we pause to consider the undefined functions in the equations above, specifically f, g, and h. It turns out that f is pretty boring, as it simply refers to how a teacher designs an assessment based on what he wants his students to demonstrate mastery of. The function g is more interesting in that it refers to how the test itself influences Johnnie to consider his options. Also fascinating is the function h, by which Johnnie chooses one particular option from those he considers. Simply put, the variable t actually influences these outcomes, which is why test design and observation/ assessment/ measurement in general must be taken up with such great care.
|
-
If we care about the way that Johnnie considers his options upon knowing that he will be observed, we MUST, we MUST, we MUST, take great care in designing HOW observation occurs, as its effects trickle down.
2. Sound is literally air molecules vibrating in patterns that strike our ear nerves and transmit sounds to our brain. Physically standing next to the falling tree changes the path that these air molecules vibrate in towards the ear, thus changing the sound, even if unnoticeably slightly. Being in a forest to hear a tree fall is similar to seeing how waves in a lake hit the short differently depending on whether or not they are traveling around a moored boat.
Willie Nelson – The Scientist
A shout out to my friend and colleague, Tyler, whose alma mater,
John & Yoko – Happy X-mas (War is Over)
The Who – Christmas
Aimee Mann – Calling on Mary
Smashing Pumpkins – Christmastime
The Beach Boys – I’ll Be Home For Christmas
Sufjan Stevens – Christmas In the Room