Inflating the tires, not reinventing the wheel ®

 

  • Home

  • Focused Instruction

  • Services

  • Resources

  • About Us

  • Blog

  • Contact us

  • More

    TESS

    Total Education Systems Support

    Focused Instruction
    Materials and Resources

    "Who says? Compared to what?"

    February 1, 2017

    |

    Gene Tavernetti, Ed.D.

    Imagine trying to make a decision about what make of car to purchase. You see an advertisement for a particular make of car that claims, “Eighty-eight percent of those surveyed selected this particular make over a Mercedes Benz in a head to head selection.”

    That sort of claim gets your attention. Pretty convincing, right?  How could you not take a very close look at the make of car that was nearly unanimously selected over the car considered to be the apex of quality?

     

    You take a closer look at the car advertised to be more desired than a Benz.  It isn’t comfortable, gas mileage is subpar, and maintenance is expensive. How could this line of cars outperform Mercedes in a head to head competition?

     

    When you look closer into how the actual survey was conducted you find that  the survey was designed and conducted by the car maker that was not Mercedes Benz.  You also discover participants in the survey were asked to choose between  a 25 year old Mercedes and brand new model from the other car maker.  In addition to that, you discover that the 88% number was inflated by providing additional information to survey participants who initially selected the 25 year old vehicle.  Now what do you think?  

     

     

    By now you are probably thinking how outrageous the above example is.  Nothing like that ever happens in the real world.  

     

    You are right it is outrageous.

     

     Your are wrong in that it never happens (in the real world).

     

    What was described above happens ALL the time in world of education.  How can that be?  A company promoting a program claims to be superior to something else that is being used.  The claims have to be true because the claims are supported by research. But, just like above, what do you find when actually scrutinize the research that supposedly supports those claims?

     

    More often than not you find that the person or persons conducting the research was associated with the company selling the product.  Are you surprised that the results of the research find the product being sold find it to be superior?

     

    In research conducted comparing one product to another it is not unusual to compare the product being sold to some vaguely described alternative.  A frequent comparison is made between students, “. . .being taught using a ‘traditional method,’’ or, “ . . .to students being taught using a ‘lecture method.’”  

     

    What is a traditional method?  What is a lecture method?  Were the teachers who were using these methods (whatever it is they mean) judged to be effective and above average teachers? Or were the comparison group teachers simply ineffective?  Most research does not provide descriptions.

     

    When I read “research” that does not specifically describe the comparison group, it is impossible for me to know what the authors of these studies mean. But I, get a funny feeling their brother-in-law owns a car dealership that sells inexpensive cars that are overwhelming preferred over a Mercedes Benz.

     

    In the field of education we are constantly being sold something new - or at least new again.  If on first examination, based on your classroom experience, it simply does not make sense you need to take a closer look at the research that supports the claims.

     

    Please do NOT take on faith any publisher's claim of, “This program is researched based.”  Look at the research yourself. As you read ask yourself, “Who says?” and “Compared to what?”

    Tags:

    educational research

    who says?

    evaluate the research

    Please reload

    RSS Feed
    Join Our Newsletter
    Subscribe to Our Newsletter
    Featured Posts

    "But, where should we start?"

    December 6, 2016

    Multiple Initiatives, Multiple Rabbits Leave You Disappointed

    September 2, 2015

    "Who says? Compared to what?"

    February 1, 2017

    1/10
    Please reload

    Recent Posts

    Simple rules save lives and student motivation

    February 24, 2017

    "Who says? Compared to what?"

    February 1, 2017

    A simple idea, elegant execution

    January 17, 2017

    Why Students Achievement is Not Soaring: A Shocking Secret

    January 11, 2017

    "But, where should we start?"

    December 6, 2016

    Sorry, Not Sorry

    November 29, 2016

    Who said this was a good idea?

    October 25, 2016

    The order makes a difference, for words and for school improvement

    September 9, 2016

    Students avoiding the task? The solution might be smaller chunks

    August 17, 2016

    This too shall pass, be it muscle soreness or stress

    August 1, 2016

    Please reload

    Archive

    February 2017 (2)

    January 2017 (2)

    December 2016 (1)

    November 2016 (1)

    October 2016 (1)

    September 2016 (1)

    August 2016 (2)

    July 2016 (1)

    June 2016 (3)

    May 2016 (4)

    April 2016 (2)

    March 2016 (4)

    February 2016 (2)

    January 2016 (1)

    December 2015 (2)

    October 2015 (3)

    September 2015 (2)

    August 2015 (2)

    June 2015 (1)

    May 2015 (4)

    April 2015 (4)

    March 2015 (1)

    February 2015 (3)

    January 2015 (2)

    November 2014 (2)

    October 2014 (2)

    September 2014 (3)

    August 2014 (2)

    Please reload

    Search By Tags

    10000 hour rule

    15%

    21st century

    BOB time

    CCSS proficiencies

    Celebrate

    Choice Theory

    Dr. William Glasser

    Grit

    January to January

    Morale

    OWL time

    Professional Development

    Reflection

    SDC

    Symptoms

    TOTS

    Teacher Support

    Trainer of Trainers

    accountability

    accountability data

    analysis

    application

    art of teaching

    balanced approach

    be a student

    bike whisperer

    boss of the book

    buzz

    buzz words

    check for understanding

    chunking

    clarity

    classroom hacks

    close reading

    cognitive load

    collaboration

    collaborative learning

    common core

    complex tasks

    concept development

    concept maps

    critical thinking

    curriculum

    data and research

    dialog

    differentiation

    direct instruction

    discipline

    educational research

    educationese

    effective instruction

    enjoy the ride

    evaluate the research

    expensive purchase

    expert

    expert tip

    feedback

    first grade

    first instruction

    focus

    focused application

    focused instruction

    growth mindset

    homework

    humility

    implementation fatigue

    improving

    independent practice

    inflating the tires

    initiatives

    inspiration

    instruction

    instructional framework

    instructional leadership

    key ideas

    kwl

    language frame

    leadership

    leading with vision

    learning

    less is more

    lesson plan

    lesson steps

    lesson videos

    manageable chunks

    manipulatives

    meta-cognition

    modeling

    neomania

    new assessment

    new curriculum

    new name

    notes from the field

    parents

    planning

    planning tools

    prescription for success

    problem solving