Chariot Learning
  • About
    • FAQ
    • Our Curriculum
    • Areas Chariot Learning Serves
  • Services
    • SAT & ACT Prep
    • SAT/ACT TestFlip
    • Academic Coaching
    • Subject Tutoring
    • Strategic Reading Club
    • Proctored Practice Tests
    • GRE Prep
    • College Essay Coaching
    • Roots2Words
  • Calendar
  • Testimonials
  • Blog
  • Resources
  • Contact
April 30, 2021 by Mike Bergin

Depth of Knowledge and Test Prep

Assessment-oriented instruction, as I like to call test prep when I’m feeling particularly bombastic, usually follows utilitarian principles. Basically, if something works, keep doing it. Thanks to rich quantitative feedback loops, we can track in real time what allows either an individual student or an entire cohort to more quickly and accurately solve different types of problems.

Couple the emphatic pragmatism of test prep with the fact that many practitioners have backgrounds in fields far outside of education and it’s no wonder that theoretical frameworks are rarely primary considerations in tutoring sessions. Nonetheless, educational professionals can learn a lot from educational theory and models, which is why I recently asked expert Erik Francis of Maverik Education to teach a group of test prep teachers about Depth of Knowledge levels. 

As far as theoretical educational frameworks go, Depth of Knowledge certainly sounds rigorous. Cooked up by Dr. Norman Webb in 1997 to facilitate the alignment of standards to assessments, the DOK model categorizes activities according to the level of complexity in thinking. Depth of knowledge is not a proxy for difficulty. Instead, a DOK level describes the kind of thinking required by a task separate from perceived difficulty.

DOK 1 – RECALL
DOK level 1 items require either basic recall or a rote operation. Look for requirements to restate or reproduce.

DOK 2 – SKILLS AND CONCEPTS
DOK level 2 items require the use of concepts, skills, and basic reasoning, often involving two or more steps.

DOK 3 – STRATEGIC THINKING
DOK level 3 items require complex reasoning supported by evidence, often allowing more than one answer. Expect to have to develop a plan or follow a sequence of steps.

DOK 4 – EXTENDED THINKING
DOK level 4 items require investigation, comparison, and synthesis taking more than ten minutes. 

Assigning an accurate DOK level to a task or test item is more of an art than a science, especially because different activities can be structured to address a range of levels. However, savvy educators can find value in understanding how students deal with increasing levels of cognitive demand. 

Exams like the SAT and ACT do not include DOK levels in score reports, but review of the different question types on each section reveals some persistent trends. Most items are either DOK level 2 or 3 with a smattering of DOK 1 items throughout. DOK 4 cannot really be assessed through the kind of multiple-choice questions favored by most admissions tests. Also, now that the SAT and ACT are used as state assessments across the US, the test design teams absolutely incorporate DOK allocations in their internal blueprints to meet varying state standards. This probably explains why the latest revision of the SAT included new question types like Linked Evidence questions on the Reading section: these items are almost certainly DOK 3. Furthermore, math word problems are, just by nature of the requirement to translate English to math, usually at least DOK 2.

If Depth of Knowledge identifies the context and cognitive requirements of a task, effective test prep can be seen as a mechanism that helps lower levels of cognitive demand on high stakes exams by tackling certain challenges in advance. Real preparation is all about providing students rich opportunities to, for example, build deep conceptual understanding and master heuristics or strategic sequences to predictable problems ahead of time. Even better, once these students encounter reviewed problems in a test setting, they can lean on lower level DOK requirements of recall and application rather than having to derive novel solutions to unoriginal problems.

Clearly, insight into the concept of Depth of Knowledge opens doors to better teaching and learning. Even the most practical practitioners can find value in this theoretical framework, especially when designing deep learning in advance of testing to encode automaticity in sophisticated sequences and solutions. Effective test prep leads to a reduction of cognitive load during a high stakes test, which in turn facilitates better performance and higher scores.

cognition depth of knowledge learning

Previous articleThe Case for the June SAT & ACTNext article Teachers Plant Seeds of Knowledge
Mike Bergin
Tens of thousands of students a year prep for the SAT & ACT through programs Mike Bergin created or organized. After more than 25 years of intensive experience in the education industry, he's done it all as a teacher, tutor, director, curriculum developer, blogger, podcaster, and best-selling author. Mike founded Chariot Learning in 2009 to deliver on the promise of what truly transformative individualized education can and should be.

Leave a Reply

Your email address will not be published. Required fields are marked *

Helping high schoolers with tests, school, and life is what Chariot Learning is all about. Let us know how we can help you!

Latest Posts

  • Self-Control and Score Outcomes
  • Tests as Equalizers and Predictors of Success
  • Beginner’s Mindset for Advanced Results
  • Make This Your Year of Preparation
  • Who Benefits from Admissions Tests?

What is TestFlip?

Learn about the ultimate in self-directed supplemental SAT/ACT prep, powered by Chariot Learning:

  • Decide your habits well. Your habits decide your future.
    by chariotlearning 6 months ago
    Decide your habits well. Your habits decide your future.
  • The one thing you can control is your effort.
    by chariotlearning 6 months ago
    The one thing you can control is your effort.
  • Knowledge isn
    by chariotlearning 6 months ago
    Knowledge isn't free. You have to pay attention.
  • Believe in yourself, champ.
    by chariotlearning 5 months ago
    Believe in yourself, champ.
  • The depth of your struggle determines the height of your success.
    by chariotlearning 6 months ago
    The depth of your struggle determines the height of your success.
  • Consistency for the work week. Intensity for the weekend!
    by chariotlearning 6 months ago
    Consistency for the work week. Intensity for the weekend!
  • Bring a little extra to your day ;)
    by chariotlearning 6 months ago
    Bring a little extra to your day ;)
  • Be stronger than your excuses!
    by chariotlearning 6 months ago
    Be stronger than your excuses!

Subscribe to Mike’s Podcast

Subscribe to Tests and the Rest

PARENT GROUP AND NEWSLETTER

Are you an Upstate New York parent with questions about college admissions, testing, and scholarships? The Upstate NY College Conversations Facebook group is for you. Join today!

And also sign up for College Road, our free email newsletter delivering expert educational advice, test news, admissions action steps, special offers, and more.

Testimonials

Thanks again for all your help, I’m more than happy with my scores and I appreciate all of your help in the past few months.

Greg, Brighton student

Read more testimonials...

PODCAST

Tests and the Rest is the ultimate college admissions industry podcast. Join Mike Bergin and Amy Seeley every Tuesday and Friday as they discuss the latest issues in testing, admissions, learning, and education with leading experts.
© 2023 Chariot Learning, LLC. All rights reserved.