instructional leadership

How to Evaluate EdTech Tools that Support Teaching & Learning

Jan 08, 2024
How to Evaluate Ed Tech Tools

Modern classrooms are being transformed by educational technology (edtech). With device access now largely established in most districts, the focus is shifting away from adoption and onto instructional impact through blended and virtual learning opportunities that can fundamentally change how learning occurs. As the traditional classroom has evolved into an environment rich in technology, schools are increasingly looking for guidance on how to choose the best edtech solutions. 

Ask educators about best practices in teaching, and they will often discuss a short list of widely accepted frameworks for effective instruction, such as Charlotte Danielson’s Framework for Teaching and the Universal Design for Learning (UDL) framework. They will reference widely accepted research from the likes of Marzano and Hattie. Now, more than ever, educators can say with confidence: “We know what works.”  

The challenge today is applying those best practices consistently across core instruction, intervention, acceleration, and in virtual or hybrid learning environments. Here are some research-based guidelines for choosing edtech tools for use in the classroom: 

Whether learning is digital or traditional, standards matter 

If a tool is delivering course content to students, it should be built on a foundation of clear learning objectives aligned to state standards. Courses should be competency-based and should frequently assess student progress until mastery is attained. Edtech providers claiming to meet career-readiness standards or support career and technical education (CTE) pathways should clearly document the alignment of their courses to those standards and pathways in your state. Because of the importance of aligning digital courses to standards, many states require edtech providers to submit their online courses for approval.  

Tools should engage students 

Technology offers students a visually and auditorily rich experience, and there is no question that it is important for students to enjoy learning in the virtual environment created by an edtech tool. Yet, tools need to engage learning at a deeper level. Meaningful engagement also calls for students to see the relevance of what they’re learning and how they can use that knowledge to identify and achieve their academic and postsecondary goals. 

Effective edtech tools should engage students by providing them with a choice of when and how they learn. Tools designed to deliver content should pre-assess student knowledge and use that knowledge to construct learning activities at the student’s zone of proximal development—the “sweet spot” where the level of challenge in the learning task is just right. 

When students have choice and content is at the correct level of difficulty, learning is more enjoyable and, therefore, more engaging. Student engagement is also fostered when students can collaborate with peers during the learning process. Digital learning that allows students to co-engage with others leverages the theory that learning is socially constructed and provides opportunities for interaction that elicit higher-level cognitive skills through discussion, debate, and collaboration. 

Tools should support teachers and inform classroom instruction 

Edtech tools might be implemented as part of classroom instruction in a blended model, serving as a supplement for students when they are at home, or be centered at the core of pure virtual learning. No matter the implementation, edtech tools exist to serve learning, wherever it occurs. Teachers should consider several important questions when evaluating edtech tools: 

  • Does the tool reduce teachers’ time spent planning, grading, or analyzing data, rather than adding to it?
  • Does the tool and the information I get from it help me meet the needs of my students?
  • Is the tool simply a digital version of an existing lesson activity, or is it providing new avenues for learning?
  • Does the tool integrate easily into my classroom?
  • Does the professional development available with the tool prepare administrators, teachers, and support staff for successful implementation?
  • Does the tool meet students at their current skill level and respond and adapt with a customized path for learning?
  • Does the tool provide valuable reports on student progress and performance that inform my teaching? 

When considering the effectiveness of an edtech tool, teachers should observe the outcomes of the use of the tool and ask, “As a result of implementing this tool, do my students seem to have a deeper understanding of the content as measured by my own observations/assessments?” 

Tools should leverage technology for effective assessment 

The same technology that can make edtech tools visually appealing and engaging can also provide teachers with real-time data on student performance and progress and give meaningful feedback to students as they learn. Technology-based assessments can also provide detailed data that drives an individualized learning experience for students. Many tools support classroom teaching by helping teachers collect data on students' progress and performance. Integrated formative assessments give teachers and students quick, predictable feedback using fixed-form assessments targeting specific skills or knowledge teachers can use to inform their instruction. 

Another way technology-based assessments can shine is in their ability to be adaptive—using AI-powered, computer-adaptive testing (CAT) to adjust the type and difficulty of questions presented to students based on the knowledge and ability of the test taker. The results of adaptive tests provide accurate assessment data on students from a wider range of abilities by eliminating ceiling and floor effects inherent in fixed-form tests and can be used to provide formative assessments that meet students more precisely at their instructional level. The greatest value comes when assessment results can translate directly into instructional next steps. 

Decision-makers should consider ESSA requirements 

If technology-based interventions are to be used as part of a school improvement plan, then they are subject to the evidence-based requirements of the Every Student Succeeds Act (ESSA) of 2016. Interventions that are implemented in the lowest-performing 5 percent of Title I schools, as well as high schools with a graduation rate below 67 percent, must meet one of the top three evidence tiers (strong, moderate, or promising evidence) and must align with the school’s improvement plan.  

Many competitive grants that fund interventions at both the state and federal levels also require a strong, moderate, or promising level of evidence. Grants for interventions demonstrating a higher level of evidence may take priority over grants with interventions supported at a lower level of evidence. For higher-performing schools, ESSA language strongly encourages state and local education agencies to prioritize evidence-based interventions or strategies as they develop improvement plans. For more information on choosing evidence-based interventions, see this document from the U.S. Department of Education. 

Today, evidence requirements also factor into grant competitiveness and board oversight, making careful evaluation even more critical. 

Supporting sound teaching should matter most 

Choosing the right edtech tools in the constantly changing technology landscape is definitely a challenge. It’s important to tie the decision-making process to sound foundations of teaching. Digital learning is subject to the same pedagogical best practices as traditional classroom instruction, and the edtech tools you implement should serve students and teachers, fostering an engaging, differentiated learning experience that connects with students and helps increase their knowledge and skills. 

 

For more resources that can help with the selection of edtech tools, consider our EdTech for Impact Buyer’s Guide.

Get the latest education insights sent directly to your inbox

Subscribe to our Knowledge Articles