Signals of Quality: What Effective AI-Powered Tools Look Like

Welcome to the “Signals of Quality” series — a look at what separates effective artificial intelligence (AI)-powered ed tech from flashy technology, and how state leaders and advocates can build procurement practices that put student learning first. Given the growing skepticism of AI and ed tech, how should K-12 education leaders think about what “good” tools look like? Safety-oriented frameworks for AI tools abound, but little exists on assessing efficacy and quality for AI tools used by students and teachers in classrooms. 

Building on early research, this blog series:

1. Surfaces five signals of quality in AI-powered tools.
2. Identifies concrete steps state leaders and advocates can take to prioritize efficacy and learning throughout a procurement ecosystem. 

These insights arise from the AI Policy Hub, a partnership between Bellwether and the PIE Network to connect leaders and advocates with resources, support, and national education experts. Hub advisers for this series also include Babak Mostaghimi (Learner Studio), Bree Dusseault and Robin Lake (the Center on Reinventing Public Education), and Jennifer Alexander (PIE Network).

Explore the full series below.

#1 IN THE SERIES

Not all ed tech is the same, but the “techlash” sweeping K-12 education isn’t making any distinctions. The confluence of debates about phones in schools, social media, screen time in classrooms, and the rise of AI has created a perfect storm that blurs the lines between good AI-powered ed tech tools and bad ones. Yet research shows that a well-designed educational tool is a completely different experience from the addictive scrolling of social media. 

The first installment in the series elevates the five signals that separate high-quality AI tools from low-quality ones.

COMING SOON: #2 IN THE SERIES

Procurement is a powerful mechanism state leaders can use to ensure that any AI-powered ed tech tools purchased for K-12 classrooms are safe and effective. Yet formal efficacy research is slow, few independent sources evaluate AI tools, and state education agencies typically lack the technical capacity to assess vendor claims in depth. 

This second installment focuses on actions states can take to support efficacy-oriented procurement of AI tools.

COMING SOON: #3 IN THE SERIES

Procurement (the process of sourcing, negotiating, and acquiring tools) is one of the most powerful ways education leaders can shape how students interact with AI tools in the classroom. This includes not just state and district leaders but also advocates, who play a critical role in ensuring that states and districts make investments that drive growth in student learning. 

The final installment in the series connects the five quality signals identified earlier in the series to specific actions advocates can take to support stronger AI procurement ecosystems.