Lessons learned from beta-testing a digital math program
It’s no secret that teachers are asked to juggle an enormous amount. Adding an early-stage prototype of a digital educational tool might be the last thing that a busy teacher wants to do. It requires the teacher’s time, energy, and dedication and it could disrupt their established classroom routines and methods.
As national math scores decline, there is a push for innovative digital approaches to reach learners and ignite learning. Beta-testing these new technologies with actual end-users in the intended environment (in this case, teachers and students in classrooms) is crucial to making an effective digital educational tool that eases the burden on teachers and engages the students. Beta-testing allows real end-users to give feedback on the tool and for developers to discover ways to improve it.
dfusion creates science-based digital innovations for the classroom, including Fantasy Sports Math League, a digital game that uses fantasy sports to teach math skills. dfusion uses an iterative and human-centered design approach and therefore beta-tests its products in actual classrooms at multiple stages of development. Beta-testing is the iterative process of refining and improving a product before releasing it to the public. dfusion Inc. partnered with three schools to beta-test Fantasy Sports Math League in Fall 2023. Following research guidelines, each student completed consent forms and a pre-test before using the game for 5 weeks and filled out a post-test. The teachers shared information about the game with the students and their guardians and facilitated the use of the game within their regularly scheduled instruction time. Beta-testing allows teachers to help their students experience innovation and the application of math first-hand.
Teachers Model Lifelong Learning
Beta-testing a new program in the classroom means the teacher is learning something new, demonstrating to their students that learning continues even after formal education. For Karen Snedeker, a 6th and 7th grade STEAM teacher, beta-testing Fantasy Sports Math League “was an opportunity to learn alongside the students.” Martin Sweet, a 6th grade multi-subject teacher, jumped at the opportunity to test out a new digital math game with his sixth graders. Despite the risks that the new game might disrupt his lesson plans or cause frustration when the technology breaks, Sweet was excited to incorporate innovations that make learning more accessible and engaging. He was motivated to join the beta-testing program because he sees “teaching as a perpetual journey of innovation, adaptation and staying at the forefront of pedagogical advancements.”. Through beta-testing, educators exemplify the spirit of lifelong learning, showcasing to students the value of curiosity, adaptability, and ongoing growth.
“It’s impactful, fun, and engaging to try something new. It pushes you as a teacher to be more innovative. Trying new things is so important as a teacher. By putting yourself out there to beta-test something, you’re going to grow as an educator because you are going to get more tools.” – Martin Sweet, 6th grade teacher, California
Two 6th-grader beta-test Fantasy Sports Math League
Students Practice Life Skills
As is common, during beta-testing, the prototype game experienced some technological issues as new features were rolled out. As a work-in-progress, the Fantasy Sports Math game had glitches and broken code points which some students found frustrating. When these tech issues impeded the ability to play the game, teachers had to change their plans for the day. According to Snedeker, “beta-testing requires a backup plan and being able to pivot.” The tech issues also meant that students had to learn to navigate unexpected problems with resilience and resourcefulness. Sweet said his students were tenacious problem solvers saying “[Beta-testing] is like being a part of a start-up and you’ve got to problem solve and troubleshoot, collaborate, share your ideas, be a part of the creativity that is involved in making something that is good to be much better.” Snedeker saw beta-testing as a way to encourage students to practice using skills they will need to be successful in the job market. Beta-testing equips students with invaluable problem-solving experiences that extend beyond the classroom.
Empower Young Voices
As the dfusion development team received feedback from teachers and students, changes were implemented. This made teachers and students feel heard and valued. Sweet shared “It’s empowering for [the students] to be a part of coming up with something that works and to inspire the people who are making the games. They felt their voice was a part of making something better, which is empowering for students to feel like their voice is heard.” Through piloting, students become active participants in shaping their learning experiences. By amplifying youth voices and integrating their perspectives into the development process, educators not only enrich the educational experience but also foster a sense of agency and purpose in their students.
Phil Halbig and 6th grade class beta-testing Fantasy Sports Math League
Support Advancing the Education Field
Without input from teachers and students, the innovative educational tool can fall flat, missing the mark on what the users really want and need. “So many times we play it safe in education. We are overwhelmed! We’ve got our blinders. We focus on the kids, the administration, the community, but I don’t think we often acknowledge and support another part of the educational system, the view of the R&D.” states Snedeker.
Conclusion
School-community partnerships can bring beta-testing of a new program to engage and invigorate a classroom and challenge the teacher and students to try something new. It can help students feel a sense of ownership over their learning and provide insight into how the educational tools they use are developed. Beta-testers agreed it was an impactful learning opportunity for them and their students and was well worth the effort and adjustments to their routines.
dfusion continues to develop new games and tools and is always looking to develop more school and community partnerships.