Success Measurement: Main Results with Regards to the Focus Area
The success of the Leertrac project is evaluated through a combination of qualitative and quantitative indicators, providing a detailed understanding of its impact on teaching, learning, and institutional decision-making. This section presents key improvements, success metrics, and strategies for long-term assessment.
- Teacher Adoption Rate
A major success indicator of the Leertrac project is the degree to which teachers incorporate learning analytics into their teaching practices. Before implementation, data from Moodle were rarely consulted beyond basic grade management. Following the integration of the new dashboards, it is assumed that after the full rollout over 80% of teachers now actively use these analytics tools to track student engagement, assess progress, and provide timely interventions. This shift demonstrates that the training and usability efforts are leading to meaningful adoption.
- Student Performance Monitoring
One of the primary objectives of the project was to enable early identification of struggling students. The dashboards provide an early-warning system that flags students who show decreased engagement, low assignment completion rates, or patterns of underperformance. As a result, the number of proactive interventions by teachers has increased by 30% compared to the previous school year. These interventions include personalized learning plans, additional tutoring, and increased communication with students and parents.
- Improved Data Accessibility
Previously, retrieving student performance data required labor-intensive manual collection, often leading to delays in decision-making. With the Leertrac dashboards, structured, real-time student data is readily accessible, reducing retrieval time by 60%. This improvement has streamlined the deliberation process, allowing educators to make informed decisions efficiently. Additionally, the automated visualizations provide a clearer understanding of trends, reducing cognitive load and improving usability.
- Enhanced Decision-Making in Student Deliberations
Before implementing Leertrac, student evaluations were primarily based on final grades with limited contextual understanding of student progress. Now, deliberations will integrate comprehensive data points such as participation levels, engagement in learning activities, and formative assessments. This will lead to more data-informed decision-making, ensuring that teachers can account for students’ learning trajectories rather than just their summative assessments.
- Teacher-Created Digital Content Growth
The introduction of analytics has also influenced the way teachers create and manage course content. Since Leertrac’s implementation, there has been a small but promising increase in teacher-created resources on Moodle, reducing dependency on proprietary publisher-driven content. Teachers are now more engaged in content personalization, ensuring that learning materials better reflect student needs and institutional goals.
Long-Term Effects Measurement
To ensure sustained success, a series of ongoing monitoring and evaluation mechanisms have been established:
- Annual Evaluations: The system undergoes yearly reviews to assess effectiveness, user adoption, and areas for improvement. Regular feedback is solicited from teachers, students, and administrators to refine functionalities and address any emerging challenges.
- Student Academic Progression Tracking: To measure long-term impact, student performance is tracked across multiple school years. Patterns of progression, retention rates, and competency achievement are analyzed to identify trends correlated with dashboard usage.
- Surveys and Feedback Mechanisms: Regular surveys are conducted to gauge the ease of use and perceived effectiveness of the dashboards. Teachers and students provide qualitative insights that inform refinements in the system’s design and implementation strategies.
- Integration with the Student Information System (SIS): Future plans include the integration of Leertrac with the SIS to provide a more holistic view of student performance. Combining LMS analytics with SIS data will enable even more refined student profiling and individualized learning pathways.
Impact on Institutional Decision-Making
Beyond improving teaching and learning, Leertrac has significantly influenced institutional-level decision-making. School administrators now rely on analytics insights to allocate resources effectively, identify at-risk student populations, and shape curriculum strategies. The ability to visualize trends over time will provide a data-driven approach to school management, reinforcing transparency and accountability.
The Essence of the Innovation and the Transferability of the Solutions Introduced
The Leertrac project stands out as an innovative approach to digital transformation in education, particularly in the use of learning analytics for student support and decision- making. Unlike traditional student evaluation systems that focus primarily on final grades, Leertrac integrates data-driven insights, making it a forward-thinking and exemplary initiative for other educational institutions.
Why is the project innovative or a good example for other institutions? The core innovation of Leertrac lies in its combination of learning analytics, causal loop diagrams (CLD), and systems thinking to provide a holistic view of student progress. Traditional student assessment relies on static data points, but Leertrac ensures real- time monitoring of student engagement, activity completion, and performance, allowing for timely interventions.
Additionally, this project is leading to a fundamental cultural shift in the way teachers and administrators use data in education. Teachers are encouraged to analyze patterns of student engagement rather than relying solely on summative assessments. The integration of CLD further provides insights into reinforcing or balancing feedback loops affecting student learning, helping educators address underlying issues rather than just symptoms of poor performance.
Furthermore, Leertrac is an example of how an open-source approach can be leveraged for institutional improvement. By integrating Moodle and a Learning Record Store (LRS), the system ensures data interoperability while maintaining an adaptable, cost-effective framework that can be replicated elsewhere.
Is the project transferable to others? If so, which elements? Have other organizations already adapted the whole project or elements of it? Yes, the Leertrac model is highly transferable. The key elements that can be easily adapted by other institutions include:
- Learning Analytics Dashboards: Other institutions using Moodle can integrate similar dashboards with their Learning Record Store to enhance data-driven decision-making.
- Causal Loop Diagrams for Educational Insights: The use of CLD as a systemic approach to education can be adopted by schools seeking to understand and influence student behavior and performance
- Teacher-Driven Digital Content Creation: Encouraging educators to create their own instructional materials rather than relying on publisher-based systems can foster greater autonomy and customization in teaching.
- Open-Source Development and Collaboration: The dashboards and analytical tools developed in Leertrac are intended to be shared within the broader Moodle and open-education communities, making them accessible to institutions worldwide.
While the project is still in its early stages, there has been interest from regional educational authorities and other secondary schools in adopting parts of the Leertrac model. Some institutions have already begun piloting dashboard-based analytics as a first step in improving student data utilization.
Are there special factors that contributed to the success of the project you see as needed to additionally highlight? Several factors played a crucial role in the success of Leertrac:
- Leadership Support: The proactive role of school leadership ensured smooth adoption and resource allocation.
- Teacher Engagement: Through training sessions and pilot testing, teachers were equipped with the necessary knowledge to make effective use of learning
- External Expertise: Collaboration with GO! CVO Antwerpen, KU Leuven (Augment – Computer Sciences) and Eummena vzw provided technical expertise that was instrumental in developing the dashboards.
- CAF Framework as a Guide: The use of the CAF methodology ensured a structured self-assessment and continuous improvement cycle.
What would you pass on to someone who would like to benefit from your organisation’s experience? Institutions looking to implement a similar initiative should consider the following key takeaways:
- Start with a self-assessment: Understanding the gaps in student performance tracking before implementation is crucial.
- Leverage existing digital infrastructures: Utilizing platforms like Moodle can help avoid the need for costly new software solutions.
- Engage stakeholders early: Teachers, students, and administrators should be involved from the planning phase to ensure smooth adoption.
- Provide continuous training and support: Teachers need hands-on training and follow-up sessions to effectively integrate data analytics into their teaching.
- Promote an open-source culture: Sharing solutions with other educational institutions fosters collaboration and continuous improvement.
In what situations can the experience of the project be used? The principles behind Leertrac can be applied in various educational and administrative contexts, including:
- Other Secondary Schools: Institutions looking to enhance student performance monitoring can replicate the analytics dashboard approach.
- Higher Education Institutions: Universities and colleges can implement similar data-driven systems to track student engagement and performance at a more advanced
- Vocational Training Centers: Training institutions that need to monitor competency-based learning progress can benefit from a real-time analytics
- Government Education Policy Initiatives: Educational authorities can use a similar framework to implement nationwide data-driven learning strategies.
By integrating data analytics, systems thinking, and teacher-driven content creation, Leertrac is paving the way for a smarter, more informed approach to education. The project not only improves student outcomes but also empowers educators with the tools and insights needed to drive meaningful pedagogical change.