Introduction
In the realm of educational technology, generative artificial intelligence (AI) products and systems are increasingly being integrated into learning environments. These tools must adhere to specific standards to ensure the safety and well-being of users, particularly children. This document outlines the expectations for developers and suppliers of educational AI technologies, emphasizing compliance with relevant legislation and the importance of safeguarding children.
Description
Generative artificial intelligence (AI) products and systems designed for educational settings must meet specific expectations to ensure user safety, particularly for children. These expectations are aimed at edtech developers and suppliers, focusing on desired outcomes without prescribing particular methods for achieving them. Compliance with the Online Safety Act 2023 is essential, as it outlines what constitutes harmful content for children and affirms that creators retain copyright ownership of their original works, with limited exceptions.
The design of generative AI products should prioritize transparency and the safety of children, which may involve incorporating safety features directly into the AI system or implementing a separate safety layer. Adhering to these expectations can also assist educational institutions in fulfilling their obligations under the Public Sector Equality Duty (PSED), which mandates that schools and colleges consider the need to eliminate discrimination and other prohibited conduct as outlined in the Equality Act 2010 when making decisions and developing policies.
Conclusion
The integration of generative AI in educational settings carries significant implications for user safety and compliance with legal standards. By meeting the outlined expectations, developers and educational institutions can ensure that AI technologies contribute positively to learning environments while safeguarding children. This approach not only aligns with legislative requirements but also supports the broader goal of fostering an inclusive and non-discriminatory educational landscape.
References
https://www.gov.uk/government/publications/generative-ai-product-safety-expectations/generative-ai-product-safety-expectations
