The current policies and guidelines of international organizations for Artificial Intelligence in Education (AIED) and research highlight the numerous ethical and practical challenges arising from the integration of Artificial Intelligence (AI) in the educational field, such as privacy and data protection, inequalities, bias and discrimination, transparency, and the quality and personalization of learning. This contribution aims to qualitatively analyze the results from a questionnaire administered to a sample of 244 future teachers, first-year students of the Primary Education Sciences Course, during the Teaching Technologies course at the University of Palermo. The questionnaire investigates the aforementioned ethical challenges, providing an overview of the participants’ perceptions regarding the application of AI in education.