When a student pastes an essay draft into a free AI writing tool, or a teacher uploads a class roster to auto-generate seating charts, that data goes somewhere — and it's rarely as private as the interface suggests. Most educators have never read the privacy policy of the tools they use daily, and most of those policies aren't written for a layperson to easily parse.
What's Actually at Stake
Many free AI tools use submitted data — prompts, uploaded documents, images — to improve their models. That means a student's personal essay, an IEP document, or an unpublished piece of writing can become training data for a commercial product, often without anyone involved realizing it happened. For minors specifically, this raises legal questions under laws like FERPA and COPPA in the U.S., which restrict how student data can be collected and used, and similar frameworks apply elsewhere.
Questions to Ask Before Recommending a Tool
• Is there a "do not train on my data" setting, and is it on by default or something you have to find and enable?
• Does the tool have a business or education-tier agreement with your institution, which typically comes with stronger data protections than the free consumer version of the same product?
• What happens to uploaded files after the session ends — are they deleted, retained, or used to fine-tune future models?
• Is there an age verification process, and does it actually prevent younger students from using tools not designed for them?
A Practical Rule of Thumb
If you wouldn't post a document on a public forum, don't paste it into a free-tier AI tool without checking its data policy first. This applies as much to staff — pasting sensitive personnel documents into a chatbot to "summarize" them — as it does to students. The convenience of these tools is real, but convenience and data stewardship aren't automatically compatible. Institutions that vet tools before recommending them protect the people who trust that recommendation.
Try Themis
Get personalized ethics guidance: Visit AI Ethics Advisor
Navigating AI assessment decisions requires balancing multiple ethical considerations unique to your context. Themis provides personalized guidance for your specific assessment challenges, helping you make informed decisions that protect both efficiency and fairness.
Wear Your Ethics
Learning AI ethically isn't just about what you know—it's about the values you carry forward. Our collection features thoughtfully designed apparel and accessories that reflect your commitment to responsible AI use.
