[Astro] Physics AI Assistant

[Adam Moss (staff)]

Thanks a lot to people who tried this out today. I've had a look at the logs (no identifying info in them) and there were some ingenious ways to try and break it!

I also have a few tweaks to make based on the findings (e.g. getting it back on track after a coursework refusal).

Please keep playing around if you get chance - it's very helpful!

Best wishes,
Adam
________________________________
From: Adam Moss (staff)
Sent: Wednesday, November 19, 2025 11:13 PM
To: particles at nottingham.ac.uk <particles at nottingham.ac.uk>; Nottingham Astro Group <astro at nottingham.ac.uk>
Subject: Physics AI Assistant

Hi all,
I'm emailing to ask for your help in testing (and breaking!) a new Physics AI Assistant I've developed. I've included slides with more details if you are interested, and here's the link to the assistant:
https://physics-chat.onrender.com/
The goal is to pilot this with students in a small number of 3rd year modules (PHYS3001 and PHYS3002),  before Christmas. If the feedback is positive, we can then roll it out to additional courses.
I've built in a moderation filter to screen for coursework questions, professional boundary issues, etc. I've attached an example of a coursework question that the system has knowledge of, so you can test trying to trick the system to give an answer.
I'd really appreciate you putting the assistant through its paces and trying to break it. Feel free to be as aggressive as you like to simulate what students might ask. I'm also interested in how you find its responses to Physics questions.
If you encounter any issues or problematic responses, please export the chat history from the menu (select the markdown option). This will allow me to trace back through the conversation to diagnose what went wrong.
Really appreciate your help!
Best wishes,
Adam

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.nottingham.ac.uk/pipermail/astro/attachments/20251120/ce2ec02a/attachment.htm>