We put way too much faith in AI as it is. AI can't do my job (yet) but the pharmacy we collaborate with put AI in charge, and we ended up having to drop them as our supplier before someone got seriously hurt.
The difference between 1 pill every 5 days and 5 pills every 1 day is pretty extreme. Also, it's .gov regulation that our paperwork matches the prescription verbatim, as well as the med label from the pharmacy. We have been "flagged" by state inspectors for having a medication administration record say "1 pill by mouth every day" when the prescription said "1 pill by mouth each day". Means the same thing, but is not an exact match. Retrain everyone, document that training, put a system in place for redundant double checking, etc to fix it.
The pharmacy put AI in charge. Prescription would say "Take 1 tablet by mouth daily". AI would print take "Take 1 tablet every morning at 7am with food." WAAY different. Pointed that out. They said "hey, the computer decides whats best. We can't change it." Apparently it has an algorithm to determine the perfect way to take that medication for optimal efficacy. Wonderful. Except we can't use it. They made so many errors, we had to drop them after partnering for 20+ years because the computer in charge was making errors to the point of becoming a danger to our program participants, so we dropped them.
AI can find the optimal time for medication, but can't figure out how to duplicate a phrase exactly. They fired all their senior pharmacists BEFORE making sure the new system worked, and when is went sideways, had a bunch of kids trying to fix it.
Screw AI. It's the new OUIJA board, and equally as trustworthy.