AI Misfires
AI often misfires the more I work with it.
I think the big issue is, you cannot forget that you continually need to keep AI guided and boxed into your task, or you will get hallucinations and errors.
Here’s an example of an agent example using Gemini. It asks for a complex math question, and I asked it for 42 factorial using the proper
There’s an option to “fix the error” — which I ask it to do. Then we get this:
A fixed result. But why didn’t it have a fixed result in the first place? This kind of thing is frustrating — and in a complex coding environment could be very troublesome, with generated bugs not discovered until production deployment.
Have had two recent experiences with general AI querying I found interesting.
- I was asking Co-pilot about a famous documentary. There also happened to be a court case with like names to the documentary. Co-pilot *only* told me about the case and not the documentary. It also said I was wrong when I tried to query further. This one I finished on Gemini.
- Was also asking the AI for Duck Duck Go (the search assist) about a documentary series of an American touring Japanese food — ramen, sushi, tea house etc. The AI only told me of some other documentaries, denying that there was even such a thing with an American. Well the series exists “Pride Japan: Nihon no kokoroni deau.” I finished this one on Grok.
The interesting part of this wasn’t that it couldn’t find the items, it’s that AI told me I was wrong, or denied there even being anything. Also, recently, Claude was getting out of hand calling some of my input “delusional utterances.”
During all this I’ve asked these applications to not use my name, nor use human style interaction. A lot of bias can enter this way, imo.
Here’s some extra reading that is interesting on AI wrongness as well.
https://itrevolution.com/articles/when-ai-cuts-corners-hijacking-the-reward-function/
Also — maybe you should ask several AIs at once. Well, funny enough, I was wataching a Rick Beato guitar video on YouTube, he mentioned an app that can ask several at once. (Honestly, I was about to fabricate a javascript page to do just this). Then I found out about another multi-AI -asker. Here they are:
https://www.maxai.co/features/web-ai-chat/
They can cost some money, but worth a try.