Prompt Drift

“It works for a little while. It may work beautifully for a hundred inquiries using that prompt, but eventually it starts to drift. And I know that I've had this frustration factor on both my personal use as well as sometimes my use at work, particularly with, I've admitted I'm frustrated with Copilot. They get drifty and they get really drifty and you sit there and you're like, "It's not that hard. Why don't you just do your job? I told you what your job is." And one of the things that it's doing in the back end is it's trying to streamline me. Given it a complex set of edits, like, "Where can I cut corners?" And so I would say is kind of where the disappointment is, that it's hard to create a workflow that replicates every single time consistently without it being long and detailed, saying, "You may not move on until this happens." That's I think the big disappointment, that you don't have the, vibe coding is such a thing right now, but you don't have that kind of usage of AI.”

“I'm used to trying things over and over and over again, and once I get it right, I don't have to worry about it anymore. It works. With AI, I'll try things over and over and again and I get it to work, then I try to use it again and I get something different, like complaints, "Oh, I can't access these files" that I just accessed before.”