Discussion about this post

User's avatar
Paul Koning's avatar

"Because China can’t even steal it properly and file off all the serial numbers from what they stole." -- yup. I learned that decades ago, back when Huawei had just gotten started and was caught doing exactly that with Cisco's IP.

As for "...there were at least 20 human specialists who had to rewrite over 100 prompts telling AI why “This answer is wrong, now do it again, without the hallucinations this time.” Otherwise, they had to hold AI’s hand the entire way, step by step." that matches my experience precisely. My employer has gotten serious about using AI, and while I've had some notable successes, I have definitely observed what you describe. And for the cases where things worked rather well, part of the reason is that I spent several hours very carefully crafting a detailed prompt.

K.M. Carroll's avatar

Great perspective here! My husband likes to use Grok to come up with new card decks for Magic the Gathering and other games. Grok constantly invents cards then lies about it. It can't do basic math. "I removed one card (from 50) and added four more, that brings the total back to 50". I recently did a search for Shell Beach in CA. It gave me the correct stats and location, then proceeded to tell me about Shell Beach in Western Australia. It's so stinking unreliable.

9 more comments...

No posts

Ready for more?