"I just found out that it's been hallucinating numbers this entire time."

@Epic_Null @Natasha_Jay @davidr yeah it's a system failure.
the failure is so bad you need to investigate how such a bad decision could have ever been made and you need to change your process

@Natasha_Jay
Well, AI for professionals & experts is a tool for the expert who is in charge and responsible.
The kind of use of AI described here is for *general public* AI, i.e. where the user has no idea how correct it is & shouldn't even have to care as long as it is reasonably plausible.
Professionals, experts & businesses can NEVER blame the "AI" for the hallucinations they take as truth.

@Natasha_Jay @drahardja some people really don't grasp what innovation is. Randomly running in a random direction is not innovation.

Surely the same people think the luddites just had a dislike for looms or something

@sodiboo @drahardja @indigoviolet @maniaclives i usually just put a space at an obvious location
otherwise readers might spend forever looking for the mistake

@NickBoss @Natasha_Jay
Oh jeez, is THAT where all my SPAM is coming from?!!?

@taurus @Natasha_Jay Wait, "plausible sounding percentages" is not enough checking?

@Natasha_Jay This really is a major issue with #AI.

Even if you use things like #Gemini "Deep Research", it still loves to make things up it couldn't research properly. For instance, I once tried to use it for researching axle ratios of cars and every time I've repeated the same request, it came up with different numbers.

(It can come up with decent results though for topics where lots of scientific papers are available, like life cycle emissions of vehicles with different propulsion types.)

@stragu @Natasha_Jay @drahardja someone says its AI generated, maybe that?

@Natasha_Jay @goedelchen uh no perhaps one should actually check

you know... the things a business does since... ever? Since the invention of business you are having an eye on the operation

@Natasha_Jay "Flounder, you can't spend your whole life worrying about your mistakes! You fucked ed up. You trusted us! Hey, make the best of it!"

@Natasha_Jay @goedelchen ah I think I answered too seriouy
may I advice using a /s when saying things the average stupid person would write non-jokingly

@Quantillion @Natasha_Jay No, an LLM is a toddler that has been reading a lot of books but don’t understand any of them and just likes words that are next to other words, and then you need to be very precise and provide a lot of details in your questions to make it answer anything close to correct, and the next time you ask the same thing the answer is probably different.

But yes, the user bears responsibility as the adult in the relationship.

@Natasha_Jay Sounds plausible.

@Natasha_Jay
He he they are using randomization to make chat bot look more "intelligent"
See this:
https://towardsdatascience.com/llms-are-randomized-algorithms/

@Natasha_Jay@tech.lgbt don't trust an llm for anything other than what 1 + 1 is, like NONE of these check themselves and just make things up if there's no solution. and if not ran locally, pretty bad.

@Natasha_Jay@tech.lgbt Who would have thought that an algorithm to generate answer shaped noise would produce something with the factual value of dummy text.

@Natasha_Jay Vibe work is not work.

@davidr @Epic_Null @Natasha_Jay Fire the bloody management. They keep pushing for "use more AI". If you don't, you are considered to not be a team player, be obstructive, hinder the company and all these things.

@taurus @Epic_Null @Natasha_Jay @davidr but... But... That would lead right up to the board of directors and shareholders. These people are by definition faultless. The eminent purpose of a corporation is to extract wealth without consequences reaching this select group of shitheads.

@Natasha_Jay