lol, "if only someone had warned us about this sort of thing?!"

@Da_Gut

It has been moderated away on #Reddit. Several commenters suspect that it is fake.

https://www.reddit.com/r/analytics/comments/1r4dsq2/we_just_found_out_our_ai_has_been_making_up/

Of course their rationales in some cases have been that it cannot be true because the poster and the people in the poster's company certainly would not have been so dumb as to really do this.

@Lazarou
#analytics #BusinessAnalytics #AIslop

@Lazarou As a CEO (which I am not) I would be happy, if there were still persons in my company, who are not totally relying on LLMs.
@agasramirez

@Lazarou I have my doubts about this post.

I do not doubt that AI can and will produce fake insights. A very easy way to get that is to ask an AI questions whose answers are not in the numbers you’re feeding it. Or your questions are heavily biased towards things you want to hear („Show me how campaign X increased sale“).

But unless you’re completely ignorant of your own business, you will notice it quickly. Especially if it goes on for 3 months. I deal with a lot of managers and every single one of them looks through raw data. Every system (with or without AI) is faulty and they fine comb every bit that influences their salary relevant metrics.

@Lazarou I don't get how LLMs are needed for analytics? This field is basically about counting numbers, statistics magic and visualization. Isn't it?

I mean, asking an LLM what kind of statistical sorcery would be needed to measure this and that and ask it for a small python script will probably work (if you double check everything). But what did they do, to come to a situation where an LLM makes up data for months?

@Lazarou Completely deserved

@Lazarou
Wonder if Trump uses AI to generate statistics about the US economy

@t8g @fred @Lazarou The post has been deleted by reddit moderators

https://www.reddit.com/r/analytics/comments/1r4dsq2/we_just_found_out_our_ai_has_been_making_up/

@MugsysRapSheet @Lazarou Garbage in Garbage out is such an old principle in computing and yet it's only now we're really seeing it's effects.

@flxtr @Lazarou three weeks ago someone got fired because he admitted he didnt know how to use AI for his job (he was a server guy)

@agasramirez Sounds like a "decision " made by an LLM. @Lazarou

@flxtr @Lazarou I've seen a ton of analysis reports done by agents and just trusted with little or no verification, looking for wrong database lock strategy, to reasons for errors in logs to data quality issues. It would not surprise me at all that someone pointed an agent at a database or something like crystal reports or even just a bunch of spreadsheets and asked it to summarise them based on a list of KPI, the results would genuinely be that bad without a bunch of hard work.

@agasramirez @Lazarou If everybody should be using AI, it seems weird that he suggests meeting one-on-one to discuss it.

I recently went to a Microsoft seminar for work. They were full-on “everything is AI now” which I had no interest in. So I found the only breakout sessions WITHOUT AI.

What I found was a much smaller group of people attending and the people leading the sessions actually knew WTF they were doing and I got a lot of one-on-one time with the experts.

@Lazarou Darwin Business Award

@Lazarou @User47 There’s going to be a lot of very embarrassed, broke CEOs soon.

@peterbosch66 @Lazarou missed a trick here. In the last panel it should've been "Eleventy Nine" studies