lol, "if only someone had warned us about this sort of thing?!"
-
@MugsysRapSheet @Lazarou AI has always been a marketing term. What was "machine learning" back when you were probably studying bares little resemblance to Large Language models, but it all get lumped in the same bucket.
Even when criticizing it, we're encouraged to use terms like "hallucinations" that anthropomorphise the systems, instead of using more correct terms like "statistical error".
@jbaggs @MugsysRapSheet @Lazarou It does not at all meet the definition of statistical error, a jargon term in statistics practice. If so we could ask the AI a hundred times and average the results for the correct answer.
-
@jbaggs @MugsysRapSheet @Lazarou It does not at all meet the definition of statistical error, a jargon term in statistics practice. If so we could ask the AI a hundred times and average the results for the correct answer.
-
@jbaggs @MugsysRapSheet @Lazarou It does not at all meet the definition of statistical error, a jargon term in statistics practice. If so we could ask the AI a hundred times and average the results for the correct answer.
@glent@aus.social @MugsysRapSheet @Lazarou No. that would be the "normalized answer" and not necessarily correct at all. Just "average".
-
-
@Lazarou "double checking" and "accident".
EPIC.
seems like today double checking is some kind of failure
-
@Lazarou meanwhile my ceo
@agasramirez @Lazarou all CEOs went to the same "cool kids" CEO school.
-
-
-
@Lazarou God I hope this post is true
It has been moderated away on #Reddit. Several commenters suspect that it is fake.
https://www.reddit.com/r/analytics/comments/1r4dsq2/we_just_found_out_our_ai_has_been_making_up/
Of course their rationales in some cases have been that it cannot be true because the poster and the people in the poster's company certainly would not have been so dumb as to really do this.
-
@agasramirez oh wow, I've heard talk of this attitude but to actually see it in action!
@Lazarou As a CEO (which I am not) I would be happy, if there were still persons in my company, who are not totally relying on LLMs.
@agasramirez -
@Lazarou I have my doubts about this post.
I do not doubt that AI can and will produce fake insights. A very easy way to get that is to ask an AI questions whose answers are not in the numbers you’re feeding it. Or your questions are heavily biased towards things you want to hear („Show me how campaign X increased sale“).
But unless you’re completely ignorant of your own business, you will notice it quickly. Especially if it goes on for 3 months. I deal with a lot of managers and every single one of them looks through raw data. Every system (with or without AI) is faulty and they fine comb every bit that influences their salary relevant metrics.
-
@Lazarou I don't get how LLMs are needed for analytics? This field is basically about counting numbers, statistics magic and visualization. Isn't it?
I mean, asking an LLM what kind of statistical sorcery would be needed to measure this and that and ask it for a small python script will probably work (if you double check everything). But what did they do, to come to a situation where an LLM makes up data for months?
-
@Lazarou Completely deserved
-
@Lazarou
Wonder if Trump uses AI to generate statistics about the US economy
-
@t8g @fred @Lazarou The post has been deleted by reddit moderators
https://www.reddit.com/r/analytics/comments/1r4dsq2/we_just_found_out_our_ai_has_been_making_up/
-
@Lazarou
I wish they'd stop calling it "#AI".It isn't. Not even close. I went to college to study #AI decades ago.
What they are calling "AI" today is nothing more than "deep database scrubbing".
It *assumes* an answer is correct based simply on the number of results it finds supporting that conclusion.
#GIGO: Garbage In; Garbage Out.
@MugsysRapSheet @Lazarou Garbage in Garbage out is such an old principle in computing and yet it's only now we're really seeing it's effects.
-
@Lazarou As a CEO (which I am not) I would be happy, if there were still persons in my company, who are not totally relying on LLMs.
@agasramirez -
@agasramirez Sounds like a "decision " made by an LLM.
@Lazarou -
@Lazarou I don't get how LLMs are needed for analytics? This field is basically about counting numbers, statistics magic and visualization. Isn't it?
I mean, asking an LLM what kind of statistical sorcery would be needed to measure this and that and ask it for a small python script will probably work (if you double check everything). But what did they do, to come to a situation where an LLM makes up data for months?
@flxtr @Lazarou I've seen a ton of analysis reports done by agents and just trusted with little or no verification, looking for wrong database lock strategy, to reasons for errors in logs to data quality issues. It would not surprise me at all that someone pointed an agent at a database or something like crystal reports or even just a bunch of spreadsheets and asked it to summarise them based on a list of KPI, the results would genuinely be that bad without a bunch of hard work.
