AI is changing everything. Its not a lie, its absolute truth.
The problem is the changes are fuckawful terrible for everyone and everything.
AI has been helpful for my job, sure, but the cost in terms of societal damage is so great it makes me wish AI were never created.
In my academic field of sustainability, AI still fails to explain what economic sustainability means. It’s very simple.
I lecture and explain to my students that economic sustainability is about how we assess and manage our knowledge, innovations, wealth, and other man-made capital. I stress that it is ABSOLUTELY NOT profit and revenue.
Sure enough, my students submit assignments clearly written by AI that state economic sustainability is profit and revenue.
AI is regurgitating decades of green-washing and even bad academic articles that state economic sustainability is about profits. I use that AI god mode site to test several AI’s at once and they’ve consistently gotten this wrong for 3 years.
The trick that AI pulls is just that it is really good at appearing competent, and we as humans really bad at acknowledging how little we individually know about the world around us.
The easiest example to ask AI detailed questions about something that you know you have expertise in. If you try to test its limit, no matter what your particular expertise is, I’m confident that in 5-10 minutes you’ll realize it’s no more intelligent than an average Joe who spent their lunch break Googling the subject or maybe someone who read a book about it once.
To give credit where it’s due, that does mean that these AIs have a much wider breadth of knowledge than any one person could have and that is, objectively, very cool.
On the other hand, that’s why it’s so easy to believe that AI is this all-knowing oracle that can replace all of humanity. It can give you a way better answer in an instant about things you know nothing about than you ever could off the top of your head, so it seems unbelievable. It’s instant gratification that also feels really valuable.
Despite the trick that AI plays on our psychology, you could also just read a book or two or participate in any form of genuine learning, and it really doesn’t take long for you to outgrow whatever the AI is capable of. It takes a bit longer, but now you have grown your actual intelligence and you get to keep it for a $0/month subscription and they don’t need to build another data center in your backyard.
The trick that AI pulls is just that it is really good at appearing competent
Yeah it’s almost like the AI is an unthinking machine trying to model what a person would answer to the question (prompt) provided to it.
I’m so goddamn tired of people (not you) acting like an LLM “knows” anything nevermind whether it’s right or wrong or could even tell you if it didn’t know the answer. It’s not like a person that can say, “I don’t have that knowledge so I know any answer is likely wrong” the machine is going to give you an answer every time. That answer will never be “idk” it’ll be whatever hallucination it’s confident enough is right based on the model and training.
I do think there are use cases for it and the technology is cool but the vision being sold and propping up our economy with a venture capitalist circle jerk is so far removed from reality.
that’s also how really successful human beings work. they bullshit and lie and appear confident, and people believe them and ignore the people who don’t do that, because they don’t appear as confident.
also why people basically fall in love with AI, because it spouts nothing but bullshit at them and they eat it up like candy because being fed back bullshit is a dopamine hit.
interacting with real people doesn’t supply endless dopamine and they might not tell you what you want to hear.
I typed into Google “potatoes pressure cooker” to get a reminder of how long to cook them. The AI told me, and correctly said that I should use the steamer sieve, but also told me to salt the water. The water that would be under the potatoes and that wouldn’t touch them.
I asked why, and the AI said that little splashes of salt water from the boiling would land on the surface of the potatoes and salt them gently, that the salt would increase the boiling temperature, and that the vapour would be aromatic.
I pointed out that the amount of salt landing on the surface of the potatoes would be negligible, that the vapour is distilled water in gas form, and that the increase in boiling temperature from salting the water is less than 1°C. The AI said, oh yeah, you’re right on all counts. Don’t salt the water.
What it has been doing was exactly what an LLM does. It gave me the received wisdom from the internet.
That aligns with what Cory Doctorow was saying here, namely that all the AI successes were from people who already knew what they were doing and could use the AI as a tool. Not from people who had no clue and just let AI do the job.
I use google “ai” in when thrifting for audio gear. Minimum 80% of the time it gets something GLARINGLY wrong. “Oh ho ho! You correctly pointed out that I was completely wrong on all counts! An astute observation! Let me try again but this time give you the CORRECT information.”
I mean, to be fair, that’s a dirt cheap model you’re talking to, and Google is not exactly at the forefront of any tier of model, cheap or otherwise.
Is that you being fair or is that you rushing to defend something?
As if you don’t know these “tools” don’t work.
I really like a song that has intro and outro samples and I wanted to know where they were from, so I googled. Google AI promptly informed me that the song has no samples. Guess that settles that.
I do potatoes in my instant pot but leave the water in, it just gets absorbed. So the salt is effective in that case. I salt the potatoes themselves and toss them before adding the water, too, so they should get reasonably seasoned.
Also i use soup stock.
Mashed, though.
Salting the water would increase the boiling temperature I guess, but it seems like a waste of salt because that info isn’t meaningfully changing the cooking time
Salting the water is relevant when not using a pressure cooker. It makes no sense when you’re steaming them in a pressure cooker. AI is a good tool, sometimes. But for everyday tasks, it is irrelevant and often wrong.
I use AI as a writing tool, not as a substitute for authorship.
The ideas, intent, perspective, and final judgment are mine. I decide what I want to say, what belongs in the piece, what does not, and whether the finished version accurately represents me. AI may help me organize my thoughts, clarify a sentence, improve the flow, or find wording that better expresses what I already mean. That is not fundamentally different from working with an editor, dictating to a transcriber, or revising a draft after receiving feedback.
What matters is that I review the final work, approve it, and put my name on it. By doing that, I take responsibility for every sentence. If the writing is thoughtful, accurate, and effective, I am responsible for those choices. If it is careless, misleading, generic, or full of slop, that is also my responsibility. Blaming the tool would be an attempt to avoid accountability.
AI does not decide what I believe. It does not decide what I am willing to defend. It does not decide what I publish under my name. I do.
The tool may assist with the writing process, but the authorship comes from intention, judgment, selection, revision, and responsibility. The final work is mine because I chose it, shaped it, approved it, and signed my name to it.
“I dont write anything but i take credit for everything”
I was reading the initial comment with peer-reviewed publications in mind and it all sounded like standard practice, but then I read yours and was like “oh, are we talking about books now?”
Either way, its still a bad look. Peer review is even worse than Op Eds, or fiction, or what have you… But its all equally socially degenerate
that’s bullshit.
What matters is that I review the final work, approve it, and put my name on it.
that’s just called writing.
That “AI” is a completely dumbed down one with reasoning disabled. Of course it’ll make stuff up.
apparently ai just broke a cryptographic scheme, hawk, that the us government was assessing to standardize.
What has AI changed so far?
- Hardware prices are so far up that nobody can buy good hardware anymore
- we have AI child porn now, awesome
- we have AI undressing apps, cool
- we have AI, the great cheat tool now † we have AI, the confidently wrong 20% of the time tool
- we have AI, the great misinformation tool
- we are at the brink of the largest economic collapse in human history caused again by the rich loving to play Russian roulette
- there are a limited amount of actual useful applications as well, yay
And all it cost us were millions of jobs, thousands of psychosis and deaths, hundreds of new loud polluting data centers, untold amounts of co2 when were right smack in the mids of a climate crisis…
I’m not advocating for murdering the AI CEOs, but I’m definitely a fan of at least permanent tarring and feathering
Only pro is laborious, tedious programming tasks have become significantly faster to do, along with testing edge cases and stuff a programmer should be able to do but maybe doesnt need to.
Just about everything else is negative.
I don’t know, it’s also fun to do role play games with a locally hosted thingamabob-bot-computer-talker. I recently played a 1930s noir detective in New Orleans RPG with AI. It was neat and kept me entertained for hours.
- two of my friends finally have diagnoses for their health problems they had been living with for decades, and can now get appropriate treatment
That’s awesome! Imagine if we took all the resources spent on pushing AI for stuff it isn’t good at and invested them in training models for detecting, classifying and correlating medical indicators and using that to anonymously connect people with a network of physicians and psychiatrists for further evaluation and preliminary diagnostics to help with getting actual treatment.
We could bring a more reliable version of that help your friends happened to get to more people, with less of a random chance that the model will reinforce the issues or misdiagnose people with dangerous consequences. We could improve the world.
Instead, they burn books, fire people and abuse eminent domain to displace people so they can run power lines to feed data centers fucking up the water supply for residents that got no say in whether they want oversized heaters in their backyard.
I’m glad your two friends got some use out of this. Is that really worth the price?
Trust me, bro!
They are real people these friends of mine, but you don’t know them, because they are from a different school. And you won’t see them this summer at all because… they are both actually models in Canada during the summer.
But totally cured and now they get boners also with THIS ONE TRICK that doctors HATE it!!!
The medical field is one of the places where AI has made real, tangible improvements.
I can’t vouch for that other person’s anecdote, but it seems entirely plausible that an LLM chatbot would be able to better diagnose an issue than a search engine, or even a human doctor, especially if the underlying issue was something like an autoimmune disease, which are notoriously difficult to diagnose.
One of the big flaws in the medical profession (and, really, most professions) is that once you are out of school, nothing forces you to keep learning as the field advances. This potentially, and counterintuitively, results in gaps in knowledge that increase the longer a doctor has been practicing. LLMs, with access to the newer medical information and with the ability to receive and output natural language, do make good tools for diagnosis.
AI, as it turns out, is also way better at analyzing MRI scans and x-rays than humans.
An old-fashioned Google search can point you to more information, if you’re curious about how AI has advanced the medical field.
Super cool! Well we can base your personal healthcare on AI’s sole guidance and if you are misdiagnosed, injured or dead as a result of an “oopsie”, no human will be held legally liable - fun!
So no real stakes for anyone to get it right, as with human-led interventions (with careers on the line at every stage to keep people engaged and honest). But corporations will probably just naturally do the right thing.
But you’re brave, you offer yourself as tribute to the lying machine. Tight tight tight!!!
You seem very passionate about this topic, but you’re not really adding much to the discussion.
Don’t worry, its coming across loud and clear that AI could cure cancer and you’d still think it was better to have cancer than use AI. I get it. AI = bad, full stop. Message received.
“AI” isn’t a thing. Computer vision, machine learning, natural language processing and neural networks are. These can all be useful tools when regulated and maintained with active oversight to balance with society’s other core priorities. What’s at question is the current method and human cost for this frivolously hyped, deceptively marketed lying machine with a single tangible use to date, being the operating system for Facebook’s pervert glasses. You didn’t read, of missed the entire point of, this important article, shared from an important contemporary mind.
Name and cite SPECIFIC examples of anything you claim.
P.s. you don’t “cure cancer”… cancer is a broad heading for hundreds of unique types of disease, presenting in different, completely unique systems within the human body. Like AI, “a cure for cancer” is a broad generalization of complex underlying systems that ignorant people make frivolously - People who think they HAVE the entire knowledge of the world in their brains, when they actually only have a plastic rectangle in their pants pocket with privilege-gated access to a (mostly corporate) CURATED VERSION of the world’s historic knowledge. So if you’ve “cured cancer” friend, why aren’t you treating the 20-30k humans that will die from a form or cancer today worldwide?
Medical AI is usually more along the lines of ‘we’ve created a proprietary model for computer aided diagnostics specific to x disease being scanned with y modality and we’ve taken this through the regulatory process in z jurisdiction’ than ‘put your symptoms into an LLM lol’.
There are studies that show that LLMs (chatbots) perform as well or better than human physicians.
I’m not suggesting getting rid of physicians, though. This is a tool for humans, not a replacement.
Lots of luddites in this thread. There’s no putting this genie back in the bottle. We are at the dawn of a Cambrian explosion of intelligence. Frontier level models are finding novel solutions to decades-long unsolved maths problems. The only limits are compute power and even more simply, energy. See you guys in the singularity
Yes I am a Luddite, a proud tech-loving Luddite. And if you think there’s a contradiction in that, then you need to read up on what the Luddites stood for.
The problem is not that AI tech exists. Machine learning has been around for quite a while, and the modern neural processor chips are a great evolution of it. The problem is that corporations are using the tech for exploitation, plagiarism on an industrial scale, and creating misinformation ant terrifying speed.
Though you reference to the Luddites is quite appropriate in that they opposed the replacement of skilled labourers with child workers, just as modern day opponents of AI slop seek to stem the tide of skilled programmers being replaced with vibe coders, artists and illustrators with prompt writers, and the myriad of workers being replaced with inferior imitations of intelligence.
“Once men turned their thinking over to machines in the hope that this would set them free. But that only permitted other men with machines to enslave them.” Frank Herbert, Dune
AI isn’t real, but it’s gonna ruin society anyway. There is absolutely zero possibility for genAI to develop intelligence because it’s just a probablistic chatbot. It doesn’t know anything; it’s just rolling dice to guess what word to spit out each time. A high school student who copies his friend’s calculus homework will eventually learn a little calculus. A chatbot will never learn any calculus. Claiming these genAI models will develop intelligence with better compute technology is like claiming a puppet will develop intelligence with better string technology.
I rank LLMs as game changing as Google Search when it first came out. It’s a tool, nothing more.
It does seem like it’s positioned to replace search engines
It is better at producing relevant information, but it may never be great, or even as good, at producing reliable information.
It’s not lying if they have no idea what they’re talking about and constantly swoon over it.
What worries me is people using it for safety-critical things without appreciating the danger, for a test some of my friends who sail for a living asked various chatbots some questions like ‘how would you approach a berth under sail when the wind is against the tide?’ and every single one but Claude got it dangerously wrong, and Claude wasn’t 100% either it just refrained from suggesting a sail plan that would lead to you crashing into the pontoon.
Will give a shout out to Mistral which got the sailing element of the question very wrong but did sensibly suggest ‘turn your engine on and perform the manoeuvre under power’ which of course is what you should do if you can.
I see a lot of useless people creating a ton of busy work that just becomes an unbearable workload for the people under them. Working in manufacturing environments which (you aren’t gonna believe this) are all horrifically understaffed is bad enough. Now i get to watch good workers get buried under Solvace/Fabriq/etc checklists and Leading2Lean/PerformOEE/etc task lists and spreadsheets and meetings to discuss kpis and metrics.
I need a new line of work
Hate to day it, but every industry has turned into that. At least in my anecdotal experience and my network’s anecdotal experience, useless people using AI to create shit that means extra work for others is happening everywhere. Not saying you should stay in manufacturing if you hate it, but just be aware that you probably won’t be leaving that issue behind.
Yeah, right. My boss gave me a bunch of risk assessments to read through and let slip that AI had ‘helped’ produce them. So I said I’d get AI to summarise them. All this vast computing power and climate damage is being used for bullshit.
In other words, corporate leadership is starting from the premise that AI has (or will) radically change the business, and they’re working backwards from that premise to find the evidence to support this article of faith.
Sounds familiar. The proof-of-work blockchain scheme which was the fad a while ago is also often described as a solution in search of a problem.
I feel like block chain as a public ledger has found quite a few purposeful uses, and was a solution to a handful of problems most people rarely if ever encounter. Then fake money got involved
Yes, exactly.
Block chain would have been an amazing solution to most democratic vote validation processes.
I’m glad you specifically pointed out proof-of-work blockchains.
They’re very inefficient (economically and ecologically) by design. In almost all cases this design isn’t warranted.
Alas there are other designs and while most of them are rubbish as well, a few ones are doing things quite right.I hope that just like other schemes than proof-of-work were thought of regarding blockchains, there will be AI models that are way, way more efficient and ideally can be run locally - for those cases that can use AI…
But it IS changing everything, and not in a good way
It’s a self-fulfilling prophecy: if all the corporate leaders believe it will change everything and, in a fit of FOMO, force it into every corner of our lives, then everything will be changed. But not so much because of what AI can do, as because of a mass delusion among the LinkedIn types.
It’s changing a lot of things, but many of them in only relatively minor ways. It’s not affecting e.g. food supply systems in a significant way - it might be screwing up the management structures of companies involved, but that will be repairable fairly quickly…
I don’t think they’re all lying; most are just misinformed or using the term differently than Cory.
It’s like saying “global warming is changing everything.” Technically, not true, but the knock on effects of specific aspects of it recently hit an inflection point that causes it to affect the lives of everyone.
This has also happened in the field of artificial intelligence; LLM chatbots are only the visible mushroom fruits of the vast mycelium network that has been silently growing underground for years.
silently growing underground for years.
And not so silently, for decades. Even J. Edgar Hoover was using early forms of AI to manage his data trove.
This moment in history is a lot like when power tools were first invented. The bad news is corporate leaders seem to view AI as a means to downsize people. The good news is that AI lets many people who formerly lacked the ability to do anything on their own to move on the “I wish I could do ____. but _____” ideas in their head. It could be anything. You can run a competent local AI model in LM Studio with a $1000 gaming PC or you can pay $20 a month to run a frontier-quality open weights model without the usage limits of the big names. The free AIs can help you get started on doing that. Big companies are using AI for a lot of stupid crap that they try to make sound very profound. They assume customer service and quality assurance are no longer “a thing”. This era reminds me of the 1970s when Bill Gates and Steve Jobs had their opening. Sometimes the big guys get sloppy. We’re at that point right now. Enshittification is everywhere.
A more recent (and maybe closer) analogy is the advent of ebook readers and the heralding of the Death Of The Book. I suspect we’ll be in a similar place in a few years - books stores are doing just fine, perhaps even better than pre-ebook.
It’s also notable that MBAs tend to be people who are into the networking versus the work and they will follow the trends wherever they leave because that’s what good monkeys do.
I generally respect this guy’s opinion (I probably use the term “enshitification” multiple times a week!), but pretending that “AI” and “Chabot” are interchangeable terms seems wildly reductive, and the subtle presumption that the process of changing is a binary changed/non-changed situation instead of a curve is just ignorant.
If the internet was “turned off” after 4 or so years not much would have changed, either.
I think you’re making a strawman argument here. He isn’t arguing that it’s a binary switch that has failed to throw, he’s arguing that we don’t have compelling evidence that the ends justify the means:
In other words, corporate leadership is starting from the premise that AI has (or will) radically change the business, and they’re working backwards from that premise to find the evidence to support this article of faith.
And this is completely true! Supposedly “data informed” organizations are trying to find a yardstick that shows actual, meaningful improvement in business outcomes from AI. In my own organization we have people touting LOC yet again because “big number”, but anyone who’s ever worked in software can tell you it’s an asinine metric to use as a KPI.
It’s inherently unscientific to start with the answer and work backwards to a satisfactory question. His point that this push is coming from the least knowledgeable of real processes- and more closely resembles religious fervor than business acumen- seems to at least warrant consideration.
The world is full of people who insist that “AI is changing everything” but who – when pressed – have to admit that what they mean is that they’re pretty sure that AI will change everything.
If Donald Trump ordered Big Tech to turn off all of your country’s chatbots tomorrow, nothing would change. Every one of your country’s ministries and corporations would chug on with nary a hitch. Households, too, though perhaps a few of the younger members of those families would have to do their own homework again.
He is definitely pretending that change is either on or off.
Are CEOs jumping the gun on how quickly they adopt AI into workflows? Definitely. However, there’s a big difference between “AI isn’t at a threshold where it is disruptive” and “AI isn’t disruptive”. Or, to belabor the metaphor: CEOs are jumping the gun, but the race is about to start and they’re on the correct track.
If you watch a full podcast (he has done a ton in the last couple weeks), he clearly identifies AI as not a mere hype technology, as something interesting and potentially useful from a technology perspective, and he definitely doesn’t conflate a chatbot with all AI. That doesn’t undermine the vast problems with it, how it’s being used against regular workers, the threat the bubble poses to the economy, the criti-hype cycle, etc.
I think you’re oversimplifying “Cory Doctorow” based on the article you’re reading or specifically how he presents a more complex idea to different audiences.
Watch the Jon Stewart podcast interview if you want more nuance:
A key word in that sentence is “if”, it is a rhetorical example, that’s probably pretty much correct at this point. It’s not a recommended course of action, it’s a declaration that it contrary to crazed hype, it isn’t currently as core to everything as would be befitting the current hype level.
I would argue that the CEOs aren’t on the correct track, they aren’t really in a particularly specific trajectory. I just had a debate with someone on this and their stance was “well in a hundred years do you expect things to be like they are”. My response “I cannot possibly speak to that, but we need to speak to today instead of pretending we know how things will be in a hundred years and pretending they are already at that level”. The “imagine a hundred years from now” by a relative outsider to the tech is dominating CEO mindset, and that’s problematic.
Once the bubble pops, we will almost certainly see a more durable and sane adoption for these technologies. For now, the hype is a problem as it enables some of the worst possible stewards of the technology and favors grift over progress.
Corey Doctorow isn’t speaking to you, he’s speaking to the many, many people who have been fooled by the ai craze.
And often I wonder, how many people have been fooled, and how much of the enthusiasm and over the top fantasy is astroturfing by a few people incentivized to sway public opinion?
Pretending AI and Chatbot are interchangeable is a marketing strategy by the companies who make these advanced chat bots. “They are artificially intelligent bro”.
I don’t disagree that the term AI has shifted significantly in the last 4 years or so, but I was actually meaning it in the other direction, as in, there is more to generative AI (what people are calling “AI” these days) than just chat bots.
“Chatbot” style AI is wildly good and bad at varying kinds of tasks, and a lot of that has to do with how it has been prepared.
Some LLMs have been trained to make images - I’ve not been too impressed with them, but that’s what they’re “good” at - and better than the LLMs that have been trained to write computer code when you ask the coding LLMs to draw a picture.
The code writing LLMs have actually improved the most at reviewing code over the past 8-9 months, and that ability to review their own code makes them dramatically better at writing code as well.
I find Google Gemini to be pretty impressive at scanning laws and regulations and finding, not creative, but functional solutions to stated problems within the constraints of (often frustratingly bizarre) legal structures.
And all of them will lie to you, tell you what a great idea you have, etc. They’re not really lying, they’re mostly just taking what they read at face value without checking corroborating sources enough to find the obvious (to you) blunders. If you want the LLM to be sure, ask it to go on the RAG (Research Augmented Generation) - check everything before saying it, they can do that, especially “paid mode” engines, but it reduces their capacity for analysis of complex problems by 3-10x, because they’re spending so much context window “being sure” - you can alternatively spend 3-10x as long solving complex problems / accomplishing complex tasks if you have them do their homework, verify everything from “the best” available sources 3x and build up a local document set of “trusted information” which is used in preference to whatever it might find at random on the internet. This isn’t as sexy as “Hey Claude, code me up a database that does X Y Z” and getting the result in 30 seconds, but it is how professionals have been doing their jobs for centuries: learn reliable information first, then act on it.
I think it’s a worthy simplification that sums up the current state of things well. We have AI that broadly has different uses and then we have the ChatBot/ChatBot derived AI applications. The market is not going insane over the broader AI category. Executives are not tripping over themselves to say things like machine vision is going to replace all labor, or at least all white collar labor. The chatbot is the only thing in the conversation of consequence.
All the “everyone says AI is the reality, so everyone feels like they must say AI is the reality” refers to this specific category. It might be veering towards being oversimplified, but it’s trying to balance a perspective that is also oversimplified. Generally, we aren’t good at weighing simple straightforward takes against complex nuanced takes, so you have to “net it out” to have any hope of the point landing.
