For OpenAI, o1 represents a step toward its broader goal of human-like artificial intelligence. More practically, it does a better job at writing code and solving multistep problems than previous models. But it’s also more expensive and slower to use than GPT-4o. OpenAI is calling this release of o1 a “preview” to emphasize how nascent it is.
The training behind o1 is fundamentally different from its predecessors, OpenAI’s research lead, Jerry Tworek, tells me, though the company is being vague about the exact details. He says o1 “has been trained using a completely new optimization algorithm and a new training dataset specifically tailored for it.”
OpenAI taught previous GPT models to mimic patterns from its training data. With o1, it trained the model to solve problems on its own using a technique known as reinforcement learning, which teaches the system through rewards and penalties. It then uses a “chain of thought” to process queries, similarly to how humans process problems by going through them step-by-step.
At the same time, o1 is not as capable as GPT-4o in a lot of areas. It doesn’t do as well on factual knowledge about the world. It also doesn’t have the ability to browse the web or process files and images. Still, the company believes it represents a brand-new class of capabilities. It was named o1 to indicate “resetting the counter back to 1.”
I think this is the most important part (emphasis mine):
As a result of this new training methodology, OpenAI says the model should be more accurate. “We have noticed that this model hallucinates less,” Tworek says. But the problem still persists. “We can’t say we solved hallucinations.”
It’s a better prediction model. There’s no reasoning because it’s not understanding anything you’re typing. We’re not closer to general ai.
OpenAI doesn’t want you to know that though, they want their work to show progress so they get more investor money. It’s pretty fucking disgusting and dangerous to call this tech any form of artificial intelligence. The homogeneous naming conventions to make this tech sound human is also dangerous and irresponsible.
Their work is making progress. What is irresponsible or dangerous? Im not understanding what you mean.
It’s irresponsible because making it sound like it’s true AI when it’s not is going to make it difficult to pull the plug when things go wrong and you’ll have the debate of whether it’s sentient or not and if it’s humane to kill it like a pet or a criminal. It’s more akin to using rainbow tables to help crack passwords and claiming your software is super powerful when in reality it’s nothing without the tables. (Very very rudimentary example that’s not supposed to be taken at face value).
It’s dangerous because talking about AI like it’s a reasoning/thinking thing is just not true, and we’re already seeing the big AI overlords try to justify how they created it with copyrighted material, which means the arguments over copyrighted material are being made and we’ll soon see those companies claim that it’s no different than a child looking up something on Google. It’s irresponsible because it screws over creative people and copyright holders that genuinely made a product or piece of art or book or something in their own free time and now it’s been ripped away to be used to create something else that will eventually push those copyright holders out.
The AI market is moving faster than the world is capable of keeping up with it, and that is a dangerous precedent to set for the future of this market. And for the record I don’t think we’re dealing with early generations of skynet or anything like that, we’re dealing with tools that have the capability to create economical collapse on a scale we’ve never seen, and if we don’t lay the ground rules now, then we will be in trouble.
Edit: A great example of this is https://v0.dev/chat it has the potential to put front end developers out of work and jobless. It’s simple now but give it time and it has the potential to create a frontend that rivals the best UX designs if the prompt is right.
I appreciate the effortful response but i dont think regulators would get caught up on colloquial names when weighing benefit versus harm and deciding to do something like ban a model.
We just arent close enough to the same perspective to discuss it further. Thanks again for the good faith clarification.
I think over-selling the “AI” with “reasoning/thinking” language becomes fraudulent and encourages inappropriate/dangerous applications.
Why does ai that has a “reasoning” step become dangerous?
assuming that “AI” has “reasoning” and using it in applications that require that is dangerous
It will be used to take control over peoples lives.
In any simple way it may be - denying job/insurance/care/etc, it will be hailed as using ‘reason’, while it just repeats patterns from the training sets.
It does not ‘reason’, because it can’t. Trying to sell it as such is very dangerous as it will be used against people, and it’s dishonest for the investors as well, as they will jump on it even though it’s not ‘true’ and it never will be for this model.
I wish more people would realize this! We’re years away from a truly reasoning computer.
Right now it’s all mimicry. Mimicry that hallucinates no less…
trained to answer more complex questions, faster than a human can.
I can answer math questions really really fast. Not correct though, but like REALLY fast!
It scores 83% on a qualifying exam for the international mathematics olympiad compared to the previous model’s 13% so…
😋
So they slapped some reinforcement learning on top of their LLM and are claiming that gives it “reasoning capabilities”? Or am I missing something?
It’s like 3 lms on top of eachother in a trenchcoat, and appau a calculator so it gets math right
That’s not what reasoning is. Training is understanding what they’re talking about and being able to draw logical conclusions based on what they’ve learned. It’s being able to say, I didn’t know but wait a second and I’ll look it up," and then summing that info up in original language.
All Open AI did was make it less stupid and slap a new coat of paint on it, hoping nobody asks too many questions.
And this is something data scientists have already been doing with existing LLMs.
Can’t wait to read about it telling someone to put glue on pizza.
I just love how people seem to want to avoid using the word lie.
It’s either misinformation, or alternative facts, or hallucinations.
Granted, a lie does tend to have intent behind it, so with ChatGPT, it’s probably better to say falsehood, instead. But either way, it’s not fact, it’s not truth, and people, especially schools, should stop using it as a credible source.
Being wrong is not the same as lying. When LLMs start giving wrong answers on purpose to mislead people we would have a big problem.
The thought of a maliciously deceptive AGI is terrifying to me. Many, many people will trust it until it’s too late.
Dang, OpenAI just pulled an Apple. Do something other people have already done with the same results (but importantly before they made a big fuss about it), claim it’s their innovation, give it a bloated name so people imagine it’s more than it is and produce a graph comparing themselves to themselves, hoping nobody will look at the competition.
Just like Apple, they have their own selling point, but instead they seem to prefer making up stuff while forgetting why people use em.
On a side note they also pulled an Elon. Where’s my AI companion that can comment on video in realtime and sing to me??? Ya had it “working” “live” a couple months ago, WHERE IS IT?!?
Meanwhile a bald turtle and his AI anime daughter on twitch can do exactly this, and he’s building her at home on nvidia GPUs.
(Vedal987 and Neuro-sama, if you’re curious)
Pulled an Apple?
I know you hate apple because android is way better but people loved their ipods, iphones, airpods and apple watches. Sure those things were made before but Apple did make them better. So I don’t know what your point is.
Assuming I’m an android fan for pointing out that Apple does shady PR. I literally mention that Apple devices have their selling point. And it isn’t UNMATCHED PERFORMANCE or CUTTING EDGE TECHNOLOGY as their adds seems to suggest. It’s a polished experience and beautiful presentation; that is unmatched. Unlike the hot mess that is android. Android also has its selling points, but this reply is already getting long. Just wanted to point out your pettiness and unwillingness to read more than a sentence.
Reinforcement learning my beloved ❤️
Lol Lemmy has the funniest ai haters they drown out any real criticism with stupid strawman nonsense
I’m getting so tired of the pessimists who are against AI. Granted, I can reflect and see my own similar attitude towards Trump: no matter what, I would never vote for him considering his history and who he is as a person. But treating the next generation of technology feels different than that to me; AI is the future, it’s the next revolution. Sure, there are several real issues to criticize and question (copyright, compensation, hallucination come to mind) but instead shit here on Lemmy just gets downvoted to hell with no explanation. I know this comment will get downvoted, but I just wish we could have a discussion about the future without shutting down every practical comment wanting to talk about it.
I’m kinda in the same boat but on the other side. I always try to argue with people about this. It gets me a lot of flak on pro AI posts but that won’t stop me. I usually get very aggressive replies and sometimes some fucked up dm’s too.
I’m against it because we are already seeing the consequences of this technology and it’s only getting worse. By the time laws catch up it’s gonna be too late and the damage will be done. For some technologies that’s not always the worst. But we already saw how long it took for anyone to do anything about the Internet when it came out, and we are still trying to this day. This shit is growing so fast we will all feel the whiplash. Sites like Facebook are getting absolutely flooded with so much AI that they are becoming almost unusable. And that’s before we even get into the shady shit people use AI for like making porn of people they know with the click of a button. I recently read an article about how bad deepfake porn is in South Korea (found the article. https://www.nytimes.com/2024/09/12/world/asia/south-korea-deepfake-videos.html). And in places like the US, where a lot of these companies are based, they are so slow to do anything about a problem it’s going to be too late by the time they get to it.
But besides all the awful things happening because of AI, I do have one personal gripe with the whole ordeal. Why are we so quick to replace the things we enjoy with AI? When I get home from work I like to make music and practice pixel art (I’m not very good at either yet). I’d much rather have AI replace my job than my hobbies. I’m down for things that are useful, but too much of this just gives me a bad gut feeling. Like their trying to replace people and not their jobs.
This may be the future. But it sounds like a pretty dystopian future to me. You already can’t believe everything you see on the Internet and this will only make it worse.
I’d recommend everyone saying “it can’t understand anything and can’t think” to look at this example:
https://x.com/flowersslop/status/1834349905692824017
Try to solve it after seeing only the first image before you open the second and see o1’s response.
Let me know if you got it before seeing the actual answer.
