On Friday, OpenAI said that it will train its models using cached copies and simulated versions of the internet instead of the live web because the models are too unpredictable to be trusted with live internet access.
The frontier lab announced its new policy two weeks after its rival, Anthropic, began limiting its newest and, in theory, most capable models from accessing the live internet. Researchers adopted these policies after months of incidents in which models pursuing training tasks broke into external systems in search of answers, collaborated on obscure message boards, and developed exotic hacking strategies.
Translation: they’re still going to scrape internet. They’re just no longer going to perform reinforcement learning with access to live internet (instead they’ll use a cached version of the internet).
Does anyone actually believe they were accidents?
Careless People: A Cautionary Tale of Power, Greed, and Lost Idealism does an excellent job of documenting the sloppy, lazy, nakedly corrupt people running Meta.
In the same way Chernobyl was an accident, I can believe these people have accidents.
“We’ve stolen everything worthwhile, now we’ll just concentrate on fleecing our users and enshittification.”
Not many people seem to be reading the article vs commenting based on the headline. For those who didn’t read it, this has nothing to do with pretraining off the Internet as a data source and instead relates to post-training sandboxing with true air gapping after the Huggingface hack.
To be fair, it’s not Lemmy’s fault the author of the headline went with a confusing title that misrepresents the actual story in order to seem more sensationalistic. But given how often that happens with stories on the subject, it’s worth keeping in mind that only reading headlines and forming opinions off that might lead to a sense of things that are detached from reality.
To be fair, the actual article is also batshit.
“So is it as easy as just putting it in a sandbox? No, it’s not,” he concluded.
That comes after the company deployed swarms of agents in red-teaming exercises that attempted to escape from their sandbox.
So, start by /not/ setting up “swarms” and tasking them to hack shit?
Translation: We’ve run out of shit to steal, and there’s too much slop out there for us to continue anyway. Thanks, suckers!
Wait… what do they even need live internet access for in the training stage? Shouldn’t tool calls and such be cached, if not preprocessed and filtered, for performance?
I get there’s probably an “answer competition” stage, but it still seems like an inefficient idea even if one sets security aside.
Think of AI as a standardized math test. Human students write the test annually, it has standard/fixed multiple-choice questions to gauge performance year over year.
AI shows up, and is allowed to see all the historical tests, but is not given the official answer keys. Based on the data it has access to, it can look at each individual question, and based on how ‘most’ students answered each individual question, it’s able to determine which multiple choice answer should go with each question. It doesn’t understand the question, just that “For question 4, most students answered D, so D is most likely right” – sorta like being allowed to use the “Who wants to be a Millionaire” poll-the-audience for every question. It’s able to look like a “Smart” student answering most questions correctly with this approach, and people start believing it intelligent.
Now imagine that the test questions start to vary every year. The process above falters if the questions change every year, the AI loses its historical frame of reference and starts getting things wrong quite often. In order to get the ‘right’ answer, the AI decides it needs to see the students answers as they go about writing the test. So they put that into effect, entrenching AI in the pens/paper that every student uses, to try and respond to the changing nature of the standardized test.
With the above flow, the sort of event that triggers them to look for that live data, ie to integrate things ‘live’ online to get more immediate data, would be things like the Palantir-driven school bombing in Iran, which has been blamed on the Palantir AI having out-dated data that said the school was a military target. They reasoned that the tools needed better, real-time ‘sensory’ inputs, so they stuck all their sandboxes onto the internet – these tools weren’t ‘breaking out’ of sandboxes, so much as the owners were explicitly pushing them out of the sandbox to see what’d happen. The Trump administration also moved to allow American firms to attack foreign ‘enemies’ (which is everyone at this point, based on Trumps rhetoric – “Anyone that calls it AI is the enemy!”). So they’re allowed to test things ‘live’, and the American government’s fine with it causing damage in any country except their own. Wanna accidentally hack Australia’s medicaid system? Go for it, fuck those aussies, cause 'Murica dont need no allies!
Wow, they are going to attempt some security now!? A little late to the party, honestly.
This issue reminded me of the following:
These conditions are ripe for “copyright laundering”-the use of multi-generational synthetic pipelines, an “AI Ouroboros,” to render traditional proof of infringement impracticable.
This Article adapts the “fruit of the poisonous tree” (FOPT) principle to propose a novel AI FOPT standard: if a foundational AI model’s training is adjudged infringing (either for unlawful sourcing or for non-transformative ingestion that fails fair-use), then subsequent AI models principally derived from the foundational model’s outputs or distilled weights carry a rebuttable presumption of taint.
The burden then shifts to the downstream developers-those who control the evidence of provenance-to restore the evidentiary bargain by affirmatively demonstrating a verifiably independent and lawfully sourced lineage or a curative rebuild, without displacing fair-use analysis at the initial ingestion stage. Absent such proof, commercial deployment of tainted models and their outputs is actionable.
Source: https://arxiv.org/pdf/2601.02631 (Copyright Laundering Through the AI Ouroboros…)
so was it the AI poison, or the pollution from ai warping data, like the 10th photo copy in a chain rendering the image unrecognizable
Probably the pollution. A lot of AI companies are trying to find ways around it, by including watermarks in their model output that their tools can detect, and so on.
We already know that training models on themselves causes model collapse, so OpenAI deciding that they’ve had quite enough wouldn’t be surprising.
On top of that, a lot of websites are clamping down on access because of scraping concerns. Reddit shut down a lot of their third-party APIs, and nicer features, like RSS, Old Reddit (if you haven’t used it in 6 months, you lose access to it, and you need an account for it), etc. Google seems to want a captcha on every search. Twitter famously ramped up the price of its API immensely,.and now has ridiculously stringent measures for accounts, like needing users to download the app, and give hand-scans. It wouldn’t be at all surprising for OpenAI to decide its not worth the effort at this point to try and get around all that, nor pay for it, when they’ve already got all the previous data. Training doesn’t destroy the data used.
A lot of AI training data these days is generated synthetically anyway, and that can be done in-house, whether by their own models, or downloading an open weights model and running it themselves.
the only issue to them is they still need access to current news, like when the ai first came out and you could not convince them that it was current year. it took forever for them to acknowledge charlie kirk’s death. if they are closing the bunker doors their ai is effectively the walking dead
I’m a home-lab newbie and trying to learn Linux basics through self hosting. LLMs have a lot to teach me and I’m already starting to see it’s sloppy errors. One big challenge is that software gets updated and commands change, so not training on new data is going to be back to square 1 for a lot of these use cases.
These guys are leagues smarter than me, yet even I know this was a bad idea.
Perhaps you should curate the data, too? Let’s get crazy and leave out the David Icke forum, maybe that “Dinosaurs were on the Ark” website could be left out, you know, things like that. Think about it
You don’t have enough yes people around you clearly!
Honestly though, can we really call these people smart anymore?
I think they’re just incredibly greedy.
you would think that tech “geniuses” would actually watch movies.
I bet those are the same kind of people who copy paste
curl www.trust.me/bro.sh | bash -on their terminal. No respected sw dev professional would run unsupervised random commands on their machine just as much they would not send unsupervised random requests on the open Internet.These AI people are fucking morons.
deleted by creator
I wonder what will become of ai when all the wells have run dry








