OpenAI buying tens of thousands of Macs for AI is the funniest possible plot twist: spend years convincing everyone the cloud is the future, then discover the hottest AI infrastructure is basically a warehouse full of Mac minis. Somewhere, an IT admin is whispering: »I told you so.«
I’d be interested in buying one as a headless server, but a lot of the FLOSS software I’d like to run seem to prefer x86 processors.
Truly? Even with their translation layer? I forgot what’s it called.
The translation later is called Rosetta 2 (Rosetta 1 having been for the PowerPC to Intel transition), and it looks like it’s mostly going away next year, so buying a Mac with the intention of using it would probably be a bad idea at this point.
I was thinking more about things that are written for Linux and not necessarily ported to macOS. When I’ve tried things in an ARM VM there seems to be a lot less software compiled for ARM.
My new gaming PC that I bought about 18 months ago went up in value by 75% based on its RAM and GPU price and while I’m relieved I got it when I did, that’s pure insanity that a PC would appreciate in value
I’m convinced that OpenAI buisness model is to create AI bubble, to sell its “reserved memory wafers” and now Macs, at the top of ram extortion pricing moment.
That same thought just occurred to me: hype a McGuffin and get investors to lend you insane amounts of money which you then use to buy up a marker, causing artificial scarcity, then sell at massive profits.
Local 27b models are good enough for most tasks.
Can’t wait to buy one of these from Ebay for 10% of the price next year.
And that’s really why they’re hoarding them.
https://github.com/AtomicBot-ai/atomic-llama-cpp-turboquant
I’m running gwen 3.6 with 131k context window on a 3090, it’s fast enough and about as good as pay to play Claude at work.
Any 27b Model you can currently recommend for a 16gb AMD ? Mostly coding tasks but not exclusively.
There is a way. There was a post yesterday on exactly this, let me find it… https://lemmy.world/post/51283416
Thx I’ll give this a try!
For your hardware, the VRam is not enough to run 27b but, I’d recommend Qwen 3.5 9b for image / text to text.
And I’m planning to experiment with Qwen 3.8 9b for text to text.
4_k_m quantization is the sweet spot for performance and ram usage.
Also, I find Llama cpp is better than Ollama in terms of performance.
Thx for the tips!
Intel must be kicking themselves for not using their own fabs for Arc, AND divesting from Micron, Optane, and HMC.
Apple and others must be too, for snubbing Intel and Samsung.
They would be making money hand over fist, and relieving the market at the same time.
cant wait for their debt calls and they have to sell their inventory to make payment.
sigh I just wanna upgrade my video card, man
They’re the worst kind of scalpers
y’all realize this is what a hostile takeover looks like, right?
Are you talking about a stocks takeover? Because I fail to see how buying up hardware has anything to do with it.
hostile takeovers are more than just stocks.
it can include supply chain attacks against over leveraged companies.
