mobyduck648

Medical AI is usually more along the lines of ‘we’ve created a proprietary model for computer aided diagnostics specific to x disease being scanned with y modality and we’ve taken this through the regulatory process in z jurisdiction’ than ‘put your symptoms into an LLM lol’.

What worries me is people using it for safety-critical things without appreciating the danger, for a test some of my friends who sail for a living asked various chatbots some questions like ‘how would you approach a berth under sail when the wind is against the tide?’ and every single one but Claude got it dangerously wrong, and Claude wasn’t 100% either it just refrained from suggesting a sail plan that would lead to you crashing into the pontoon.

Will give a shout out to Mistral which got the sailing element of the question very wrong but did sensibly suggest ‘turn your engine on and perform the manoeuvre under power’ which of course is what you should do if you can.