Google's AI-powered Med-PaLM has achieved a passing grade on the U.S. Medical Licensing Exam, but still falls short of human doctors. ChatGPT, developed by OpenAI, has also achieved passing or near passing results. Google has developed a new evaluation benchmark to reduce "hallucinations" and a newer version of Med-PaLM has reached 86.5%. AI experts caution that AI should be used as an assistant, not a decision maker. Med-PaLM is being tested at the Mayo Clinic for administrative tasks.
AI can be fairly easy to democratize. The bleeding edge language models created two years ago with large effort are available today as open source projects. It’s difficult for companies to create long term business cases because of that.
But getting permission from the government for the bot to write prescriptions will be as difficult as the government decides it will be.