Developers reported that since April, renowned medical institutions, including the Mayo Clinic research hospital, have been testing Google’s AI tool known as Med-PaLM 2.
PaLM 2 was first unveiled at Google I/O in May of this year, and Med-PaLM 2 is a customized version derived from it. Google’s Bard uses PaLM 2 as its primary language model.
The report reveals that Google’s confidence in Med-PaLM 2’s improved capabilities, particularly in areas with limited access to healthcare professionals, was expressed in an internal email that the publication was able to obtain.
In comparison to more generalized chatbots like Bard, Bing, and ChatGPT, Google believes that this updated version of Med-PaLM will enable more effective healthcare conversations because it was trained on a carefully selected collection of demonstrations from medical experts.
Limitations of Med PaLM 2
The article also draws attention to a study published by Google in May that shows Med-PaLM 2, like other big language models, still has accuracy issues. In the study, doctors found that the responses produced by Google’s Med-PaLM and Med-PaLM 2 contained more errors and unrelated information than those given by real doctors.
Despite these concerns about accuracy, Med-PaLM 2 outperformed real doctors in almost all other metrics, including showing evidence of reasoning, offering solutions that were supported by consensus, and displaying accurate comprehension.
According to the report, customers will have control over their encrypted data during the testing phase of Med-PaLM 2, ensuring that Google does not have access to it.
According to Greg Corrado, Senior Research Director at Google, Med-PaLM 2 is still in the early stages of development. Corrado expressed his belief that Med-PaLM 2 has the potential to significantly improve healthcare by extending the areas where AI can provide significant benefits, though he acknowledged that he personally wouldn’t rely on it for his family’s healthcare needs.
Read more: UAE Arrests Asian Man for Showing Off Huge Cash Pile at Luxury Car Showroom
