.Attributes Medicine, Released online: 26 July 2024 doi:10.1038/ s41591-024-03181-6Although huge foreign language models (LLMs) reveal commitment in regulated environments, a research currently exposes their limitations in real-world medical treatments and directs the method towards robust analysis and benchmarking just before clinical make use of.