Serving and evaluating open-weight models for health on Ortet’s Orion cluster

We evaluated 34 open-weight models on 50 health tasks on Orion, our NVIDIA Blackwell cluster, and compared them with ten models accessed through APIs across clinical medicine, biological research, and medical coding.