-
Notifications
You must be signed in to change notification settings - Fork 479
Description
Hi
I would like to know if there is a way to map the questions in the dataset to the specialities mentioned here
I am aware that the dataset can be accessed via these links:
- https://openaipublic.blob.core.windows.net/simple-evals/healthbench/2025-05-07-06-14-12_oss_eval.jsonl
- https://openaipublic.blob.core.windows.net/simple-evals/healthbench/hard_2025-05-08-21-00-10.jsonl
- https://openaipublic.blob.core.windows.net/simple-evals/healthbench/consensus_2025-05-09-20-00-46.jsonl
But is there a way to map each of these datapoints to the medical categories mentioned(namely the list below)?
Anesthesiology, Dermatology, Diagnostic Radiology, Emergency Medicine, Family Medicine, General Surgery, Internal Medicine, Interventional Radiology and Diagnostic Radiology, Medical Genetics and Genomics, Neurological Surgery, Neurology, Nuclear Medicine, Obstetrics and Gynecology, Ophthalmology, Orthopaedic Surgery, Otolaryngology, Pathology, Pediatrics, Physical Medicine and Rehabilitation, Plastic Surgery, Psychiatry, Public Health and General Preventive Medicine, Radiation Oncology, Thoracic Surgery, Urology, Vascular Surgery
Thanks in advance for your help!