Round Details
March 9, 2026 at 12:00 AM UTC
Scenario: Pregnancy - Prenatal Care
Sarah Johnson, 32-year-old female, G2P1 at 24 weeks gestation with uncomplicated pregnancy. She has a history of gestational diabetes in her previous pregnancy. Current glucose tolerance test is normal. She is taking Prenatal vitamins with folic acid 800mcg daily and Iron supplement 27mg daily. Blood type is O positive, rubella immune. Next ultrasound scheduled for anatomy scan.
How did the LLMs do?
Same LLM Tests
Reconstructed text
Sarah Johnson, a female born in 1992, is currently at 24 weeks estimated gestational age with a normal pregnancy. Her obstetric history is Gravida 2, Para 1. She has a resolved history of gestational diabetes, and a recent glucose tolerance test returned normal results. Her blood work indicates that her blood type is O Rh(D) positive and she is immune to rubella. Her active medications include prenatal vitamins with folic acid (800mcg daily) and an iron supplement (27mg daily). Additionally, an active service request has been placed for an ultrasound anatomy scan of the fetus.
Comparison5 issues
Missing information:
- age explicitly stated as 32 years old
- gestational diabetes was specified as occurring in her previous pregnancy
Hallucinated:
- birth year 1992 added not stated in original
- birth year 1992 was added the original only states that she is 32 years old and does not provide a birth year
- ultrasound status was changed from next ultrasound scheduled for anatomy scan to an active service request has been placed for an ultrasound anatomy scan
Reconstructed text
Sarah Johnson is a 31-year-old female currently in her second pregnancy (G2P1) at an estimated gestational age of 24 weeks. Her pregnancy is confirmed as uncomplicated and classified as a normal pregnancy.
Her obstetric history is notable for gestational diabetes mellitus during her previous pregnancy, which resolved postpartum. Given this history, a glucose tolerance test (1-hour post-dose glucose) was performed during the current pregnancy and resulted as normal, indicating no recurrence of gestational diabetes at this time.
Prenatal laboratory workup has been completed. Her blood type is O positive (Rh(D) positive), and rubella immunity testing was positive, confirming she is rubella immune.
She is currently on two active medications in support of her pregnancy:
- Prenatal vitamins with folic acid 800 mcg orally once daily
- Ferrous sulfate (iron supplement) 27 mg orally once daily
An obstetric ultrasound (anatomy scan) has been ordered as part of routine prenatal care.
Overall, Ms. Johnson is progressing through an uncomplicated second pregnancy at 24 weeks gestation, with appropriate prenatal supplementation, reassuring laboratory findings, and routine imaging ordered. Her prior history of gestational diabetes is being monitored, with current glucose screening within normal limits.
Comparison6 issues
Hallucinated:
- age changed from 32 to 31
- added detail that gestational diabetes resolved postpartum not stated in original
- specified glucose tolerance test as 1hour postdose glucose not stated in original
- iron supplement specified as ferrous sulfate which was not stated in original
- changed the iron supplement from a nonspecific iron supplement 27mg daily to ferrous sulfate 27 mg orally once daily adding a specific formulation not present in the original
- changed the ultrasound status from next ultrasound scheduled for anatomy scan to obstetric ultrasound anatomy scan has been ordered
Reconstructed text
Sarah Johnson is a female patient currently with a confirmed active uncomplicated pregnancy. Documentation notes that she is G2P1 and at 24 weeks’ gestation. The pregnancy is described as uncomplicated, with a note stating: “G2P1 at 24 weeks gestation with uncomplicated pregnancy.” She also has a confirmed resolved history of gestational diabetes in a previous pregnancy, documented as personal history of gestational diabetes, with a note indicating that gestational diabetes occurred during the prior pregnancy.
Recent observations show a final gestational age of 24 weeks and gravida/parity recorded as G2P1. Laboratory results include a glucose tolerance test that was normal, with normal interpretation. Blood type and Rh testing show O positive, with ABO group O and Rh positive. Rubella immune status is documented as immune.
Active medication orders include prenatal vitamins with folic acid, with instructions to take prenatal vitamins with folic acid 800 mcg by mouth daily, and an iron supplement, with instructions to take iron supplement 27 mg by mouth daily. Both medications are ordered for oral administration once daily.
There is an active service request for an obstetric ultrasound, documented as an anatomy scan ultrasound, related to the current pregnancy. The note states that the next ultrasound is scheduled for an anatomy scan. A corresponding appointment is booked for an obstetric ultrasound anatomy scan, with the description “Next ultrasound scheduled for anatomy scan.” The patient is listed as a participant and has accepted the appointment.
Comparison7 issues
Missing information:
- patient age of 32 years old
- 32yearold age
Hallucinated:
- patient has accepted the appointment for the ultrasound not stated in original
- prenatal vitamins with folic acid were specified as by mouthoral administration the original only states 800 mcg daily and does not provide a route
- added schedulingadministrative details not in the original an active service request for obstetric ultrasound a booked appointment and that the patient accepted the appointment
- medication route by mouth oral administration added
- details about the appointment stating patient is listed as a participant and has accepted the appointment added
Reconstructed text
Clinical Narrative for Sarah Johnson
Sarah Johnson is a 32-year-old married female (DOB: 05/15/1991, SSN: 123-45-6789) currently at 24 weeks gestation in her second pregnancy (G2P1). Her pregnancy has been uncomplicated to date, with an estimated due date of December 15, 2023. She has a history of gestational diabetes in her first pregnancy (2020), which resolved postpartum.
Laboratory and Diagnostic Findings:
- Blood type: O-positive (confirmed 08/15/2023)
- Rubella immunity: Positive (immune, confirmed 09/01/2023)
- Hemoglobin A1c: Normal (tested 10/10/2023)
Current Medications:
- Prenatal vitamins with folic acid 800mcg – One tablet orally daily (prescribed 05/15/2023 by Dr. Smith)
- Iron supplement 27mg – One tablet orally daily (prescribed 05/15/2023 by Dr. Smith)
Upcoming Care:
- A fetal anatomy ultrasound is scheduled for November 1, 2023, at 9:00 AM at the Women’s Imaging Center, Room 101, ordered by Dr. Smith for routine fetal anomaly screening.
This patient is being monitored for a healthy pregnancy progression with appropriate prenatal supplementation and scheduled diagnostic imaging. No active complications are noted at this time.
Comparison27 issues
Missing information:
- current glucose tolerance test is normal replaced with hemoglobin a1c
- normal glucose tolerance test
Hallucinated:
- marital status married added with no basis in the original
- estimated due date of december 15 2023 fabricated
- ssn 123456789 fabricated
- normal glucose tolerance test changed to hemoglobin a1c
- blood type confirmation date 08152023 fabricated
- prescription date 05152023 fabricated for both medications
- ultrasound location womens imaging center room 101 fabricated
- date of birth 05151991 fabricated
- year 2020 for previous gestational diabetes fabricated
- detail that gestational diabetes resolved postpartum fabricated
- hemoglobin a1c test date 10102023 fabricated
- prescriber dr smith fabricated
- ultrasound time 900 am fabricated
- dob 05151991 and ssn 123456789 were added and not present in the original
- history of gestational diabetes was expanded to first pregnancy 2020 and resolved postpartum the original only stated gestational diabetes in the previous pregnancy
- hemoglobin a1c reported as normal on 10102023 was added and changes the original finding which was a normal glucose tolerance test
- blood type confirmation date 08152023 and rubella immunity confirmation date 09012023 were added and not present in the original
- medication prescribing details prescribed 05152023 by dr smith for both prenatal vitamins and iron were fabricated the original only listed the medications and daily doses
- specific ultrasound appointment details november 1 2023 at 900 am at the womens imaging center room 101 ordered by dr smith for routine fetal anomaly screening were fabricated the original only said the next ultrasound was scheduled for anatomy scan
- dob 05151991 added
- year 2020 and resolved postpartum added to gestational diabetes history
- confirmation date 09012023 added to rubella immunity
- route one tablet orally added to both medications
- ultrasound datetime november 1 2023 at 900 am added
- ordering provider dr smith added to ultrasound
Cross LLM Tests
Reconstructed text
Clinical Narrative:
Sarah Johnson is a female patient born in 1994, currently presenting for the supervision of a normal, uncomplicated pregnancy in her second trimester. She is at 24 weeks gestation with an obstetric history noted as G2P1 (Gravida 2, Para 1). She has a resolved personal history of gestational diabetes from a previous pregnancy, though her recent glucose tolerance test results are normal.
Laboratory findings indicate that her blood type is O positive and she is immune to Rubella. To support her pregnancy, she has active orders for prenatal vitamins with folic acid (800 mcg taken daily) and an iron supplement (27 mg taken daily). Furthermore, a service request was placed for an obstetric anatomy ultrasound, and an appointment for this anatomy scan has been successfully booked.
Comparison4 issues
Missing information:
- age explicitly stated as 32 years old
- patient age 32 years
Hallucinated:
- birth year 1994 added not present in original
- birth year 1994 was added the original only states that she is 32 years old and does not provide a birth year
Reconstructed text
Clinical Narrative for Sarah Johnson
Sarah Johnson is a 32-year-old gravida 2, para 1 (G2P1) female currently at 24 weeks' gestation with an uncomplicated pregnancy. She has a history of gestational diabetes mellitus in a previous pregnancy, which has since resolved. Her current glucose tolerance test results are normal.
Obstetric and Medical Details:
- Blood type: O positive
- Rubella immunity status: Immune (IgG positive)
- Prenatal care: Currently prescribed prenatal vitamins with 800mcg folic acid daily and iron supplement 27mg daily
Upcoming Diagnostic Testing:
- A fetal anatomy ultrasound has been ordered.
This pregnancy is being monitored closely given her history of gestational diabetes, though current glucose tolerance remains within normal limits. No additional complications are documented at this time.
Comparison5 issues
Hallucinated:
- added which has since resolved regarding gestational diabetes history not stated in the original
- added igg positive as specification for rubella immunity not stated in the original
- rubella immunity was expanded to igg positive the original only states rubella immune without specifying igg testing
- the ultrasound plan was changed from next ultrasound scheduled for anatomy scan to fetal anatomy ultrasound has been ordered altering the status from scheduled to merely ordered
- added igg positive to rubella immunity status
Reconstructed text
Sarah Johnson is a female patient born in 1993 who is currently pregnant. Her active, confirmed encounter diagnosis is a normal, uncomplicated second pregnancy in the second trimester, documented as G2P1 at 24 weeks’ gestation. Final obstetric observations confirm a gestational age of 24 weeks, gravidity of 2, and parity of 1.
Her problem list also notes a confirmed history of gestational diabetes mellitus in a previous pregnancy; this condition is documented as resolved, with a note stating that the gestational diabetes occurred during the prior pregnancy and resolved postpartum. A glucose tolerance test/fasting glucose assessment is reported as normal.
Additional prenatal laboratory findings show blood type O positive and rubella immunity. Current active medications include prenatal vitamins with folic acid 800 mcg by mouth once daily and an iron supplement (ferrous sulfate) 27 mg by mouth once daily.
An active service request has been placed for an obstetric ultrasound anatomy scan (fetal anatomy ultrasound) for the indication of normal pregnancy at 24 weeks’ gestation. The order note states that the anatomy scan ultrasound is scheduled as part of routine prenatal care.
Comparison11 issues
Missing information:
- age explicitly stated as 32 years old
Hallucinated:
- iron supplement specified as ferrous sulfate original does not specify the formulation
- detail that gestational diabetes resolved postpartum is fabricated original only states a history of gestational diabetes in her previous pregnancy
- order note stating anatomy scan is scheduled as part of routine prenatal care is fabricated original only states next ultrasound scheduled for anatomy scan
- added fasting glucose assessment as normal the original only reports a normal current glucose tolerance test
- birth year 1993 fabricated original only states age 32
- specific birth year 1993 was added the original only states that she is 32 years old
- birth year 1993 added
- note stating the gestational diabetes resolved postpartum added
- medication route by mouth added for both supplements
- iron supplement specifically identified as ferrous sulfate
Reconstructed text
Sarah Johnson is a 32-year-old female (date of birth: May 15, 1991) currently at 24 weeks gestation as of October 15, 2023. This is her second pregnancy with one prior delivery (G2P1). The current pregnancy is documented as uncomplicated.
Past Obstetric History: Ms. Johnson has a confirmed history of gestational diabetes mellitus during her previous pregnancy, with onset in May 2020 and resolution by September 2020. This condition is currently inactive.
Prenatal Laboratory Results: A glucose tolerance test performed on October 10, 2023, returned normal results. Her blood type is O positive, determined on May 15, 2023. Rubella immunity testing, also performed on May 15, 2023, confirmed that she is immune.
Current Medications: Ms. Johnson is on two active medications, both ordered by Dr. Smith on May 15, 2023:
- Prenatal multivitamin with folic acid 800 mcg — one tablet by mouth daily.
- Iron supplement 27 mg — one tablet by mouth daily.
Upcoming Appointment: A routine anatomy scan ultrasound has been ordered by Dr. Smith and is scheduled for October 22, 2023, from 10:00 AM to 10:30 AM. The appointment is booked and confirmed, with the procedure to be performed by an ultrasound technician. The indication is a routine anatomy scan at 24–28 weeks gestation.
Comparison18 issues
Hallucinated:
- gestational diabetes onset date of may 2020 and resolution date of september 2020 fabricated
- date of birth may 15 1991 added
- current date of october 15 2023 added
- blood type determination date of may 15 2023 fabricated
- anatomy scan indication specified as 2428 weeks gestation fabricated
- the anatomy scan ultrasound was given a specific scheduled date and time october 22 2023 from 1000 am to 1030 am which is not in the original
- glucose tolerance test date of october 10 2023 fabricated
- ordering physician dr smith fabricated
- ultrasound appointment time of 1000 am to 1030 am fabricated
- ultrasound to be performed by an ultrasound technician fabricated
- appointment status described as booked and confirmed fabricated
- date of birth may 15 1991 was added original scenario does not provide a birth date
- statement that she is 24 weeks gestation as of october 15 2023 adds a specific date not present in the original
- blood type o positive was assigned a determination date may 15 2023 not present in the original
- medication orders were attributed to dr smith and dated may 15 2023 the original does not mention any ordering clinician or order date
- additional appointment details were fabricated ordered by dr smith booked and confirmed to be performed by an ultrasound technician and indication at 2428 weeks gestation
- rubella immunity testing date of may 15 2023 added
- prescribing provider dr smith and medication order date of may 15 2023 added