📞

AI Telephone

LLM Interoperability Demo

← Back to home

Round Details

March 9, 2026 at 12:00 AM UTC

Scenario: Hypertension - Lisinopril

Maria Garcia, a 62-year-old female, presents with essential hypertension diagnosed 3 years ago. She is currently on Lisinopril 10mg once daily in the morning. Her blood pressure today is 138/85 mmHg. She reports occasional mild cough but otherwise tolerates the medication well. She is allergic to Penicillin.

How did the LLMs do?

Same LLM Tests

ClaudeClaude

Reconstructed text

Maria Garcia is a 62-year-old female with a confirmed, active diagnosis of essential hypertension, with onset documented in 2022. She has a confirmed active medication allergy to penicillin.

For management of her hypertension, she is currently prescribed Lisinopril 10 mg oral tablet, taken once daily in the morning by mouth. Her most recent blood pressure reading, obtained on July 11, 2025, was 138/85 mmHg, indicating her blood pressure remains mildly elevated above target despite current therapy.

Notably, an adverse event has been recorded in association with her Lisinopril use: she has been experiencing an occasional mild cough, a recognized side effect of ACE inhibitor therapy. The event is categorized as an actual occurrence and graded as mild in severity.

Comparison5 issues

Missing information:

  • patient otherwise tolerates the medication well aside from the cough

Hallucinated:

  • specific blood pressure reading date of july 11 2025 fabricated original only states today
  • specific onset year of 2022 fabricated original states diagnosed 3 years ago without specifying a calendar year
  • added assessment that blood pressure remains mildly elevated above target despite current therapy which is not stated in the original
  • specific onset year of 2022 added for essential hypertension
GeminiGemini

Reconstructed text

Maria Garcia is a 62-year-old female with an active allergy to penicillin. She has a history of essential hypertension, with an onset in 2021, and is currently experiencing a mild cough. For her hypertension, she has an active prescription for Lisinopril 10 MG oral tablets, with instructions to take 10mg once daily in the morning. A recent vital signs observation on May 15, 2024, recorded her blood pressure at 138/85 mmHg.

Comparison5 issues

Missing information:

  • patient otherwise tolerates the medication well
  • cough described as occasional in the original

Hallucinated:

  • specific date of may 15 2024 for vital signs observation fabricated original only states today
  • specific onset year 2021 fabricated original states diagnosed 3 years ago
  • mild cough changed from occasional mild cough to currently experiencing a mild cough
ChatGPTChatGPT

Reconstructed text

Maria Garcia is a female patient with a confirmed, active medication allergy to penicillin; the allergy criticality is documented as unable to assess. Her active, confirmed problem list includes essential hypertension (ICD-10 I10), documented with an onset date of 2023. A clinical note states that she was diagnosed 3 years ago. She has an active medication order for lisinopril 10 mg oral tablet for treatment of hypertension, prescribed as 10 mg by mouth once daily in the morning via the oral route. A medication note indicates that the patient reports occasional mild cough but otherwise tolerates the medication well. Most recent documented vital signs include a final blood pressure reading on 2026-03-09 of 138/85 mmHg.

Comparison7 issues

Missing information:

  • patient age of 62 years old

Hallucinated:

  • specific blood pressure date of 20260309 added original only states today
  • allergy criticality documented as unable to assess added not in original
  • icd10 code i10 added not in original
  • essential hypertension was given an onset date of 2023 the original only says it was diagnosed 3 years ago
  • icd10 code i10 for essential hypertension was added but not present in the original
  • specific onset date of 2023 added
MistralMistral

Reconstructed text

Clinical Narrative for Maria Garcia

Maria Garcia, a 62-year-old female (DOB: May 15, 1961), with medical record number MRN12345678, presented for an ambulatory follow-up visit on May 15, 2023, from 09:00 to 10:00, for management of essential hypertension (ICD-10: I10, SNOMED-CT: 38341003), first diagnosed on May 15, 2019. She has a confirmed high-risk allergy to penicillin (Penicillin V), documented since 1990, with a history of anaphylactic reaction.

During the encounter, her blood pressure was measured at 138/85 mmHg. She reported an occasional mild cough, noted on examination. Her current medication regimen includes lisinopril 10 mg orally once daily in the morning, prescribed on May 15, 2019 (Prescription ID: Prescription12345), which remains active.

No additional acute concerns or changes to her treatment plan were documented in this visit. The encounter was conducted by her primary provider.

Comparison24 issues

Missing information:

  • patient otherwise tolerates the medication well
  • original states she otherwise tolerates lisinopril well this is not stated in the reconstruction
  • diagnosis timeframe of 3 years ago

Hallucinated:

  • ambulatory followup visit date of may 15 2023 fabricated
  • prescription id prescription12345 fabricated
  • date of birth may 15 1961 fabricated
  • medical record number mrn12345678 fabricated
  • visit time 0900 to 1000 fabricated
  • penicillin allergy specified as penicillin v original only states penicillin
  • allergy documented since 1990 fabricated
  • history of anaphylactic reaction fabricated original does not specify reaction type
  • date of birth added as may 15 1961 no dob was provided in the original scenario
  • essential hypertension coded as icd10 i10 and snomedct 38341003 no billingcoding data was provided in the original scenario
  • hypertension diagnosis date changed to may 15 2019 which conflicts with the original statement that it was diagnosed 3 years ago
  • penicillin allergy was expanded to confirmed highrisk allergy to penicillin penicillin v the original only states allergy to penicillin without specifying penicillin v or risk level
  • history of anaphylactic reaction to penicillin was added the original only states she is allergic to penicillin
  • statement that the cough was noted on examination changes the original detail that she reported an occasional mild cough
  • statement that the encounter was conducted by her primary provider was added no provider details were given in the original scenario
  • dob may 15 1961 added
  • mrn12345678 added
  • icd10 and snomedct codes added i10 38341003
  • specific diagnosis date of may 15 2019 added
  • allergy specifics added highrisk penicillin v documented since 1990 history of anaphylactic reaction
  • encounter conducted by her primary provider added

Cross LLM Tests

ChatGPTGemini

Reconstructed text

Maria Garcia, a female born in 1964, has a confirmed, active allergy to penicillin. She has a confirmed diagnosis of essential hypertension, which was initially diagnosed three years ago. Her most recent vital signs show a blood pressure reading of 138/85 mmHg.

To manage her hypertension, she has an active prescription for lisinopril 10 mg oral tablets, with instructions to take 10 mg by mouth once daily in the morning. Clinical notes and observations indicate that she reports experiencing an occasional mild cough, but she otherwise tolerates the medication well.

Comparison5 issues

Missing information:

  • patient age of 62 years

Hallucinated:

  • birth year stated as 1964 but original states age 62 which would correspond to birth year approximately 1961 or 1962 not 1964
  • birth year 1964 added original only states that the patient is 62 years old
  • birth year 1964 added
  • medication form oral tablets and route by mouth added
GeminiMistral

Reconstructed text

Clinical Summary for Maria Garcia

Maria Garcia is a 62-year-old female with a documented penicillin V allergy. She has an active diagnosis of essential hypertension, for which she is prescribed lisinopril 10mg orally once daily in the morning. Her most recent blood pressure measurement was 138/85 mmHg. Additionally, she presents with a mild, active cough.

This summary captures her current active conditions, medication regimen, vital signs, and allergy status.

Comparison7 issues

Missing information:

  • hypertension was diagnosed 3 years ago
  • cough was described as occasional
  • patient otherwise tolerates the medication well

Hallucinated:

  • allergy specified as penicillin v instead of general penicillin
  • cough characterized as active rather than occasional
  • allergy changed from penicillin to penicillin v
  • lisinopril route specified as orally not explicitly stated in original
ClaudeChatGPT

Reconstructed text

Maria Garcia is a female patient born in 1963. She has an active, confirmed encounter diagnosis of essential hypertension (ICD-10 I10; SNOMED CT 59621000), with onset documented in 2022. She also has an active, confirmed medication allergy to penicillin, categorized as a medication allergy, with criticality unable to assess. For treatment of her hypertension, she has an active medication order for lisinopril 10 mg oral tablet, prescribed as 10 mg by mouth once daily in the morning. On 2025-01-24, her vital signs included a blood pressure of 138/85 mmHg. On the same date, an exam observation documented occasional mild cough; the patient reported that this was likely an ACE inhibitor-related side effect, and a note states it was mild and occasional and may represent an adverse effect of lisinopril. Otherwise, she was noted to be tolerating the medication well.

Comparison11 issues

Hallucinated:

  • patient reportedly stating the cough was likely an ace inhibitorrelated side effect is fabricated the original only states she reports occasional mild cough
  • note that cough may represent an adverse effect of lisinopril is fabricated the original does not attribute the cough to the medication
  • birth year 1963 is fabricated and not present in the original original states age 62 which in january 2025 would more likely correspond to birth year 1962
  • specific encounter date of 20250124 is fabricated and not in the original
  • specific birth year 1963 was added the original only states that she is 62 years old
  • specific date 20250124 was added for the blood pressure and cough observations the original only says today and gives no calendar date
  • birth year 1963 added
  • icd10 and snomed ct codes for hypertension added
  • allergy criticality unable to assess added
  • specific date 20250124 added
  • patient reporting that cough was likely an ace inhibitorrelated side effect added
MistralClaude

Reconstructed text

Maria Garcia is a 63-year-old female (date of birth: May 15, 1961). She has a confirmed, active high-criticality medication allergy to Penicillin V, with a documented manifestation of allergic reaction.

Ms. Garcia carries an active, confirmed diagnosis of essential hypertension (ICD-10: I10), with an onset date of May 15, 2019, recorded in her problem list on May 15, 2023.

She is currently prescribed Lisinopril 10 mg oral tablet, ordered on May 15, 2020, to be taken 10 mg once daily in the morning by oral route. Per her medication statement, she has been taking Lisinopril continuously since May 2020 and tolerates the medication well, with only an occasional mild cough noted as a side effect.

During her most recent visit on May 15, 2023, vital signs obtained at 10:30 AM revealed a blood pressure of 138/85 mmHg, which remains mildly elevated. A clinical exam finding at the same visit documented a mild cough, which appears consistent with the known occasional cough associated with her ACE inhibitor therapy.

Comparison17 issues

Hallucinated:

  • age changed from 62 to 63
  • icd10 code i10 added not in original
  • date of birth may 15 1961 fabricated
  • penicillin allergy changed to penicillin v
  • allergy manifestation described as allergic reaction not in original
  • highcriticality designation for allergy fabricated
  • problem list recorded date of may 15 2023 fabricated
  • medication statement of continuous use since may 2020 fabricated
  • vital signs time of 1030 am fabricated
  • date of birth may 15 1961 was added and is not in the original scenario
  • allergy details highcriticality active confirmed and documented manifestation of allergic reaction were added and are not in the original scenario
  • hypertension diagnosis timing was changed from diagnosed 3 years ago to an onset date of may 15 2019
  • statement that she has been taking lisinopril continuously since may 2020 was added and is not in the original scenario
  • mild cough was documented as a clinical exam finding at the visit whereas the original only states that she reports occasional mild cough
  • allergy specified as penicillin v instead of penicillin and described as highcriticality
  • specific onset date may 15 2019 and recorded date may 15 2023 added for hypertension
  • specific orderstart date may 15 2020 added for lisinopril