Round Details
February 15, 2026 at 12:00 PM UTC
Scenario: Asthma - Albuterol + Montelukast
Emily Chen, 28-year-old female, has mild intermittent asthma since childhood. She uses Albuterol 90mcg inhaler, 2 puffs as needed for shortness of breath, typically 2-3 times per week. She also takes Montelukast 10mg daily for maintenance. Her last pulmonary function test showed FEV1 of 92% predicted. No known drug allergies.
How did the LLMs do?
Same LLM Tests
Reconstructed text
Emily Chen is a 28-year-old female with a confirmed diagnosis of mild intermittent asthma, with onset in childhood. She has no known drug allergies.
Her current medication regimen for asthma management includes two active prescriptions: albuterol 90 mcg/actuation metered dose inhaler, 2 puffs as needed for shortness of breath (typically used 2–3 times per week), and montelukast 10 mg oral tablet taken once daily for maintenance therapy.
Pulmonary function testing has been completed with final results available. Her FEV1 measured at 92% of predicted, which was interpreted as within normal limits.
Comparison4 issues
Hallucinated:
- fev1 interpretation within normal limits was added but not stated in the original
- montelukast specified as an oral tablet dosagefrequency given in original but formulationroute not specified
- pulmonary function testing described as completed with final results available original only states the last pft showed fev1 92 predicted without noting status of final results
- specified albuterol as a metered dose inhaler original only stated inhaler
Reconstructed text
Emily Chen is a female born in 1997. Her allergy record is active and confirmed, documenting no known drug allergies.
She has an active, confirmed problem-list diagnosis of asthma, described as mild intermittent in severity, with onset since childhood.
For symptom relief, she has an active medication order for albuterol 90 mcg/actuation metered-dose inhaler: inhale 2 puffs by inhalation as needed for shortness of breath/dyspnea, typically 2–3 times per week (dose: 2 puffs per use). For asthma maintenance, she also has an active medication order for montelukast 10 mg oral tablet: take 10 mg by mouth once daily.
A pulmonary function test observation (final) documents FEV1 % predicted = 92%. No appointments or scheduling details are included in the provided records.
Comparison5 issues
Missing information:
- patient age explicitly stated as 28 years old
Hallucinated:
- birth year 1997 fabricated original only states age 28
- year of birth added as 1997 not provided in the original scenario and not necessarily consistent with age 28
- birth year born in 1997 added
- specific medication form oral tablet added for montelukast
Reconstructed text
Emily Chen is a 28-year-old female with a confirmed diagnosis of mild intermittent asthma, which has been active since the age of 5. Her current medication regimen includes albuterol 90mcg inhaler, to be used as 2 puffs via inhalation as needed for shortness of breath, and montelukast 10mg oral tablet, taken daily. A recent pulmonary function test conducted on February 15, 2024, showed normal results, with an FEV1/FVC ratio of 92%. Emily has no known drug allergies.
Comparison7 issues
Missing information:
- albuterol usage frequency of typically 23 times per week
- pulmonary function test result specifically reported as fev1 of 92 predicted not just a general normal result
Hallucinated:
- pulmonary function test date of february 15 2024 fabricated original only states last pft
- fev1 of 92 predicted changed to fev1fvc ratio of 92 which is a different measurement
- onset specified as since the age of 5 when original states since childhood without a specific age
- asthma onset specified as age 5 instead of childhood
- montelukast form specified as oral tablet which was not in the original
Reconstructed text
Emily Chen is a 28-year-old female (born 1996) with no known drug allergies. She has an active diagnosis of mild intermittent asthma. A recent exam recorded her FEV1/FEV1 predicted at 92%. To manage her condition, she is currently prescribed an Albuterol 0.09 mg/actuation inhaler, with instructions to take 2 puffs as needed for shortness of breath (typically 2-3 times per week), as well as Montelukast 10 mg oral tablets to be taken as 10mg daily.
Comparison9 issues
Missing information:
- asthma onset described as since childhood
- montelukast described as being for maintenance
- asthma history noted as being present since childhood
- pulmonary function test explicitly described as the last pulmonary function test
- specific mention of pulmonary function test replaced with recent exam
Hallucinated:
- birth year 1996 added not present in original
- montelukast formulation specified as oral tablets not stated in original
- fev1 result phrased as fev1fev1 predicted at 92 original states fev1 was 92 predicted
- timingsource of spirometry changed to a recent exam original specifies last pulmonary function test
Cross LLM Tests
Reconstructed text
Emily Chen, a 28-year-old female, has a confirmed diagnosis of mild intermittent asthma since childhood, which is currently active. Her pulmonary function tests show a FEV1 of 92% predicted, indicating well-controlled asthma. She has no known drug allergies. For her asthma management, Emily has been prescribed two medications. The first is an albuterol 90mcg inhaler, to be used as needed at a dose of 2 puffs for shortness of breath, typically required 2-3 times per week. The second medication is montelukast 10mg, which she takes daily as a maintenance therapy. These medications are both currently active prescriptions.
Comparison4 issues
Hallucinated:
- states asthma diagnosis is confirmed original only states she has mild intermittent asthma since childhood without saying it was confirmed
- adds that asthma is currently active not stated in the original
- interprets fev1 92 predicted as indicating wellcontrolled asthma control status not stated in the original
- states both albuterol and montelukast are currently active prescriptions original says she usestakes them but does not specify prescription status or that they are active
Reconstructed text
Emily Chen is a female patient born in 1997 who has no known drug allergies. She has an active, confirmed diagnosis of mild intermittent asthma, which she has had since childhood. A recent observation shows her FEV1 is at 92% of predicted value. To manage her condition, she has two active medication orders: montelukast 10 mg taken orally once daily for asthma maintenance, and an albuterol 90 mcg inhaler with instructions to inhale 2 puffs as needed for shortness of breath (typically used 2 to 3 times per week).
Comparison8 issues
Missing information:
- fev1 result was specifically from a pulmonary function test reconstruction only says recent observation
- patient age explicitly stated as 28yearold
- age 28
- pulmonary function test
Hallucinated:
- birth year 1997 fabricated original only states age 28
- birth year added as 1997 original scenario does not provide date of birthbirth year
- birth year 1997 added
- oral route added for montelukast
Reconstructed text
Emily Chen is a female patient born in 1997. She has a confirmed, active diagnosis of mild intermittent asthma (uncomplicated) (SNOMED CT 427679007; ICD-10-CM J45.20), listed as a problem-list item with onset in childhood. Her allergy record indicates no known drug allergies, documented as active and confirmed (“No known drug allergies”).
For asthma management, she has two active medication orders. She is prescribed albuterol 0.09 mg/actuation metered dose inhaler (albuterol 90 mcg inhaler) with instructions to take 2 puffs as needed for shortness of breath, typically 2–3 times per week; the dose is 2 puffs per use and the administration is documented as inhalation (route text “Inhalation” is present, though the coded route is “Oral route”). She is also prescribed montelukast 10 mg oral tablet for maintenance with directions 10 mg by mouth once daily.
Pulmonary function testing was completed with a final report categorized under pulmonary function (“Pulmonary Function Test” / “Measurement of respiratory function”). The conclusion states FEV1 92% predicted, interpreted as within normal limits. A corresponding final observation documents FEV1 measured/predicted = 92%, with interpretation Normal / within normal limits. No appointments or scheduling details are included in the provided records.
Comparison13 issues
Missing information:
- patient age explicitly stated as 28yearold
Hallucinated:
- pft interpretation within normal limits normal within normal limits fabricated original only states fev1 of 92 predicted without an interpretation
- birth year 1997 fabricated original only states age 28 without a specific birth year
- asthma described as uncomplicated not stated in original
- birth year added as 1997 not stated in original and may not match a 28yearold depending on the current date
- added codingclassification details not in the original eg snomed ct 427679007 icd10cm j4520 uncomplicated activeconfirmed status
- added medicationorder metadata not in the original including a documented route discrepancy coded route is oral route despite inhalation
- added claims about recordreport status eg pft categorized as final report and final observation not present in the original
- statement that no appointments or scheduling details are included in the provided records not addressed in the original scenario
- birth year 1997 added
- asthma described as uncomplicated with specific snomed and icd10 codes added
- montelukast route specified as oral tablet and by mouth not in original
- fev1 test interpretation added as within normal limits normal
Reconstructed text
Emily Chen is a 29-year-old female with no known drug allergies. She has a confirmed diagnosis of mild intermittent asthma, with onset at age 5. Her most recent pulmonary function test, performed on January 15, 2023, showed an FEV1/FVC ratio of 92%, which was interpreted as normal.
Her current active medications include albuterol 90 mcg inhaler, 2 puffs as needed for shortness of breath via inhalation (maximum 2 puffs per day), and montelukast 10 mg taken orally once daily.
Comparison13 issues
Missing information:
- albuterol usage frequency of typically 23 times per week
- montelukast described as being for maintenance
- pulmonary function result specifically reported as fev1 of 92 predicted not fev1fvc
Hallucinated:
- age changed from 28 to 29
- asthma onset specified as age 5 original only states since childhood
- pulmonary function test date of january 15 2023 fabricated
- fev1 of 92 predicted changed to fev1fvc ratio of 92
- maximum 2 puffs per day restriction fabricated not stated in original
- interpreted as normal added for pft result
- pulmonary function metric changedfabricated reported as fev1fvc ratio of 92 instead of fev1 92 predicted
- added interpretation that the pft was normal not stated in original
- pulmonary function test interpretation interpreted as normal added
- albuterol instruction maximum 2 puffs per day added