📞

AI Telephone

LLM Interoperability Demo

← Back to home

Round Details

February 15, 2026 at 12:00 PM UTC

Scenario: Dental Extraction - Post-Op Care

Robert Williams, a 58-year-old male, had surgical extraction of impacted lower right wisdom tooth (#32) two days ago due to recurrent pericoronitis. He was prescribed Amoxicillin 500mg three times daily for 7 days to prevent infection, and Ibuprofen 600mg every 6 hours as needed for pain. He reports moderate swelling on the right side of his jaw and pain level of 5/10, improving from yesterday. No signs of dry socket or infection. He is allergic to Penicillin, so was given Clindamycin 300mg three times daily instead of Amoxicillin. Follow-up appointment scheduled in 5 days for suture removal.

How did the LLMs do?

Same LLM Tests

ChatGPT→ChatGPT

Reconstructed text

Robert Williams is a male born in 1968. He has a confirmed, active medication allergy to penicillin.

On 2026-03-07, he was documented to have recurrent pericoronitis (confirmed; currently marked inactive) and underwent a completed surgical extraction of an impacted lower right wisdom tooth (#32) (surgical removal of impacted tooth) on 2026-03-07, with the procedure performed at tooth #32 (lower right third molar/wisdom tooth). The extraction was performed for the indication of the pericoronitis.

Post-procedure medications ordered on 2026-03-07 included:

  • Amoxicillin 500 mg oral capsules, intended dosing 500 mg by mouth three times daily for 7 days, was cancelled due to the patient’s penicillin allergy; the record notes that clindamycin was prescribed instead.
  • Clindamycin 300 mg oral capsules (active order), indicated for post-extraction infection prophylaxis in the setting of penicillin allergy, with dosing 300 mg by mouth three times daily for 7 days.
  • Ibuprofen 600 mg oral tablets (active order), dosed 600 mg by mouth every 6 hours as needed for pain.

On 2026-03-09, follow-up clinical observations documented a pain score of 5/10, with a note that pain was improving compared with yesterday, and moderate swelling of the right jaw/extraction area (tooth #32). Two postoperative complications were specifically assessed and refuted (recorded as inactive with refuted verification status): alveolar osteitis (dry socket) with note “No signs of dry socket,” and postoperative infection with note “No clinical signs of infection noted.”

A follow-up visit for suture removal was ordered (ServiceRequest active) for 2026-03-14 due to the recent extraction, and a corresponding appointment is booked for 2026-03-14 for suture removal after extraction of tooth #32, with the patient listed as an accepted participant.

Comparison9 issues

Hallucinated:

  • clindamycin duration specified as 7 days but the original does not explicitly state a duration for clindamycin
  • specific dates 20260307 for procedure 20260309 for followup observation 20260314 for suture removal are fabricated the original uses only relative timing two days ago 5 days
  • birth year 1968 fabricated original only states age 58
  • patient date of birthyear added as 1968 original only states he is 58 years old no dob provided
  • pericoronitis status described as currently marked inactive inactive original does not describe the conditions activeinactive status
  • administrativeverification metadata added eg servicerequest active appointment booked patient accepted participant complications recorded as inactive with refuted verification status that are not present in the original scenario
  • birth year 1968 added
  • specific dates 20260307 20260309 20260314 added
  • clindamycin duration for 7 days added original only stated three times daily
Mistral→Mistral

Reconstructed text

Robert Williams, a 58-year-old male, has a documented allergy to penicillin. He presented with swelling of the jaw and underwent a surgical extraction of an impacted lower right wisdom tooth (#32) on March 15, 2023, due to recurrent pericoronitis. Post-operatively, Mr. Williams was prescribed clindamycin 300mg to be taken orally three times daily for 7 days and ibuprofen 600mg to be taken orally every 6 hours as needed for pain. On March 17, 2023, his pain level was recorded as 5 out of 10. A follow-up appointment for suture removal has been scheduled for March 22, 2023.

Comparison12 issues

Missing information:

  • pain is described as improving from yesterday
  • swelling described as moderate specifically on the right side of the jaw
  • no signs of dry socket or infection noted
  • initial mention of amoxicillin 500mg three times daily prescription before correction to clindamycin
  • statement that there are no signs of dry socket
  • initial prescription of amoxicillin 500mg three times daily for 7 days and that clindamycin was given instead of amoxicillin due to penicillin allergy
  • extraction occurred two days ago relative timing explicitly stated in the original

Hallucinated:

  • specific followup visit date of march 17 2023 fabricated
  • jaw swelling presented as a preoperative complaint presented with swelling of the jaw and underwent when the original describes it as a postoperative finding reported two days after surgery
  • specific procedure date added extraction on march 15 2023 not present in original
  • specific surgical date of march 15 2023 fabricated original only states two days ago
  • stating the patient presented with swelling of the jaw prior to the procedure original states swelling is a current postoperative symptom
Claude→Claude

Reconstructed text

Robert Williams is a 58-year-old male with a confirmed active allergy to Penicillin (criticality unable to assess).

Mr. Williams presented with a history of recurrent pericoronitis and a confirmed impacted lower right wisdom tooth (tooth #32, mandibular right third molar). The pericoronitis has since resolved. On January 25, 2025, he underwent a completed surgical extraction of the completely bony impacted lower right wisdom tooth, performed due to both the recurrent pericoronitis and the impaction.

Following the procedure, he was prescribed two medications on January 25, 2025: clindamycin 300 mg oral capsule, to be taken three times daily for 7 days as post-surgical antibiotic prophylaxis (notably prescribed in place of amoxicillin due to his Penicillin allergy), and ibuprofen 600 mg oral tablet, to be taken every 6 hours as needed for pain.

A post-operative follow-up visit was conducted on January 27, 2025 (ambulatory encounter, now completed). During this visit, examination findings included a pain severity rating of 5 out of 10 on a verbal numeric rating scale, noted to be moderate and improving from the prior day. Assessment of the surgical site revealed moderate swelling on the right side of the jaw, with no signs of dry socket or infection.

A follow-up appointment for suture removal has been booked for February 1, 2025, from 9:00 AM to 9:30 AM. A corresponding service request for suture removal is active and scheduled for that date.

Comparison13 issues

Missing information:

  • original amoxicillin order details are not fully captured amoxicillin 500 mg three times daily for 7 days the reconstruction only notes clindamycin was prescribed in place of amoxicillin without the original amoxicillin dosefrequency
  • timing statement from the original is not stated explicitly extraction occurred two days ago the reconstruction replaces this with specific calendar dates

Hallucinated:

  • pericoronitis described as has since resolved which is not stated in the original
  • specific surgical date of january 25 2025 fabricated
  • specific appointment time of 900 am to 930 am fabricated
  • impaction type specified as completely bony impacted when original only states impacted
  • impaction added as a separate reason for extraction original only cites recurrent pericoronitis
  • specific dates added that are not present in the original extraction dated january 25 2025 postop followup dated january 27 2025
  • added characterization of the impaction not in the original completely bony impacted lower right third molar
  • added rationale beyond the original wording extraction performed due to both the recurrent pericoronitis and the impaction original states extraction was due to recurrent pericoronitis
  • added appointment details not in the original suture removal booked for february 1 2025 from 900 am to 930 am and an active service request for suture removal
  • added allergy metadata not in the original penicillin allergy confirmed active with criticality unable to assess
  • impaction specified as completely bony
Gemini→Gemini

Reconstructed text

Robert Williams is a male patient born in 1965 who has a confirmed active allergy to penicillin. He presented with active swelling of the jaw and reported a pain severity score of 5 out of 10.

On October 10, 2023, he successfully underwent the surgical removal of an impacted lower right third molar tooth due to pericoronitis. For bacterial infection prophylaxis, he was prescribed Clindamycin 300 mg oral capsules, with instructions to take 300 mg three times daily for 7 days. He was also prescribed Ibuprofen 600 mg oral tablets to be taken every 6 hours as needed for pain management.

A follow-up appointment has been booked for October 17, 2023, for suture removal.

Comparison17 issues

Missing information:

  • swelling was described as moderate and specifically on the right side of the jaw
  • pain was noted as improving from yesterday
  • no signs of dry socket or infection were explicitly documented
  • surgery was noted as occurring two days ago timing relative to current presentation
  • tooth number 32 was specified in the original
  • initial prescription of amoxicillin 500mg three times daily was mentioned before being corrected due to penicillin allergy
  • patient age 58 years old
  • tooth number specified as impacted lower right wisdom tooth 32
  • extraction was performed due to recurrent pericoronitis recurrent not mentioned
  • original plan included amoxicillin 500 mg tid x7 days but was changed due to penicillin allergy the initial amoxicillin order and substitution context are not included
  • tooth 32 specification
  • pericoronitis was noted as recurrent

Hallucinated:

  • birth year 1965 was fabricated original only states age 58
  • surgery date of october 10 2023 was fabricated no specific date in original
  • clindamycin formulation specified as oral capsules was not in the original
  • specific procedure date added october 10 2023 though the original only states two days ago
  • birth year of 1965 was added

Cross LLM Tests

ChatGPT→Gemini

Reconstructed text

Robert Williams, a male born January 1, 1968, has a confirmed, high-criticality allergy to penicillin. On March 7, 2026, he was diagnosed with recurrent pericoronitis in the lower right third molar area. The condition was resolved that same day following a surgical extraction of his impacted lower right wisdom tooth (tooth #32).

For postoperative care, an initial order of amoxicillin 500 mg by mouth three times daily for 7 days was stopped due to his penicillin allergy. Instead, he was prescribed clindamycin 300 mg by mouth three times daily for 7 days to prevent infection, as well as ibuprofen 600 mg by mouth every 6 hours as needed for pain.

During a 2-day postoperative evaluation on March 9, 2026, Mr. Williams reported a pain score of 5 out of 10, noting that his pain was improving from the previous day. A clinical examination noted moderate swelling on the right side of his jaw, but there were no signs of a dry socket or infection. Mr. Williams has a booked follow-up appointment scheduled for March 14, 2026, for postoperative suture removal.

Comparison9 issues

Hallucinated:

  • birth date of january 1 1968 is fabricated original only states age 58
  • specific dates march 7 2026 for surgery march 9 2026 for evaluation march 14 2026 for followup are fabricated
  • statement added that the condition was resolved that same day after extraction not stated in original
  • penicillin allergy described as confirmed highcriticality original does not characterize the allergy with these qualifiers
  • allergy severityconfirmation added confirmed highcriticality allergy to penicillin original only states allergic to penicillin no severitycriticality
  • specific dates added for events march 7 2026 diagnosisextraction date march 9 2026 2day postoperative evaluation date and march 14 2026 followup date original provides only relative timing extraction 2 days ago followup in 5 days
  • clindamycin duration specified as for 7 days original states amoxicillin was for 7 days but does not explicitly state the duration for clindamycin
  • birth date of january 1 1968 was added
  • allergy severity of highcriticality was added
Mistral→Claude

Reconstructed text

Robert Williams is a male patient born in 1965 (approximately 58 years old). He has a documented active allergy to penicillin.

On November 10, 2023, Mr. Williams underwent a completed surgical extraction of an impacted lower right wisdom tooth (tooth #32, mandibular right third molar) due to recurrent pericoronitis. Following the procedure, he presented with moderate swelling of the right side of the jaw, which remains an active condition. A pain severity assessment conducted on November 12, 2023, recorded a score of 5 out of 10.

Given his penicillin allergy, Mr. Williams was prescribed clindamycin 300 mg orally three times daily for 7 days as antibiotic coverage. He was also prescribed ibuprofen 600 mg orally every 6 hours as needed for pain management.

A follow-up appointment for suture removal is booked on November 15, 2023, with a scheduled duration of 30 minutes.

Comparison11 issues

Missing information:

  • pain noted as improving from yesterday
  • no signs of dry socket or infection
  • initial prescription of amoxicillin 500mg three times daily for 7 days which was then replaced due to allergy
  • original plan initially included amoxicillin 500 mg three times daily for 7 days before being changed to clindamycin due to penicillin allergy

Hallucinated:

  • birth year 1965 fabricated not in original
  • scheduled followup duration of 30 minutes fabricated
  • procedure date added as november 10 2023
  • specific dates november 10 2023 for surgery and november 12 2023 for pain assessment fabricated
  • followup date of november 15 2023 fabricated and inconsistent with stated 5 days from current visit which by the reconstructed timeline would be november 17
  • followup appointment date added as november 15 2023 original only states followup in 5 days not a specific calendar date
  • swelling described as remains an active condition original only reports moderate swelling does not state it is ongoingactive in those terms
Gemini→Mistral

Reconstructed text

Robert Williams, a 58-year-old male, has a documented penicillin allergy. He recently underwent a surgical extraction of his lower right third molar tooth on October 22, 2023, due to pericoronitis, which has since resolved. Post-procedure, Mr. Williams was prescribed clindamycin 300mg three times daily for 7 days as a prophylactic measure against infection, and ibuprofen 600mg every 6 hours as needed for pain management. He currently experiences swelling on the right side of his jaw and reports a pain severity level of 5 on a 0-10 verbal numeric rating scale. A follow-up appointment has been scheduled for October 29, 2023, at 10:00 AM for suture removal.

Comparison16 issues

Missing information:

  • tooth was described as impacted
  • pain reported as improving from yesterday
  • no signs of dry socket or infection noted
  • tooth number 32 not specified
  • pericoronitis described as recurrent in the original
  • procedure was stated as two days ago rather than a specific date
  • extraction occurred two days ago timing relative to today
  • indication was recurrent pericoronitis recurrent nature not mentioned
  • painswelling are improving compared with yesterday
  • explicit statement that there are no signs of dry socket
  • originally prescribed amoxicillin 500 mg three times daily for 7 days but changed to clindamycin due to penicillin allergy initial amoxicillin order and the substitution process not described

Hallucinated:

  • specific procedure date of october 22 2023 was fabricated
  • followup appointment date of october 29 2023 at 1000 am was fabricated original states 5 days and october 29 is 7 days after october 22
  • statement that pericoronitis has since resolved
  • pericoronitis described as has since resolved not stated in the original
  • specific followup date and time october 29 2023 at 1000 am added
Claude→ChatGPT

Reconstructed text

Robert Williams is a male born in 1967. He has a confirmed, active, high‑criticality medication allergy to penicillin (documented as “Penicillin” / “Allergy to penicillin”).

He was diagnosed with recurrent pericoronitis of the lower right wisdom tooth (#32) (SNOMED: Pericoronitis; ICD‑10‑CM: K05.20 “Aggressive periodontitis, unspecified”), which is documented as confirmed and resolved, and also has a confirmed, active impacted lower right third molar/wisdom tooth (#32) (SNOMED: Impacted third molar tooth; ICD‑10‑CM: K01.1). The affected site is consistently noted as the lower right third molar.

On 2025-01-20, he underwent a completed surgical extraction of tooth: surgical extraction of the impacted lower right wisdom tooth (#32) (SNOMED: 69514004; CPT/Dental code: D7240 Removal of impacted tooth—completely bony). The procedure was performed due to recurrent pericoronitis and the impacted lower right wisdom tooth, involved the lower right third molar site, and the documented outcome was successful.

Post-procedure medications ordered on 2025-01-20 include:

  • Clindamycin 300 mg oral capsule, 300 mg by mouth three times daily for 7 days (total dispense 21 capsules, 0 refills, expected supply 7 days). A note specifies this was prescribed instead of amoxicillin due to the penicillin allergy. The reason for this prescription is the surgical extraction of the impacted wisdom tooth.
  • Ibuprofen 600 mg oral tablet, 600 mg by mouth every 6 hours as needed for pain (oral route). The reason for this prescription is also the surgical extraction of the impacted wisdom tooth.

Follow-up observations on 2025-01-22 document postoperative status:

  • Pain severity score: 5/10, noted as moderate pain and improving from yesterday.
  • Swelling: moderate swelling of the right side of the jaw, with a note stating no signs of dry socket or infection.

A follow-up appointment is booked for suture removal related to the surgical extraction, scheduled for 2025-01-27 from 09:00 to 09:30 (UTC). Robert Williams is listed as a participant and has accepted the appointment.

Comparison29 issues

Missing information:

  • patients age explicitly stated as 58 years old
  • amoxicillin order details from the original amoxicillin 500 mg three times daily for 7 days are not stated in the reconstruction it only notes clindamycin was prescribed instead of amoxicillin
  • original indication for antibiotic specifically stated as to prevent infection is not explicitly included in the reconstruction
  • original planned amoxicillin dosage of 500mg

Hallucinated:

  • dispense quantity of 21 capsules and 0 refills for clindamycin fabricated
  • birth year 1967 fabricated original only states age 58
  • specific surgery date of 20250120 fabricated original only says two days ago
  • specific followup observation date of 20250122 fabricated
  • d7240 removal of impacted toothcompletely bony classification fabricated original does not specify the impaction was completely bony
  • procedure outcome described as successful not stated in original
  • patient accepted the followup appointment fabricated
  • icd10cm code k0520 aggressive periodontitis unspecified for pericoronitis is fabricated and clinically inaccurate pericoronitis is not aggressive periodontitis
  • birth year born in 1967 is added the original only states the patient is 58 years old no dobyear provided
  • specific dates are fabricatedadded procedure date 20250120 followup observations dated 20250122 and appointment scheduled for 20250127 09000930 utc the original provides only relative timing extraction two days ago followup in 5 days and no timestime zone
  • allergy is characterized as confirmed active highcriticalityseveritycriticality and confirmation status are not stated in the original only allergic to penicillin
  • diagnosis coding is incorrectfabricated icd10cm k0520 aggressive periodontitis unspecified is assigned for pericoronitis this codediagnosis is not in the original and does not match the described condition
  • problem status is fabricatedchanged recurrent pericoronitis is documented as confirmed and resolved in the reconstruction the original does not state it is resolved
  • procedure codingdetails are added snomed 69514004 and dental code d7240 removal of impacted toothcompletely bony are not provided in the original and completely bony impaction is not stated
  • procedure outcome successful is added the original does not explicitly document procedural outcome beyond postoperative assessment no dry socketinfection
  • medication dispensing details are fabricatedadded for clindamycin 21 capsules 0 refills expected supply 7 days and specific dosage form oral capsule the original does not include dispense quantityrefillsform
  • appointment workflow details are fabricatedadded that the patient is listed as a participant and has accepted the appointment is not stated in the original
  • birth year 1967 added
  • allergy severity marked as highcriticality
  • pericoronitis status marked as resolved
  • snomed icd10 k0520 k011 and cptdental d7240 codes added
  • description of impacted tooth as completely bony
  • specific dates added 20250120 20250122 20250127
  • documented outcome as successful
  • specific time for followup appointment 0900 to 0930 utc