AI chatbot takes the first pass at urgent primary care histories

A text-based conversational AI system interviewed patients before urgent primary care visits at Beth Israel Deaconess Medical Center, and every completed exchange was monitored in real time by a board-certified internist. In 98 completed conversations, no safety-stop intervention was needed. The study, published in The Lancet, tested whether a chatbot could gather a usable history ahead of the clinician encounter without creating immediate safety problems.

The system, called Articulate Medical Intelligence Explorer, was built with Google researchers and used by patients from home before their appointment. In practical terms, the model was asked to do one of the most time-consuming jobs in ambulatory care: collect symptoms, organize the story, and surface concerns before the physician walks into the room. When that process works, the visit can start with more structure and less repetition. When it fails, the risks are obvious — missed red flags, misleading summaries, or a false sense of completeness.

Here, the supervision model mattered. A board-certified internist observed every exchange as it happened, creating a safety net that would not exist in routine practice. That design makes the findings reassuring for feasibility, but it also places clear limits on how far the results can be stretched. The system was not left alone with patients, and the study was not built to determine whether this approach improves diagnosis, treatment, or outcomes.

One sentence captures the central result: no completed conversation triggered a safety stop.

Hallucination, clarification, and the limits of transcript quality

Supervising physicians identified one hallucination and added clinical clarification in five cases. Those events are small in number, but they are the details clinicians care about most, because even a rare fabrication can distort triage or downstream decision-making if it reaches a chart unchallenged. In AI terms, a hallucination is not a cosmetic error; it is a potential clinical hazard if the output is taken at face value.

The transcript did not simply function as a passive record. In 44 visits where physicians reviewed the AI transcript or summary before seeing the patient, they said it helped them prepare 75% of the time. That is a substantial signal for workflow utility, especially in urgent care where the first minute of the encounter often determines the rest of the visit. A well-structured intake can help clinicians anticipate medication issues, refine the differential diagnosis, and avoid wasting visit time reconstructing the story.

Still, a preparatory tool is not the same as a diagnostic engine. The study measured feasibility, not accuracy in the sense that matters most to patients: whether the AI changes treatment plans, shortens time to diagnosis, reduces errors, or improves symptom control. A transcript that is useful to a physician can still be incomplete, biased by prompt structure, or too polished for the messy realities of ambulatory medicine. In a busy primary care setting, that difference will determine whether the tool becomes a true extension of the clinical team or just another layer of documentation.

Patient trust, confidentiality concerns, and the work ahead

Patients voiced concerns about confidentiality and the chatbot’s trustworthiness. Those concerns are not peripheral; they go straight to adoption. A conversational system in medicine does not just need technical performance, it needs credibility. If patients worry that a machine is storing sensitive details unsafely or misinterpreting their words, the interview may become guarded, incomplete, or selectively honest, which defeats the purpose of the encounter.

That tension is especially important in primary care, where the history often contains the most diagnostically valuable material. Symptoms evolve over days, medication adherence is imperfect, social stressors shape presentation, and patients rarely present with a neat problem list. A well-designed AI intake could help organize that complexity, but only if patients feel comfortable speaking freely and clinicians trust the summary enough to use it.

The study also leaves open a major operational question: what happens when the supervising physician is no longer watching every exchange? Real-world deployment will depend on how safely the system can function with less direct oversight, how reliably it flags uncertainty, and how clearly it separates patient statements from machine interpretation. It will also depend on whether the transcript can be integrated into workflow without forcing clinicians to verify every line from scratch.

For now, the evidence supports a narrower conclusion. A conversational AI interviewer can complete previsit history-taking in urgent primary care, avoid immediate safety-stop events in a monitored feasibility study, and sometimes help physicians prepare for the encounter. The next step is not a broader claim about better outcomes. It is a tougher test: whether the same tool can be trusted in routine practice, with real-time ambiguity, less supervision, and the full clinical consequences of an imperfect interview.


Reporting by Dr. Sarah Lin, MD, MPH for Medicine World Foundation, with additional data provided by Medical Economics.