A good read on AI by Will Falk

[Alies Maybee]

Will Falk's new piece on AI: A Complement, Not a Substitute: Generative AI’s role in Canadian Healthcare in 2026
https://www.csagroup.org/article/public-policy/a-complement-not-a-substitute-generative-ais-role-in-canadian-healthcare-in-2026/

What do you think?

[Chris Johnston]

@Alies-Maybee

While I don't argue with the headline message, I have many concerns about the detailed content. But the one that really jumps off the page is the exercise on page 43. Asking people to submit the PDF framework to an AI with their questions is an exercise in skewing the field. The more times a single document is uploaded by different users (different IP addresses essentially), the greater weight it will carry, until it assumes massive influence. Asking people to add their professional bios adds even more weight, since essentially it will be be construed as promoting and endorsing the content without them realizing it. Whether this is an intentional act or not, it undermines the author's credibility: If he's aware of the implications, he shouldn't suggest it, if he's not aware of it, how well does he really understand AI?

I'm more than a little shocked by the CSA's involvement - although their disclaimer seeks to distance themselves a little from the author, but they should know better.

[Alies Maybee]

@Chris-Johnston interesting. Will is considered something of an expert in this area and is closely associated (on the board) of AMS. Many listen to and pay attention to him.

[Debra Turnbull]

@Alies-Maybee

It was a long read... need time to digest.

But then, this summary showed up:
Gen AI already a major Component of Care Delivery

[Chris Johnston]

@Alies-Maybee

That makes it even more concerning

[Debra Turnbull]

@Chris-Johnston @Alies-Maybee
I don't have a problem with complementary GenAI. This is the human-in-the-loop version.

For me, substitutive GenAI is a NO GO. This is the autonomous or Agentic AI. We have a rather famous privacy breach case here in Ontario - you can read the OIPC's response . You may need to download the PDF.

@Robert-Wells BTW Rob, this was a case of "Otter. AI"... system run amock...!

After 3 days in an AI in Med 2026, Krakow, Poland conference, there are valid economic reasons for deploying AI. The doctor shortages are real here in Canada and in the EU. This will not get better.

We need to protect our clinicians - by giving them the tools they need to make their jobs easier. If that means relieving some of their cognitive load, by reclaiming some admin time (transcription to EMR) - so be it.

AI Scribes are flawed - they make errors - we know this. So put the human in there to make the corrections when they happen.

[Kim Locke]

@Debra-Turnbull What happened to transcription processes with humans?

[Debra Turnbull]

@Kim-Locke
Do you mean this guy:

Or are you referring to present day?
Current processes in the healthcare sphere, involve the clinician reviewing the transcript - prior to copy-&-paste text into the EMR (electronic medical record). This is in healthcare and not in commercial businesses.

In the case of the doctor in Ontario that had the OtterAI product; linked into his email list - and didn't think about what would happen when he left the hospital - the system did what it was designed to do - automatically distribute the transcript to all parties. Major privacy breach. (There were also major hospital process that were not followed after the physician's departure.) Hence, why "new" proposals insist on disabling automated processes, placing human oversight in the process, and especially before the notes are copied into the EMR. (There are further nightmare stories when patients try to correct erroneous information in their patient record but that discussion is for another time.)

Bottom line - there needs to be a human "reviewer" in the process.
Second point - the "automated" aspect of the AI Scribe can not be present in the software. Get rid of substitutive AI Scribes; chose only complementary Scribes.

[Kim Locke]

@Debra-Turnbull Hmmm....I was thinking more along the lines of the medical professional literally saying his notes into a Dictaphone, and then someone (a student?) transcribing what he has said.