¶ Intro / Opening
Behind the Knife, the Surgery Podcast. Relevant and engaging content designed to help you. Thank you all for your continued listening of Behind the Knife. While many long term listeners of BTK have used our podcast and resources while in medical school, we now provide resources tailored to medical student general surgery curriculum. Over the past ten years of of BTK and in our day jobs, we have dialed in the specifics of what medical students need to dominate their surgery rotation.
It contains about everything you need to include review text, video, audio segments, pictures, reviewing over about seventeen disciplines that you will encounter during your time on service. Enjoy the series and dominate the day.
¶ Welcome and AI for Surgeons Introduction
Welcome back to Behind the Knife. I'm Iman Oli, a PGY4 and Behind the Knife fellow here at Dude. Last month, Stanford's Institute for Economic Policy Research released a working paper that showed approximately 76 to 176% efficiency gains in productivity for home tasks by adopters of large language models. There's a lot to say about this, but for busy clinicians, every second that we can get back in our personal lives is cherished. So how can we start?
Well today, Dr. Patrick George, co-director of Behind the Knife and Trauma Medical Director at Duke, and myself are excited to talk to an early adopter and truly an AI power user, Dr. Christian Paon. Dr. Payan is an orthopedic trauma surgeon at Duke. faculty member at the Duke Margolis Institute for Health Policy and founder of Revel AI Health, a company that targets many of the tasks that directly lead to physician burnout. And he's also the author of sub of the substack, The Techie Surgeon.
Yes. I'm excited about this one. So the pace of AI development is dizzy, right? Every single week there's a breathless new proclamation about what AI can do. And it's really exciting, but it's also extraordinarily overwhelming, especially if you happen to be a busy surgeon. You feel like you're getting left behind, you can't keep up. And in some ways, it's at odds with what we do as surgeons. We strive to be very thoughtful.
Very meticulous, very sick. Let me do the same thing over and over again because we know it's gonna work for our patients. Meanwhile, AI is kicking down the door and daring you to go faster. and faster and to do more. I saw a meme the other day of the uh back in the day, Kristen might appreciate this, the Kool-Aid guy where he, oh yeah, kicks down the door. And that was AI kicking down the door. You can't hardly keep up. And so we thought it'd be a good idea.
to do a a very practical episode in which we focus on AI tools that you can and really should be using today. So we've got Christian, as Iman mentioned, an AI super user. He really is a super user to enlighten us. So Christian, we want to pick your brain. and talk about some of the basics and how listeners can get into the world of AI.
¶ Shifting AI Mental Models for Surgeons
I've heard you talk about the mental model surgeons use to approach AI and you encourage them to blow it up by thinking about using AI as an operating system for your information life. So what do you mean by that? First off, I'm super excited to be on on this. I mean I think Behind the Knife is doing amazing things and I really appreciate what you all do and love the show, love all of the continue education.
¶ AI as a Thought Partner for Knowledge Work
My personal perspective is that not just surgeons, but people in general have thought of these large language models and as gen of generative AI as a search engine. I think that that is the wrong way to think about these models. And I know we're going to jump into all of the different use cases. You really need to think of these large language models as almost thought partners and infrastructure, in my opinion, for anything that has to do with knowledge work.
I like to say that as humans, we kind of really only do two things. We transfer and exchange information and we manipulate and mold matter. And the transfer and exchange of information, these models are so, so good at it. So that's what I mean when I say we need a different mental model. We really need to this is not Google on steroids. This is a system that if you implement the right way, can help you augment so much of the knowledge work that you do.
Yeah, I think that the search engine analogy is unfortunate, but I think that the reason it gets made is because there's nothing else that has changed the way we interact with the world. as much as the search engine, right? Like you think about what has what has really changed human use of information gathering or anything else. And you have the search engine and now you have large language models, but they're fundamentally different concepts, but only comparable in their impact. Yeah.
And I think it's funny, um, you know, you mentioned that as surgeons we tend to be very regimented and think about step A, step B, step C and yes, l large language models, JAT GPT, Claw and they're all s stochastic models. So like you get w you put one input, you're gonna get different outputs. And I think that kind of rubs us the wrong way. But that's that's also part of the power of these tools.
And I like to say, if you're a clinician, just just think about a process that you have to execute over and over again that involves the exchange and transfer of information, whether it's writing notes. trying to figure out what the proper billing code is for your operative note. Maybe it's putting together an Excel sheet of information week to week and
Put a list of those processes down on paper if you want, or speak them into a large language model. And I think that you will be just shocked at how good these systems are for those repeatable processes that are related to information transfer and exchange.
Yeah, it's all about kind of getting over that hump, right? It's you know you you have a few good use cases and you're like, oh good lord, this is amazing. And you're off to the laces. We were just talking before we hit record about the fact that we see shockingly few staff for one, but also current residents. So kind of in that this age group we're talking about, using LLM specifically or AI in general on a regular basis. Shockingly few and once you kind of get down to the ranks of
the current medical students and undergrads, there seems to be something about that generation where they're picking up uh using these tools more readily. And so that's especially why I think it's important to for this episode to happen today and and for folks to get involved because
¶ Choosing and Using Frontier LLMs
The power of these tools are are are just amazing. And so up front are these frontier LLMs, right? The original. groundbreaking large language models. The three main ones that we all talk about are Claude, Gemini, Chat, BT GPT. These are the workhorses of the AI world. And Is as recently as one to two years ago, these were just more of a large language model, more along this line of uh uh more analogous to this Google search, and they do so much more now.
So Christian, how should folks decide which large language model or which ones to use if you're going to use multiple? And are there any specific hacks for these models that you like to share?
¶ Expert's Personal AI Tool Stack
Yeah. These models they differ in what they're best for. I think that the same way that you use a bovicottery in s one case, maybe me a a mallet in another. And then a ten blade in for another part of a case. I think that it's important to try to use these models for what they're best at. I have my own stack and I rely heavily on Claude Cowork personally.
And I would encourage the users to, in in my opinion, use use that as your entry, if you will, and your initial kind of large language model thought partner. It's very good at writing, it's very good at a variety of different outputs, whether it's an HTML. So and when I say HTML, it's like a little website that creates visuals for you. It's excellent at that. It's very good at repeatable structure through what's called skills.
And it ends up being the workhorse of my personal AI stack. So let's say I want every email that comes in from my research student to get. scanned and then to extract the the word document that was attached and then to have it waiting for me in a readable document, uh highlighting all the the prime points and taking the perspective of a peer reviewer, I use Claude for that.
I think that there are other tools that are better at visuals. So if you go on my newsletter, I have this thing, I call them visual prompts. I make prompts in Claude in order to express myself visually through a slide deck or maybe an image, a data visualization. And then I actually will take the prompt. that I've made in Claude and usually go into Gemini or their image creation tool called VO3.
And that's a fantastic tool to make really compelling images. They can actually come pretty close in some cases to drawing some of the anatomy, if you will, on an image. And it's fantastic for that. I've stopped using ChatGPT personally. And look, I was a mega user. I received a notification from them that I was in the top, I think, 0.75% of users. Impressive. Not nothing wrong with it, but I just ended up transitioning over personally to to Claude.
So that's those that's my stack. I will also say I use open evidence for clinical use cases around medical answering as well as Doc Summit GPT, but open evidence tends to be my go-to. Um And then and then the other tool that I've I've used is just the ones that are embedded within my in my electronic health record system. And that's an ambient scribe. But in this case it's a bridge, but we've other sites are using Rebel AIs. Describe.
¶ Overcoming AI Overwhelm and Verification
Right. And so what about when folks say, well, I, you know, I I only have so much time. I'm going to jump in them with Gemini, right? And I'm going to learn the interface, learn what kind of tools it offers. And then two weeks later, Chat GPT drops. the next biggest thing. And this is a horse race, right? Each these these three these three companies are massive. They've done incredible things.
And every week and every month it's a little bit different. Do you have any recommendations for jumping around between models? Again, especially when something right now, uh, this is April twenty twenty six, Claude Claude in general has has a lead for some good reasons we'll talk about. But Any recommendations for that? Because it can again be overwhelmed to say the worst, you know, I need to be using something different.
It can be so overwhelming. And what I would say is you can it's very easy with these tools. to to just get analysis paralysis. And I've seen actually from some of my Substack readers, I see them following along, following along, trying, they're downloading all these skills files, right? These workflows.
You just have to use and it's okay if it's chat GPT, by the way. You just have to use one of these tools and integrate it into your workflow. And I think that that will go a long way. I personally would start with Cloud Cowork because it is very f is a very friendly user interface. It can manipulate files on your desktop.
And for repeatable knowledge work that we're doing as clinicians, I think it's going to be the most powerful platform to just introduce yourself to the world of large language models. I will say though, I personally, I jump all the time between Claude and Gemini or VO3 because I'm going from written input to visual in visual output. And there's nothing wrong with that. You don't want 10 tools.
But two to three or four is is really powerful. And um just find your workflow for those repeatable tasks. stick to it and just keep iterating. Like just think about the use case. I w I want to put together a morbidity mortality conference, de-identified, and I need to put this case study together.
You're gonna I'm gonna take the evidence from open evidence on that topic. I'm gonna package it and copy paste it into Claude Cowork and have a file ready for me that's got my Duke branding. You know, like just think of the the end product, the input. And then try to let these large language models arrange things for you. And then I say, you know, never trust, always verify.
Your domain expertise is actually really powerful here. And you know the right question to ask. You still need to be willing to spend the time to come up with the workflow and check the final product. But be before we go any further, I mean this this is all great. I think that people would really like to hear some specifics on how you use these tools practically. So you mentioned, for example, building a case for MM, or you mentioned reading through one of your research students' email.
But and you know, this is a question for both UN and Dr. Georgeov, but what what are some good other examples that people can start with maybe today or tomorrow? Um, just to just to dip their toes in the water. Patrick, you got something? I got you know.
¶ Practical AI for Trauma Registry Analysis
I got something because I was literally just working on it right before we we came in for the show today. So as trauma medical director at Duke, we're interested in looking at our trauma triage guidelines. And so we have three years worth of data
Over 12,000 patients that come from a trauma registry. And that's a painstakingly entered data. This is a manual process. And Before, if I wanted to thoroughly analyze that using different triage guidelines, different triage guidelines or resource based tools that show you whether you're overactivating, underactivating, somewhere in between, that would take literally an expert in in statistics.
and likely weeks of of work. And then when you want to iterate on a little farther, you go back to the drawing board, wait a couple more weeks and back forth. It it's extremely labor intensive. Instead, I'm using actually a combination of Claude and Gemini. And I've got this data set and just
constantly iterating from it saying, okay, tell me last year's uh breakdown my level one, twos and threes. How am I over under triage according to this criteria? How about this criteria? Okay, where am I falling out? How are we under triaging here? Which mechanism of injury is it? And it is remarkable because all I'm doing is is typing or even now speaking questions to the computer.
It goes and does its thing and it's it's kind of gotten ridiculous to the point now where I'll have Claude doing some heavy duty work and in between then I'll be on the fast version of Gemini cross-referencing some topics to as I wait to kind of fill myself in on that next paper, the next thing that I need to that I'm about to ask. And so that that that's an example of a workflow that I mean, even six months ago.
No, or a year ago, I should say. Couldn't have done it. Could not do it. And the beautiful part about it is it too is it spits out these PowerPoint. slides. I say make me a slide, write me a brief executive summary. So when I go back to my colleagues in this very multi-institution or multi-I should say specialty practice of trauma surgery, that we have some really great deliverables to share and say, hey, look at all this work.
And this is me some some data Luddite working on this stuff. I think it's it it it still actually blows my mind that this it is possible and so powerful. Kristen, I know you have you have endless Plenty. But I will I will try to be like basic if not basic. I'll try to be practical, right? A lot of us are trying to keep up with the Literature.
¶ Automating Literature and Resident Coaching
One really cool thing about Cloud Cowork is this thing called schedule tasks. And it does have what's called again, and don't worry about some of this terminology, but it has an MCP, basically a connection to PubMed.
So one thing that I've done is, hey, I need to stay up to date on orthopedic trauma literature. And actually I'll tell you like we could even create this now live. I use um a dictation tool, Whisper Flow, and I speak instead of typing where I can. I was like, Every week I want to be updated on the Journal of Orthopedic Traumas latest
and most relevant topics for an orthopedic trauma surgeon. And I want to receive an email with links to those PubMed links for that journal. I'm an orthopedic trauma surgeon, about five years into practice. So Yeah. try to format the email to me in a format that's going I'm going to be able to scan really quickly and that is relevant to my practice and also make for me an HTML that I can interact with and has some of those key points from those articles.
You hear the little bleep. That's the dictation. I don't type because it lets me iterate faster. And actually Claude Cowork, I'm in it now. I'm going to send that and it's going to make a schedule task for. So it's thinking, it's putting it together, and it's asking me, okay, what day of the week do you want this to happen? I'm going to say every Wednesday at 7 a.m. Now every Wednesday at 7 a.m., I'm going to receive in my email inbox.
Uh, and in my Claude Cowork instance, the latest and greatest in orthopedic trauma. And I can augment my knowledge that way. I'm not doing it manually. So that's one use case. I think another great use case to think about, you know, if we're really thinking about clinicians and residents, I use it as a coaching tool. So you talk about like stringing together things.
I I use granola. That's a that's a meetings application. And again, I use it because it's very simple, but it also pulls information into Claude through MCP. I might say, hey, you know, junior resident who just came out of my service, is it okay if I record our conversation? I just want to do some some targeted feedback.
Together. Let's let's talk about the cases we've gone over this this week. And I'll turn my granola on. I'll have the recording of the transcript. I'll give my feedback. I'll say, Great, hey, like, you know, I'm gonna get back to you with. some of the feedback here and and we'll do this again in four weeks and and we'll build on this existing conversation we had.
And rather than going and typing because I'm a busy surgeon, I'm gonna forget, right? I'll take that transcript and I have a skill in my claw, but it doesn't matter. You need a skill. You just say, I just had a meeting with my junior resident. I got permission from them.
please outline some of the strengths and weaknesses that we discussed in a way that I can send to them in an email and that I can build on the next time that we meet. And by the way, go through the transcript and give me some feedback. on whether I gave good feedback as a mentor. Did I give enough insight and advice to this student that's going to be relevant for them? And how can I improve on it next time?
So that's like another use case and example of how I'm using these tools to augment my daily interactions, right? And that feels maybe a little out of the box. But again, it's the transfer and exchange of information. It's a task that I'm doing over and over again. And it's one that I'm using a large language model as a thought partner so that I can get better over time. So those are a couple. There's so many more, man. There's so many more.
Let's let's go around the horn again. I I mean, I want to ask you about one or two. I'm gonna share another one or two. Christopher, you get to share another one or two because I do think this is this is
important to hear how people use these tools really opens your mind up. Maybe you might want to use it in the exact same way that, you know, Chris and you just mentioned. Or maybe there's something that's similar to that. You go, wait a minute, I I see the the connection here. Let me try this new process.
Yeah, yeah, I I think something Dr. Pan said earlier, he said, you know, he he he says the word repeatable a lot, right? You you keep saying anything repeatable and that's that's a concept in computer science that goes back decades. It's you know, the something I was taught very early on is if you find yourself writing the same thing twice.
¶ Streamlining Administrative and Personal Life
Can you just write it once? Right. Is that something that you can turn into a function? Is what we would say. And so one practical example that I did just a year ago is I think that these tools are fantastic for administrative tasks. So, one administrative task that we have to do as residents is you need to schedule medical students to different rotations. Now, historically, Sorry, Greatest Wizard.
a massive deal in our program. You know, our residents would be late occasionally in s in slotting out these medical students. We're all busy. That would delay the the program coordinator. That would delay the anesthesia department. That I mean It it was just this huge consequence. And I looked at the problem and I thought, this is such a simple thing to just to just to just write as a function.
So it only took me, you know, a a a very small amount of time, probably less time than just actually scheduling people myself. And I built a website and and I and I just gave it to our program coordinator. And now instead of residents doing it, He does it and uh it takes him one second of just plugging in an Excel sheet and he's done. So, you know, it it this was an administrative task that took residence, you know.
10, 15 hours each every single month, and now it's completely gone and it takes about 15 seconds a month. So I think anytime that you have something administrative and you find yourself doing something like copy pasting or anything like that, these are things that LLMs ex excel at. And they and they excel at transferring knowledge as well. So, you know, if you have a task that's very repeatable, but for some reason someone else just can't do it. And again, scheduling kind of comes down to that.
Well, I mean, most likely an LLM can do it really, really well, right? Those nuances that you think that only you have, it's probably something you can transfer. So that that's something I use it for a lot, of course. I being in computer science, I use it a lot for research, but really it has it has reduced my administrative burden dramatically. And that paper I referenced earlier with 200% efficiency gains and productivity for home tasks.
For me, it's gotta be like 500%. Things that took me six hours now take me one. I mean, even something like editing this podcast in terms of just just making little corrections, you know, maybe we had a blooper or someone's someone's kid came running in the background. Yeah, historically that that would take, you know, 15, 20 minutes to edit. And now it's just a two-second thing with an AI tool. So those are some of the ways I use it. But again, an infinite example.
¶ Advanced AI Projects and Patient Communication
Yeah. And and we at you know, behind the knife making content, we have a a growing tech stack. Tech stack being just the tools that we use to create. And it's multi layered. I think Dr. Pan, you'll give us a an example of a of a fairly simple three step process for a AI grand rounds presentation, which I think is just a really nice example of how you can kind of daisy chain these things together. And
One of the biggest projects we're working on, I'm in and Dr. Swenson at Behind the Knife is the AI Board Simulator. That's a an LLM-based uh project. uh that I think I've learned a ton from Matt Nyman about how these LLMs function because we're trying to, you know, tweak these models. to match what uh the nuance and the detail and the richness of an interaction with a board examiner. And that is certainly much easier a said than done.
But you know, that's would be in an an an advanced level thing. I'm gonna go backwards a little bit farther towards more personal things. I just moved into a new home. And again, when you talk about different models. For this, I use Gemini. Gemini would use fast thinking, etc. So I use the fast function of Gemini on my phone. And I had to fix a whole bunch of different things, do a bunch of different gardening and
It had some tree that was dying to take a picture of it. Why is this dying? Next thing you know, I got the stuff ordered through Amazon and I'm treating it with the the right insect ripel and thing and and lo and behold,
It's a few weeks ago, now the tree looks beautiful. We had to fix the some covers and had us a very specific hinge on it, which I've never seen before. Take a picture of it. This is how you fix it. Step one, step two, step three. So so it doesn't have to be uh the most advanced, you know, the most advanced usage, but this is part of the door that opens once you start using it.
You can also personalize things by creating your own chat functions within ChatGPT, gem to call them gems, et cetera. And certainly within Claude, there's an extensive variety, which we're going to touch on when it comes to creating things like artifacts and projects and skills. But recently I got a pool, which is exciting. I have no clue how to take care of a pool. But now I have within Gemini a gem that says I'm it knows all my pool equipment. It's I I've taken pictures of it.
It knows how many gallons there are. So when I test the chlorine, I just say, hey, my chlorine's this. And it tells you exactly how much to put in it. And I actually compared it to because I I got this pool and I was like, oh my gosh, I'm overwhelmed, downloaded all these different apps. And those apps are are garbage compared to the highly personalized information given through what took me literally, I think, three or four minutes to set up. But
I love that, man. I love I love that actually because of the last thing you said. So this idea of a personalized software that Is serving your needs uniquely. I think that is where a lot of your listeners can leverage these tools to come up with things that. We just, we just would not have ever been able to have come up with on our own. And that honestly, no developer is going to either, because they don't have your lived experience.
or your lens of your unique problems. And so, you know, I think that my advice would honestly be just chat with these tools with some of your common problems and see what comes out of them, be be willing to scrutinize, but then then explore and see if you can get to that repeatable process that's information laden in a way that is more efficient or creative than you would have been able to on your own.
I think these tools are great for Excel sheets, you know, and scheduling, like you mentioned, right? And there's so much administrative work that can be automated. Just another thing, like if you do have something you want to explain to a patient, right? And maybe you're struggling for the words.
to explain to them. I mean, these tools are great for that. I'll do that in open evidence. I'll go in and say, hey, I've got, you know, this issue or complication for a patient. What's a good way to explain it to them? And sometimes I'll take go step further and take that explanation.
put it into Gemini, ask for an image that might help conceptualize it for the patient. And I've used that before and actually it's been it's been pretty great. So just new ways to communicate and conceptualize information. Yeah. None of us are talking about clinical use cases, really, right? And this
¶ Revolutionizing Clinical Notes with Ambient AI
Well we have plenty to plenty to talk about before we get into your AI ground grounds presentation, but when it comes to the clinical use case, it's a few months ago we had an episode on uh ambient scribes, right? And I don't know if there is a more direct way for physicians who spend any time in clinic, but also i it's it's actually quite useful for inpatient encounters too, to save more time.
If I'm gonna we we we have an audience of clinicians, right? Mostly. And if you want to save time, take a half day clinic. I would say if I do a half day clinic. I'm saving about an hour and a half to two hours of time. I'm kind of verbose when I dictate and I dictate my notes and I like to talk a lot and kind of fill it in. And I think as part of this, Kristen, I got to thinking about this when you mentioned how you communicate with patients.
It's also remarkable in as you're talking like to your phone, right, to get your your scribe to create a note that you want. By invert it by in by doing so, you're also talking to the patient in a way that's much more clear and you're you're sharing a lot of information that maybe you would not have shared before.
And I found that those interactions to be better, I can spend more time with patients. And then the notes are better. It says exactly what I told them, right? It it says exactly what they told me. There's no there's no making things up in between. But I think it's an incredible tool. Yeah, I the ambient scrab one is fascinating because I read Dr. Pan's article from January where it's it's it's actually it's and trials have shown this, it's it's actually not even the time that you save.
It's it's the and you actually you should probably explain it since you wrote the article that I read. You know, it's it it it it's not even the time, it's the burnout, right? It's like it's like what is really what is really the thing that burns you out. It's not necessarily looking at the note, it's the process of sitting down, typing out the entire thing. And even if you're not saving time, you're saving your mental load. And I that's just one of the most powerful things you can have.
Totally. Yeah, I was gonna say it's interesting. It f I feel I would inherently say that the ambient scribe saves me hours. Most of the studies are suggesting maybe 20 to 30 minutes, a a marginal increase. Like it's not no me too. Well that's what I was just I I feel like that. I really do it. But and maybe it's not maybe it doesn't matter that it's 20 minutes in aggregate in these studies
instead of an hour and a half, but it the it it has completely changed definitely the way that I, you know, all my notes are done on time and they they didn't always used to be. And I agree with you. I think the other thing is, you know, you're you're mentioning something That maybe a super user is more likely to do. I've heard people complain about the ambient scribe. And I I always tell them, like, well, did you say what you wanted it to do?
Did you before you went into the room give a little bit of context saying I'm gonna go in to see a sixty eight year old female who had a hip fracture two weeks ago? She got these comorbid conditions, then go in and then give a little more context on the way out. I personally read the radiographs, I need the physical exam. to specifically emphasize XYZ. Cause if you don't, then yeah, you know, garbage in, garbage out to some extent. And if you're in the in the room with the patient,
And you, you know, give a very cursory, have a very cursory conversation. That's all the LLM has to go off of. But it sounds like you, Patrick, have honed in on it. And maybe that's why it is saving you and me hours and others, you know, 20 or 30 minutes. The last thing I'll say is like, so that's a skill to learn when you're using these ambient scribe tools is you have the ability to basically talk to the scribe to give it instructions around the note that you're trying to create.
The other thing I'll say is I do think that the technology itself of ambient scribing is getting commoditized, but it is the launch pad, in my opinion, for deeper workflows. Like that's coming, right? Like. Whether it's one of the big systems of record like Epic or some of us that are working in these inner inner integrated verticals of care management with AI.
It's gonna be like scribe informed a chart review that was done by an agent that ended up suggesting an order that did an asynchronous outreach. to close a care gap. I mean like that is where the that's gonna be the launch pad I think for for clinical intelligence. My impression is that I think, as you said, the reason you two are really good at using this tool is because you've used other LLMs.
And the skills you learn when you direct an LLM are very horizontal. They kind of apply to any tool that's built on top of an LLM. So No. The the reason that we, you know, I think that we we're really trying to encourage people to use these to any degree is because as they get deployed, the way to get the most out of them is just to get a feeling for how they work. And you can only do that by interacting with it.
And that goes back to exactly what you said. The more context you give these things, the better they are. The less context you give, the more variable the result and the less reliable the outcome. So I think that's just one big reason to start. Tomorrow. Using the tool. Yeah. Yesterday, right.
¶ Clinician-Led AI Innovation and Policy
But but in we said at the top that Christian has a a substack called Techy Surgeon. It's a fantastic resource to learn how to use AI tools like we're talking about today, but it's also a really fantastic look at the interface between clinicians. AI and the types of tools that we're reviewing, like LLMs, and healthcare policy and the financial aspects of a hospital. And so if you have any interest in that, I highly recommend you check that out.
I appreciate that. Yeah. And and that's the thing about I think technology is that it's intersecting with our patient care delivery and our patient care delivery is extremely impacted by policy. And so I've tried to write about the intersection between the three kind of clinical AI.
care delivery and health policy because they all shape one another. So yeah, please, and by the way, if people do subscribe or check out some of the live sessions, I would love more feedback and insight from people like your your listeners at behind the knife. Because I wanna empower people to use this technology to become more knowledgeable about health policy and shape
the field, their own lives and the lives of their patients. And I I think this is just a great tool to do that. It's not an end all be all, you know, you s you need to scrutinize the output from these tools. But I think that we need more creative clinicians using these tools, figuring out the next big use case. It's not going to be a a techie person. I think it's going to be someone with really unique domain expertise.
and insight to unique problems, those are gonna be the real, I think, transformative applications of this technology. Right. And and we all have domain expertise, right? Whether you're an inquiry medical student, you all have your own lived experiences. You know, you're a a senior surgeon. Uh everyone has true domain expertise. And as surgeons, it's pretty awesome, right?'Cause there's there's not that many people.
who are served as number one. And then if you learn how to interface with this technology, how that becomes such a powerful tool to to leverage that that insider information. that, you know, the next tech startup founder doesn't have'cause they didn't do the surgery residency. They didn't they didn't spend years taking care of patients, you know, in the middle of the night, you know, fixing femurs on on Saturday afternoon, et cetera.
¶ Advanced Features of Claude Co-work
So Christian, let's let's focus on cloud cowork for a minute because that is all the rage right now is something that you like to use and talk about. And I'd like you to explain to us a few of the features. So I think most folks know you you fire up an LLM, you can type it in, you can talk to it, and you can have this ongoing conversation. It can do some really neat things for you. But within
Claude Cowork, you hear people talking about projects for one. Yeah. That you hear them talking about artifacts and skills. Can you explain what each of those are and your step list to term? Absolutely. Yeah. So and Cloud Core work, I think, is really useful for a couple of reasons, just quickly. One, it can actually manipulate your files on your desktop. That's intimidating at first, but it's a mechanism for the large language model to organize information.
And that's where projects come in. Projects are basically folders of information and they allow for you to work in a certain domain or subject and not have to reiterate over and over again to the chat bot what you what it is you're working on. And by doing that, you can have a folder for personal reasons where your workouts are getting downloaded, maybe the chores task list, the pool cleaning instructions for Patrick, and you can work in that domain.
And you've got a folder of research, you've got a folder of your personal ambitions for your career, and you've got your branding guidelines from your academic institution, your CV, and you're working and the LLM begins to know you to some extent. And that's really powerful. The other thing that I think is really powerful about cloud cowork is the ability to run tasks in parallel. So a lot of us are used to like.
Yeah, I'm gonna open up a chat session. I'm gonna work on something and I'm waiting until the chatbot is finished cooking whatever I'm doing, or I'm trying to open up multiple tabs in my browser and trying to work on things, but oftentimes the you know, the chat or the task gets stuck. And Cloud Cowork, you can fluidly
start multiple sessions. So maybe one is writing that prior authorization appeal letter. Another session is editing a research paper. The third session is building a a visualization or artifact. explaining a new research project for you or students. Art so that's really powerful. Artifacts.
That's just the output from the model that lives in a sidebar. And that might be an Excel sheet. It's oftentimes an HTML, which is basically a little web-based widget that gets put out from whatever you have done. I like the HTML output. Because from a workflow perspective, I may say, give me an interactive HTML with prompts embedded in it. And I may take that HTML and then those prompts and do something in another tool like Open Evidence or like Gemini in order. Amplify.
the work that I'm doing. So there's a tons of tons of possibilities. The other thing that's nice about Cloud Cowork is it has these schedule tasks. You heard us talk about them earlier. You can have tasks running at certain times. Let's say every day you want your emails to be sorted. And brought to you in an HTML, prioritized, reminding you which emails you need to get back to, and to have drafts of responses to emails you haven't gotten back to. Cloud Cowork Schedule Tasks can do that.
The last two things that I'll mention is dispatch. Dispatch allows you to use the tool remotely from your cell phone. As long as your computer is on, you can run a complicated task on cloud cowork while you're on the go. And then skills are repeatable flows. So uh you mentioned earlier this scheduling task.
You could have a skill, right? Let's say you worked on this for a long time in a session and you're like, I need an Excel sheet that looks like this. And I I, you know, I need to make sure that I've sorted the PG DY years differently and the services and you like the output. You could say, hey, like I want that to be a skill. From now on, when I say scheduling Excel skill, I want to be able to have a similar output, but it maybe for a different test.
And you can do that. And that skill, the next time that you invoke it or mention it, will be applied to a completely different task but with a similar output. You can do that around your branding and much more. So that's that's hopefully a reasonable. overview. And I know it's a lot in a short amount of time. There's so much good material out there to learn each one of those different little facets of Cloud Cowork and to leverage them for your own workflows.
But that's why I love this tool so much, is it's so versatile in its output and its applicability to different tasks. Yeah, barely scratching the surface, but if you want to get into it, watching I'd probably say two hours maybe to worth of YouTube videos. Um you find the most popular ones with the highest views. You kind of choose a a few kind of what you might like to style up.
I'd say about two hours get you started. And from what Christian you said, the the simplest approach I would say if you have a project, especially as thinking about our listeners and surgeons being folks who you know administrative duties, clinical duties, et cetera. If you have a project you want to start with, I think you can start simple with a folder where you store PDFs and PowerPoints and stuff like that, and where you could.
Talk to it about skills, say, hey, you are the chair of surgery at such and such institution. This project is about optimizing OR rooms. There's these stakeholders that are involved. Okay, you you have this fixed. set of knowledge and task to go with. You have a certain number of PDFs and whatnot that you want to work from. And then within that conversation even alone, you can just start
Iterating. And then you can move on to these next things where you're automating your workflows where, you know, again, it's a kind of a bigger leap to say, well, I'm okay with with connecting different tools. You mentioned NC It's connecting different agents and tools like, okay, I'm okay with this folder being shared with Claude. I'm okay with this Gmail account being shared with Cloud.
etc. And so so that's kind of I think more advanced and next steps. And then culminating in this in the the fact that Christian is an animal and he's got like ten different things happening at once on these scheduled tasks. You know, that that's super, super high level stuff. But if you back it down to just a single project, for example, I think a good one is that uh that trauma optimization thing. That's something anyone uh can do in in in Yeah.
¶ Demystifying Agentic AI and Next Steps
You know, you'll be really pleased with that. So one thing I wanted to have you talk about, Christian, is the word agentic is everywhere. What else? that what does that mean to you in the setting of LOMs and Claude or kind of the future of how you look at this moving from a chat kind of thought to a doing feature of AI? Yeah, I really think of agentic AI as just AI that's moving from chat and surfacing information to doing tasks. You know, I think that this is about
a lot of the things we've already been talking about. This is where you have AI that is actually taking the next few steps. Maybe it is that you have the AI, like we were talking about earlier. Going into your files, pulling out the information, creating an actual Excel sheet and firing off an email. Like those three steps to me make me think of Gen Tik AI. And you know, I try to tell people, don't get too hung up on labels.
Cloud cowork in and of itself inherently is really agentic because it's it it it's executing multiple steps and tasks and it's going beyond that sort of search engine. Mentality to operating system. That's really the way that I think about it. Once you're starting to delegate tasks.
that are multi-step to AI, you've kind of crossed over into the agentic framework, in my opinion. Now, some some s skeptics would say, you know, oh, that's cron jobs and just individual tasks. It's not really agentic. It's not autonomous. But that's the simplest way that I think about it. You know, that uh I don't know if you actually maybe I Eamon, you may have a different a different definition.
I I mean, no, that was great. I mean, I think if you want to go, the most simple way to think about it is like you can treat it like a medical student first, then you can treat it as a resident. And then, you know, one day you can maybe even treat as a co-partner. But I think of it as, you know, maybe you're an attending and you delegate some task.
Maybe you're only comfortable with, okay, go take down the dressing for now, but eventually you'll work your way up to, okay, why don't you go around on the patients and let me know who's sick. Yeah. So that that's kind of how I think of aging, the same way you would think of any sort of any sort of person working up the medical pathway. But but maybe to to wrap up I I want
¶ RevelAi Health and Future of Clinician AI
to ask you about Revel AI. So what is it and why did you start it? What was the inspiration? Yeah, absolutely. Yeah. RevelAI is really an agentic care coordination platform. We've really thought about the different regulatory policies and the common patient-facing tasks. that we face all the time. And we've wrapped AI on top of those interactions to try to improve care coordination. Most of our work is in the musculoskel space.
So we've looked at some of these regulatory workflows like collecting patient report outcome measures or coordinating care for patients before and after surgery. And we're really equipping AI to educate patients with content that we create. Con converse with the patients and collect information from them that also maps to some of these policy regulations. And then automating what
the clinician would be doing. So we've got ambient scribing technology. We have voiceover internet protocols so you can make phone calls yourself or your staff can and documentation automatically happens. But we always wrap it around episode of care management. And what inspired me to start the company, you know, I wasn't honestly out to start a company. I was trying to solve problems.
There were these value-based care models that orthopedic surgeons needed to participate in. We all of a sudden were responsible for optimizing patients preoperatively, trying to contain costs. in the postoperative period. And I saw a huge gap, especially actually for my underserved patients in the communication that we had with them, collecting the information from them. And I said, you know, why don't we have technology that can do some of this?
And it started off as a project. We got selected for a Techstars Accelerator, which came with some funding. Ended up ended up going the venture backed route. raised uh a round of 3.1 million this last year. And now we're getting close to being in almost 20 hospitals and care organizations. We're integrating to Cerner and Athena Health and we're getting into Epic.
It's been a remarkable experience. And also, by the way, one that I would encourage listeners to at least get exposure to. Our platform now is interacted with over 200,000 patients, our agents. have interacted with over 200,000 patients. We're automating a lot of compliance and regulatory workflows for clinicians and hospitals. And that scale has been super gratifying as a clinician. I still operate, do a lot of cases, but we need more.
surgeons and clinicians at the innovators table. I kind of fell into it, but I would do it over and over again if I could go back, even though it's been a roller coaster. So that's that's Revel AI in a nutshell. Would love on another day to give you some examples of some use cases and how we're using agentic AI there. But I'm hopeful that it's just one example of many other clinician founded companies leveraging AI that will spring up in the future.
Nice. Well it's it's a pleasure having you on, Christian. And chatting with you about all this. I hope people got uh something out of this as we kind of blabbered on about different use cases. But again, this is something that is extraordinarily important, obviously excites all of us. Again, check out Christian Substack for more. And until next time, dominate the day.
Be sure to check out our website at www.behindthennife.org. Download our free app available for Apple, iOS, and Android. Simply search for Behind the Knife in the App Store or Google Play to download the app. In the app you can listen to our episodes, watch high-yield videos,
and even access our premium content, including our oral board reviews and trauma video atlas. You can also follow us on Twitter at Behind the Knife and on Instagram at BehindTheKnife Podcast. If you like what you hear, please be sure to leave us a review. We do not diagnose, treat, or offer patients specifically. Vice. We appreciate your support. Until next time.
