Rethinking Visualizations in Plastic Surgery: Open-Source Artificial Intelligence Can Accelerate Cosmetic and Reconstructive Operative Techniques and Reports

Abstract

INTRODUCTION: Artificial intelligence (AI) describes the field of computer learning that relies on extensive data sets and has accelerated in its capabilities through a transition to open source code. We reviewed widely used current AI softwares surrounding smart speech-to-text transcriptions,1 computer-generated images from text,2 and conversational Chat programs,3 to illustrate how open-sourced AI (OpenAI) can be incorporated into the plastic surgeon’s toolkit now, and how it may change the field in the future. METHODS: We trialed the following OpenAI interfaces: (1) Stable Diffusion and (2) DALL-E, both text-to-image applications; (3) Clip, an image-to-text program, and (4) ChatGPT, a conversational Chat AI software. Inputs included operative descriptions from plastic surgeon operative notes, de-identified images from plastic surgery case reports, and verbal descriptions discussing operative techniques. AI-generated outputs were evaluated for accuracy to true anatomy and steps in the surgical procedure. RESULTS: Current OpenAI systems can generate semi-accurate depictions of surgical procedures using phrases from operative reports. Stable Diffusion has the benefit of “image-to-image” mode, in which users can command the program to edit an existing image via a text prompt. This process allows for more accurate image adjusting via iteratively composing an image. To convert intraoperative images and videos into operative notes, we found that CLIP and ChatGPT can generate captions for inputted images.4 However, the program is pre-trained on public image databases which are currently limited in relevant content for surgical purposes. More development is needed before these programs can describe more specialized images. With a broader training database, OpenAI can be expanded to caption intraoperative images. CONCLUSION: Open source, web-based applications can generate and edit accurate operative and anatomical figures. As researchers refine AI image and video generation, plastic surgeons can use AI to make operative reports more image- and video-based and accelerate the operative report writing process. References: 1. Whisper.ai I. Whisper.ai. Updated 2022. Accessed 02/25/23, https://whisper.ai/ 2. Online SD. Stable Diffusion. Accessed 02/25/23, https://stablediffusionweb.com/ 3. OpenAI. ChatGPT. Updated 02/13/23. Accessed 02/25/23, https://chat.openai.com/chat 4. Mokady R, Hertz A, Bermano AH. ClipCap: CLIP Prefix for Image Captioning. 2021;doi:10.48550/arxiv.2111.09734

Ähnliche Arbeiten