Med-Flamingo: a Multimodal Medical Few-shot Learner – Appendix

We clustered the image embeddings of the MTB dataset into a large number of clusters (100) and manually reviewed examples of each cluster to assign an annotation. Table 4 lists the categories used to prompt the Claude-1 model to classify each book title. We initially prompted with 3 very rare categories (Geriatrics, Occupational medicine, Space medicine), but merge them into the ”Other” group for visualization purposes.


This content originally appeared on HackerNoon and was authored by The FewShot Prompting Publication

:::info Authors:

(1) Michael Moor, Department of Computer Science, Stanford University, Stanford, USA and these authors contributed equally to this work;

(2) Qian Huang, Department of Computer Science, Stanford University, Stanford, USA and these authors contributed equally to this work;

(3) Shirley Wu, Department of Computer Science, Stanford University, Stanford, USA;

(4) Michihiro Yasunaga, Department of Computer Science, Stanford University, Stanford, USA;

(5) Cyril Zakka, Department of Cardiothoracic Surgery, Stanford Medicine, Stanford, USA;

(6) Yash Dalmia, Department of Computer Science, Stanford University, Stanford, USA;

(7) Eduardo Pontes Reis, Hospital Israelita Albert Einstein, Sao Paulo, Brazil;

(8) Pranav Rajpurkar, Department of Biomedical Informatics, Harvard Medical School, Boston, USA;

(9) Jure Leskovec, Department of Computer Science, Stanford University, Stanford, USA.

:::

Abstract and 1 Introduction

2 Related Works

3 Med-Flamingo

4 Evaluation

5 Results

6 Discussion, Acknowledgments, and References

A Appendix

A APPENDIX

A.1 ADDITIONAL DETAILS FOR MTB DATASET

Clustering the images In a post-hoc analysis, we clustered the image embeddings of the MTB dataset into a large number of clusters (100) and manually reviewed examples of each cluster to assign an annotation. We discard noisy or unclear clusters and display the remaining clusters and their frequency in Figure 7.

\ Figure 7: Distribution of manually annotated image clusters in the MTB dataset.

\ Classification of book titles Here, we provide further details about the creation of Figure 3. Table 4 lists the categories used to prompt the Claude-1 model to classify each book title. We initially prompted with 3 more very rare categories (Geriatrics, Occupational medicine, Space medicine), but merge them into the ”Other” group for visualization purposes.

A.2 ADDITIONAL DETAILS FOR VISUAL USMLE DATASET

Table 4: List of 49 Categories (and ”Other”) used for visualing the MTB dataset in Figure 3

\ Figure 8: Distribution of specialty topics in the Visual USMLE dataset, as classified by Claude-1 using the categories provided in Table 4.

\

:::info This paper is available on arxiv under CC BY-NC-SA 4.0 DEED license.

:::

\


This content originally appeared on HackerNoon and was authored by The FewShot Prompting Publication


Print Share Comment Cite Upload Translate Updates
APA

The FewShot Prompting Publication | Sciencx (2024-06-19T23:00:23+00:00) Med-Flamingo: a Multimodal Medical Few-shot Learner – Appendix. Retrieved from https://www.scien.cx/2024/06/19/med-flamingo-a-multimodal-medical-few-shot-learner-appendix/

MLA
" » Med-Flamingo: a Multimodal Medical Few-shot Learner – Appendix." The FewShot Prompting Publication | Sciencx - Wednesday June 19, 2024, https://www.scien.cx/2024/06/19/med-flamingo-a-multimodal-medical-few-shot-learner-appendix/
HARVARD
The FewShot Prompting Publication | Sciencx Wednesday June 19, 2024 » Med-Flamingo: a Multimodal Medical Few-shot Learner – Appendix., viewed ,<https://www.scien.cx/2024/06/19/med-flamingo-a-multimodal-medical-few-shot-learner-appendix/>
VANCOUVER
The FewShot Prompting Publication | Sciencx - » Med-Flamingo: a Multimodal Medical Few-shot Learner – Appendix. [Internet]. [Accessed ]. Available from: https://www.scien.cx/2024/06/19/med-flamingo-a-multimodal-medical-few-shot-learner-appendix/
CHICAGO
" » Med-Flamingo: a Multimodal Medical Few-shot Learner – Appendix." The FewShot Prompting Publication | Sciencx - Accessed . https://www.scien.cx/2024/06/19/med-flamingo-a-multimodal-medical-few-shot-learner-appendix/
IEEE
" » Med-Flamingo: a Multimodal Medical Few-shot Learner – Appendix." The FewShot Prompting Publication | Sciencx [Online]. Available: https://www.scien.cx/2024/06/19/med-flamingo-a-multimodal-medical-few-shot-learner-appendix/. [Accessed: ]
rf:citation
» Med-Flamingo: a Multimodal Medical Few-shot Learner – Appendix | The FewShot Prompting Publication | Sciencx | https://www.scien.cx/2024/06/19/med-flamingo-a-multimodal-medical-few-shot-learner-appendix/ |

Please log in to upload a file.



There are no updates yet.
Click the Upload button above to add an update.

You must be logged in to translate posts. Please log in or register.

Related Posts