Sign up to save your podcasts
Or
Share BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining
In this paper, we propose BioGPT, a domain-specific generative Transformer language model pre-trained on large-scale biomedical literature. We evaluate BioGPT on six biomedical natural language processing tasks and demonstrate that our model outperforms previous models on most tasks. Our case study on text generation further demonstrates the advantage of BioGPT on biomedical literature to generate fluent descriptions for biomedical terms.
2022: Renqian Luo, Liai Sun, Yingce Xia, Tao Qin, Sheng Zhang, Hoifung Poon, Tie-Yan Liu
Ranked #1 on Question Answering on PubMedQA
https://arxiv.org/pdf/2210.10341v2.pdf
View all episodes
By Rob
3.7
33 ratings
In this paper, we propose BioGPT, a domain-specific generative Transformer language model pre-trained on large-scale biomedical literature. We evaluate BioGPT on six biomedical natural language processing tasks and demonstrate that our model outperforms previous models on most tasks. Our case study on text generation further demonstrates the advantage of BioGPT on biomedical literature to generate fluent descriptions for biomedical terms.
2022: Renqian Luo, Liai Sun, Yingce Xia, Tao Qin, Sheng Zhang, Hoifung Poon, Tie-Yan Liu
Ranked #1 on Question Answering on PubMedQA
https://arxiv.org/pdf/2210.10341v2.pdf