Skip to main navigation Skip to search Skip to main content

A comprehensive survey on pretrained foundation models: a history from BERT to ChatGPT

  • Ce Zhou
  • , Qian Li
  • , Chen Li
  • , Jun Yu
  • , Yixin Liu
  • , Guangjing Wang
  • , Kai Zhang
  • , Cheng Ji
  • , Qiben Yan
  • , Lifang He
  • , Hao Peng
  • , Jianxin Li
  • , Jia Wu
  • , Ziwei Liu
  • , Pengtao Xie
  • , Caiming Xiong
  • , Jian Pei
  • , Philip S. Yu
  • , Lichao Sun
  • Michigan State University
  • Beihang University
  • Lehigh University
  • Macquarie University
  • Nanyang Technological University
  • University of California at San Diego
  • Salesforce AI Research
  • Duke University
  • University of Illinois at Chicago

Research output: Contribution to journalArticlepeer-review

Original languageEnglish
Pages (from-to)9851-9915
Number of pages65
JournalInternational Journal of Machine Learning and Cybernetics
Volume16
Issue number12
DOIs
StateAccepted/In press - 2024
Externally publishedYes

ASJC Scopus Subject Areas

  • Software
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Keywords

  • BERT
  • ChatGPT
  • Computer vision
  • GPT-4
  • Graph learning
  • Natural language processing
  • Pretrained foundation models

Fingerprint

Dive into the research topics of 'A comprehensive survey on pretrained foundation models: a history from BERT to ChatGPT'. Together they form a unique fingerprint.

Cite this