Hi, I am Shenggui Li, you can call me Frank Lee as well. I am a first-year PhD student at the Nanyang Technological University in Singapore, advised by Prof. Tianwei Zhang and Prof. Ivor Tsang. I am also affliated with Singapore A*STAR Center for Frontier AI Research (CFAR). Prior to that, I obtained my 🤓 B.Eng in Computer Science in Nanyang Technological University in 2021 advised by Prof. Chen Change Loy. I also worked with Prof. Yang You from 2021 to 2024 as a research asssistant in the HPC-AI Lab and a founding member of HPC-AI Technology.

My interest lies at the intersection of 🤖 machine learning and ⚡️ high performance computing. I first proposed the concept of sequence parallelism in 2021, which has attracted follow-ups and is widely adopted for large-scale model training. I am the author of Ring Self-Attention, Colossal-AI and Open-Sora. During my undergraduate study, I had the privilege to spend a wonderful year on the NTU HPC Team and we won the overall 🥈 2nd place in the student cluster competition of ISC21.

You can find my 📄 CV here.

I am currently working on builiding efficient systems for generative AI and write technical blogs sometimes. Feel free to contact me for collaboration.

I was previously involved in some interesting projects.

• 🎥 Open-Sora: Core contributor (until July 2024) 
• ⚡️ SwiftInfer: Core contributor (until Jan 2024) 
• ⚡️ ColossalAI: Top 1 contributor (until April 2024)