Hi, I am Shenggui Li, you can call me Frank Lee as well. I am a second-year PhD student at the Nanyang Technological University in Singapore, advised by Prof. Tianwei Zhang and Prof. Ivor Tsang. I am also affliated with Singapore A*STAR Center for Frontier AI Research (CFAR). Prior to that, I obtained my 🤓 B.Eng in Computer Science in Nanyang Technological University in 2021 advised by Prof. Chen Change Loy. I also worked as a founding member of a MLSys startup from 2022 to 2024.

My interest lies at the intersection of 🤖 machine learning and ⚡️ high performance computing. I first proposed the concept of sequence parallelism in 2021, which has attracted follow-ups and is widely adopted for large-scale model training. I am currently leading the SpecForge project and the SpecBundle intiative. I am also the author of Ring Self-Attention, Colossal-AI and Open-Sora. During my undergraduate study, I had the privilege to spend a wonderful year on the NTU HPC Team and we won the overall 🥈 2nd place in the student cluster competition of ISC21.

You can find my 📄 CV here.

I am currently working on builiding efficient systems for generative AI and write technical blogs sometimes. Feel free to contact me for collaboration.

During my spare time, I am learning and contributing to open-source projects such as

• 🚀 SpecForge: Project Lead 
• 🚀 SGLang: Core Dev 

I was previously involved in some interesting projects.

• 🎥 Open-Sora: System Lead (until July 2024) 
• ⚡️ SwiftInfer: Project Lead (until Jan 2024) 
• ⚡️ ColossalAI: Project Lead, Top 1 contributor (until Jan 2024)