Education

• Ph.D. in AI4Science and Foundation Models, Beihang University, 2020-2025 (expected)
  • Research focus: Applying advanced AI techniques to scientific computing and foundation models
• B.S. in Computer Science, Beihang University, 2016-2020
  • Graduated from the shenyuan honor class.

Professional Experience

• Co-founder and AI Research Lead, SeekThought (2022-2023)
  • Invested by YC China (2022 Spring)
  • Spearheaded the development of cutting-edge AI-enabled cross-modal search services
  • Led a team of researchers and engineers in implementing novel algorithms for multi-modal data processing
  • Collaborated with industry partners to deploy AI solutions in real-world scenarios
• Research Intern, Microsoft Research Asia (2019-2020, 2021-2022)
  • Conducted pioneering research on domain adaptation of pre-trained models
  • Developed innovative approaches for privacy protection in transformer architectures
  • Contributed to multiple research papers and patent applications
• Research Intern, Sinovation Ventures (2020)
  • Designed and implemented multi-task learning toolkits for Natural Language Processing
  • Optimized model performance for various NLP tasks, achieving state-of-the-art results
• Visiting Researcher, National SuperComputing Center in Wuxi (2020)
  • Explored the synergy between High-Performance Computing (HPC) scale-up techniques and pre-training methodologies
  • Developed strategies to leverage supercomputing resources for large-scale AI model training

Publications

Building Flexible Machine Learning Models for Scientific Computing at Scale

Chen T, Zhou H, Li Y, et al. Building Flexible Machine Learning Models for Scientific Computing at Scale[J]. arXiv preprint arXiv:2402.16014, 2024.

Task-Specific Expert Pruning for Sparse Mixture-of-Experts

Chen T, Huang S, Xie Y, et al. Task-specific expert pruning for sparse mixture-of-experts[J]. arXiv preprint arXiv:2206.00277, 2022.

The-X: Privacy-preserving transformer inference with homomorphic encryption

THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption (Chen et al., Findings 2022)

Moec: Mixture of expert clusters

Xie Y, Huang S, Chen T, et al. Moec: Mixture of expert clusters[C]//Proceedings of the AAAI Conference on Artificial Intelligence. 2023, 37(11): 13807-13815.

Learning Music Sequence Representation From Text Supervision

Chen T, Xie Y, Zhang S, et al. Learning music sequence representation from text supervision[C]//ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2022: 4583-4587.

Pseudo-label guided unsupervised domain adaptation of contextual embeddings

Chen T, Huang S, Wei F, et al. Pseudo-label guided unsupervised domain adaptation of contextual embeddings[C]//Proceedings of the Second Workshop on Domain Adaptation for NLP. 2021: 9-15.

Leadership and Service

• Founder and Lead, AI4SC Research Group
  • Established and lead a collaborative research initiative between Peking University and Beihang University
  • Direct cutting-edge research on applying foundation models to scientific computing tasks, including PDE solving
  • Sponsored by the National 2030 plan
  • Mentor and supervise graduate students, fostering the next generation of AI researchers
• Peer Reviewer for Top-tier AI Conferences
  • AAAI, ACL, NAACL, NeurIPS, IJCAI, and ICML
  • Contributed to maintaining high standards in AI research through rigorous paper evaluations
• Organizer, PPML Workshop 2023
  • Facilitated knowledge exchange among researchers and practitioners in the field

Skills

• Programming Languages: Python, C++
• Machine Learning Frameworks: PyTorch, TensorFlow, Hugging Face Transformers
• High-Performance Computing: Experience with distributed training and large-scale model deployment
• Scientific Computing: Expertise in Neural Operators and PDE solving techniques
• Languages: Fluent in English and Mandarin Chinese

Awards and Honors

• National Silver Award, 9th China International College Students’ Innovation Competition (Industry Track), 2023
• First Prize, China Open Source Innovation Competition, Cyberspace Administration of China, 2022
• First Prize (Beijing Region), 7th China International “Internet+” College Students’ Innovation and Entrepreneurship Competition, 2022
• First Prize (Champion) in Innovation Achievement Transformation, National Industrial APP and Information Consumption Competition, Ministry of Industry and Information Technology, 2020
• Third Prize, 5th “Belt and Road” International Big Data Competition, IKCEST, 2023