Linggong Meng
Senior Machine Learning Specialist at DEVCO
Senior Machine Learning Specialist, Algorithm Engineering Direction at DEVO, mainly responsible for the R&D work related to DEVO's algorithm platform. He is responsible for the R&D of algorithmic platform in DEVO. He has been working in DEVO from 0 to 1 to build a universal large model training and inference platform. He used to work for Tencent, Ali and other big internet companies, and joined DEVO in 2022, focusing on big model related technology, including inference acceleration and application scenarios, and has published many high quality big model related articles in DEVO's technical public number, such as: using multi-Lora to save the cost of deploying big models, KubeAI big model inference acceleration practice, and DEVO's best practice of accessing the big model platform.
Topic
DeepSeek Application and Optimization Practices for Deployment of Poizon
It mainly introduces the experience of DeepSeek and other big models deployed and landed in DEVO, including the optimization of big model inference performance, deployment cost saving, and how we build a big model training platform from 0 to 1, so that each business side can fine-tune the training and deployment of the big models on line with a low threshold. Outline: Large model inference engine optimization DeepSeek big model deployment optimization Practicing with Poizon's Big Model Training and Inference Platform
