百度大模型推理工程师（J101025）
社招全职1-3年ACG地点：北京状态：招聘
工作描述
任职要求 -本科及以上学历，计算机、软件工程、人工智能等相关专业，1-3年大模型推理工程落地经验，熟悉LLM推理原理 -熟练掌握 Python、Linux、Shell，熟悉网络、多进程/多线程、异步并发编程 -精通大模型推理优化技术，熟练使用 vLLM/TGI/TensorRT 至少一种主流推理引擎，掌握量化（INT4/INT8）、KV Cache、PagedAttention、动态批处理等核心优化手段 -熟悉模型服务化架构，掌握FastAPI/Grpc、容器化Docker、K8s基…
登录查看完整工作描述
微信扫码，1秒登录
包括英文材料
学历+
大模型+
https://www.youtube.com/watch?v=xZDB1naRUlk
You will build projects with LLMs that will enable you to create dynamic interfaces, interact with vast amounts of text data, and even empower LLMs with the capability to browse the internet for research papers.
https://www.youtube.com/watch?v=zjkBMFhNj_g
Python+
https://liaoxuefeng.com/books/python/introduction/index.html
中文，免费，零起点，完整示例，基于最新的Python 3版本。
https://www.learnpython.org/
a free interactive Python tutorial for people who want to learn Python, fast.
https://www.youtube.com/watch?v=K5KVEU3aaeQ
Master Python from scratch 🚀 No fluff—just clear, practical coding skills to kickstart your journey!
https://www.youtube.com/watch?v=rfscVS0vtbw
This course will give you a full introduction into all of the core concepts in python.
Linux+
https://ryanstutorials.net/linuxtutorial/
Ok, so you want to learn how to use the Bash command line interface (terminal) on Unix/Linux.
https://ubuntu.com/tutorials/command-line-for-beginners
The Linux command line is a text interface to your computer.
https://www.youtube.com/watch?v=6WatcfENsOU
In this Linux crash course, you will learn the fundamental skills and tools you need to become a proficient Linux system administrator.
https://www.youtube.com/watch?v=v392lEyM29A
Never fear the command line again, make it fear you.
https://www.youtube.com/watch?v=ZtqBQ68cfJc
Bash+
[英文] The Bash Guide
https://guide.bash.academy/
A quality-driven guide through the shell's many features.
https://www.youtube.com/watch?v=tK9Oc6AEnR4
Understanding how to use bash scripting will enhance your productivity by automating tasks, streamlining processes, and making your workflow more efficient.
多线程+
https://liaoxuefeng.com/books/java/threading/basic/index.html
和单线程相比，多线程编程的特点在于：多线程经常需要读写共享数据，并且需要同步。
https://www.youtube.com/watch?v=_uQgGS_VIXM&list=PLsc-VaxfZl4do3Etp_xQ0aQBoC-x5BIgJ
https://www.youtube.com/watch?v=IEEhzQoKtQU
https://www.youtube.com/watch?v=mTGdtC9f4EU&list=PLL8woMHwr36EDxjUoCzboZjedsnhLP1j4
https://www.youtube.com/watch?v=TPVH_coGAQs&list=PLk6CEY9XxSIAeK-EAh3hB4fgNvYkYmghp
https://www.youtube.com/watch?v=xPqnoB2hjjA
This video is an introduction to multithreading in modern C++.
https://www.youtube.com/watch?v=YKBwKy5PrpQ
Rust threading is easy to implement and improves the efficiency of your applications on multi-core systems!
vLLM+
https://www.newline.co/@zaoyang/ultimate-guide-to-vllm--aad8b65d
vLLM is a framework designed to make large language models faster, more efficient, and better suited for production environments.
https://www.youtube.com/watch?v=Ju2FrqIrdx0
vLLM is a cutting-edge serving engine designed for large language models (LLMs), offering unparalleled performance and efficiency for AI-driven applications.
TGI+
https://huggingface.co/docs/text-generation-inference/en/index
Text Generation Inference (TGI) is a toolkit for deploying and serving Large Language Models (LLMs).
https://learn.ritual.net/examples/tgi_inference_with_mistral_7b
In this tutorial, we will use Huggingface's TGI (Text Generation Interface) API to query a Large Language Model (LLM) and enable users to requests jobs from it, both on-chain and off-chain.
https://www.sandgarden.com/learn/text-generation-inference-tgi
Text Generation Inference (TGI) is the process by which a trained AI model generates new text based on an input prompt, focusing on producing this text efficiently in terms of speed and computational resources.
TensorRT+
https://docs.nvidia.com/deeplearning/tensorrt/latest/getting-started/quick-start-guide.html
This TensorRT Quick Start Guide is a starting point for developers who want to try out the TensorRT SDK; specifically, it demonstrates how to quickly construct an application to run inference on a TensorRT engine.
还有更多 •••
相关职位
社招3-5年J0012
1、本科及以上学历，计算机/软件相关专业； 2、熟练掌握 C++/Python，具备高性能系统研发能力； 3、熟悉 Transformer 推理原理，理解 Attention、KV Cache、采样策
更新于 2026-05-29北京|上海|深圳
社招2年以上元宝技术
1.熟练掌握 C++/Python/Go语言，有2年以上llm大模型推理优化经验； 2.具备基础的GPU编程能力，包括但不限于Cuda、OpenCL；熟悉至少一种GPU加速库，如cublas、cud
更新于 2026-08-08北京
社招2年以上元宝技术
1.本科及以上学历，计算机/电子/自动化/软件等相关专业，有AI工程优化经验的优先； 2.熟练GPU的高性能计算优化技术，深入理解计算机体系结构，熟悉并行计算优化、访存优化，低比特计算等； 3.具
更新于 2026-05-26深圳
社招3年以上技术类-开发
1. 熟练掌握 linux 环境下的 C++/Python 语言，有大规模机器学习或搜推广经验者优先。 2. 至少掌握一种机器学习框架（Tensorflow，Pytorch 或其他自研框架）。 3.
更新于 2026-08-20杭州