商汤影微芯片业务-多模态大模型研究员
校招全职算法研究地点：北京 | 上海 | 深圳 | 西安状态：招聘
任职要求
1. 计算机、电子信息、数学等相关专业； 2. 熟练使用Python，C/C++中至少一种编程语言，掌握PyTorch， Tensorflow等深度学习框架之一； 3. 在计算机视觉、多模态算法等方向上有一定研究经验，对多模态算法的研究和落地具有强烈的热情； 4. 在CVPR/ICCV/ECCV/NeurPS/ICLR/ACL/EMNLP等学术顶会有相关论文发表者优先； 5. 参与过有影响力的多模态算法项目者优先；
工作职责
1. 参与多模态模型的训练(Pretrain、Post-Training、RL)，可处理图像，文本，语音等多模态数据，负责网络结构与训练策略优化等 2. 探索多模态领域内的最新研究成果和技术进展 3. 构建和维护多模态数据集，负责多模态大模型的业务落地和推广 4. 将研究内容总结为技术文档、论文、专利或技术报告
包括英文材料
Python+
https://liaoxuefeng.com/books/python/introduction/index.html
中文，免费，零起点，完整示例，基于最新的Python 3版本。
https://www.learnpython.org/
a free interactive Python tutorial for people who want to learn Python, fast.
https://www.youtube.com/watch?v=K5KVEU3aaeQ
Master Python from scratch 🚀 No fluff—just clear, practical coding skills to kickstart your journey!
https://www.youtube.com/watch?v=rfscVS0vtbw
This course will give you a full introduction into all of the core concepts in python.
C+
https://www.freecodecamp.org/chinese/news/the-c-beginners-handbook/
本手册遵循二八定律。你将在 20% 的时间内学习 80% 的 C 编程语言。
https://www.youtube.com/watch?v=87SH2Cn0s9A
https://www.youtube.com/watch?v=KJgsSFOSQv0
This course will give you a full introduction into all of the core concepts in the C programming language.
https://www.youtube.com/watch?v=PaPN51Mm5qQ
In this complete C programming course, Dr. Charles Severance (aka Dr. Chuck) will help you understand computer architecture and low-level programming with the help of the classic C Programming language book written by Brian Kernighan and Dennis Ritchie.
C+++
https://www.learncpp.com/
LearnCpp.com is a free website devoted to teaching you how to program in modern C++.
https://www.youtube.com/watch?v=ZzaPdXTrSb8
PyTorch+
https://datawhalechina.github.io/thorough-pytorch/
PyTorch是利用深度学习进行数据科学研究的重要工具，在灵活性、可读性和性能上都具备相当的优势，近年来已成为学术界实现深度学习算法最常用的框架。
https://www.youtube.com/watch?v=V_xro1bcAuA
Learn PyTorch for deep learning in this comprehensive course for beginners. PyTorch is a machine learning framework written in Python.
TensorFlow+
https://www.youtube.com/watch?v=tpCFfeUEGs8
Ready to learn the fundamentals of TensorFlow and deep learning with Python? Well, you’ve come to the right place.
https://www.youtube.com/watch?v=ZUKz4125WNI
This part continues right where part one left off so get that Google Colab window open and get ready to write plenty more TensorFlow code.
深度学习+
https://d2l.ai/
Interactive deep learning book with code, math, and discussions.
OpenCV+
https://learnopencv.com/getting-started-with-opencv/
At LearnOpenCV we are on a mission to educate the global workforce in computer vision and AI.
https://opencv.org/university/free-opencv-course/
This free OpenCV course will teach you how to manipulate images and videos, and detect objects and faces, among other exciting topics in just about 3 hours.
算法+
https://roadmap.sh/datastructures-and-algorithms
Step by step guide to learn Data Structures and Algorithms in 2025
https://www.hellointerview.com/learn/code
A visual guide to the most important patterns and approaches for the coding interview.
https://www.w3schools.com/dsa/
CVPR+
https://cvpr.thecvf.com/
ICCV+
https://iccv.thecvf.com/
ICCV is the premier international computer vision event comprising the main conference and several co-located workshops and tutorials.
ECCV+
https://eccv.ecva.net/
ECCV is the official event under the European Computer Vision Association and is biannual on even numbered years.
ICLR+
https://iclr.cc/
相关职位
校招算法研究
1.构建多模态感知与理解系统，融合RGB、TOFIR、双目等多种传感器数据，实现从视觉到语义的高质量感知; 2.参与跨模态视觉-语言-动作(VLA)模型设计与开发，实现对图像属性、空间关系、动作执行等复杂场景的统一建模; 3.推进大模型在智能设备上的落地，包括图像-语言对齐、场景理解、指令驱动行为等能力
更新于 2025-08-19
校招算法研究
1.相机图像感知核心算法研发，包括图像稳定(EIS/OIS)、目标检测、跟踪与运动建模等模块提升图像质量与理解基础; 2.推进大模型在智能设备上的落地，包括图像-语言对齐、场景理解、指令驱动行为等能力； 3.构建zero-shot或few-shot任务适应机制，在变化场景中增强模型泛化能力;
更新于 2025-08-19
校招算法研究
1. 参与视频AI-ISP算法的设计开发，负责关键算法模块（多帧图像配准，解马赛克，去噪，HDR，Tone mapping，画质增强，色彩增强等）的开发与性能优化。 2. 跟踪调研前沿ISP算法并进行实现和性能评估。
更新于 2025-08-19
校招芯片设计
1、负责图像或视频的主客观画质测试，设计主客观测试用例并执行，评测画质效果并及时反馈相关问题； 2、与算法、工程紧密合作，牵引并推动画质效果的优化； 3、分析输出画质评测报告，对最终画质效果负责。
更新于 2025-08-19