苹果Senior Big Data Platform Engineer
任职要求
Minimum Qualifications • 3+ years of related hands-on data modeling and data engineering experience. • Strong expertise in Big data Platform development in Public Cloud (such as AWS, GCP, Ali Cloud, Tencent Cloud, etc.) • Experience in scheduling system development, deployment, and tuning (such as Airflow, etc) • Database design and development experience with relational and non-relational DB. • Familiar with using infrastructure-as-code(I…
工作职责
You will design and build data warehouses on cloud, to provide efficient analytical and reporting capabilities across Apple’s global and regional sales and finance teams. You will develop highly scalable data pipelines to load data from various source systems, use Apache Airflow to orchestrate, schedule and monitor the workflows. Build generic and reusable solutions meeting data warehousing design standards for complex business requirements. You will be required to understand existing solutions, fine-tune them and support them as needed. Data quality is our goal and we expect you to meet our high standards on data and software quality. We are a rapidly growing team with plenty of interesting technical and business challenges to solve.We seek a self starter, who is willing to learn fast, adapt well to changing requirements and work with cross functional teams.
• Drive reliability engineering initiatives, including infrastructure automation, service monitoring, incident response, and capacity planning. • Leading and participating in technical design discussions across cross functional teams. • Collaborate with application teams to define and enforce architectural best practices, CI/CD standards, and cloud-native patterns. • Diagnose complex production issues through in-depth troubleshooting and implement resilient solutions to prevent recurrence. • Contribute to the development of internal tools that improve observability, system health, and operational transparency. • Analyze and optimize existing systems, providing enhancements and ongoing support as needed. • Stay current with new technologies and proactively recommend improvements to existing cloud architectures and processes. • Develop and maintain server-side logic, data processing, and application workflows. • Mentor junior engineers and promote a culture of knowledge sharing and continuous improvement.
• Working on backend and frontend design and development of web applications. • Collecting requirements and provide consultation to end users about their needs and use cases. • Analyzing performance bottlenecks. • Supporting and maintaining large scale data platform with high QoS. • Building infrastructure and microservices for various big-data scenarios.
• Analyze massive datasets to extract insights and prototype predictive models that forecast infrastructure capacity needs. • Develop scalable solution pipelines to enhance the efficiency, reliability, and performance of Microsoft 365 and Copilot services. • Leverage generative AI and agentic orchestration to build intelligent systems that address complex infrastructure challenges. • Design and implement innovative machine learning and mathematical models to drive breakthrough optimizations. • Collaborate with cross-functional teams—including product, engineering, and research—to align efforts and deliver high-impact solutions. • Translate advanced research into durable, data-driven products that create lasting business value.
• Design, develop, and manage Streaming and Batch pipelines, supporting key functionalities such as large-scale index construction, web page crawling and feature extraction, image processing, and context re-writing. • Optimize continuously a platform to manage, schedule, and monitor hundreds of pipelines. • Optimize continuously a platform to view, track, debug, and operate massive scale Ads Data. • Evaluate and optimize code and design, to maximize performance, minimize complexity. • Mentor junior SDE and solely drive feature development from ground zero.