苹果Senior Big Data Platform Engineer
任职要求
Minimum Qualifications • 3+ years of related hands-on data modeling and data engineering experience. • Strong expertise in Big data Platform development in Public Cloud (such as AWS, GCP, Ali Cloud, Tencent Cloud, etc.) • Experience in scheduling system development, deployment, and tuning (such as Airflow, etc) • Database design and development experience with relational and non-relational DB. • Familiar with using infrastructure-as-code(IAC) and configuration management tools such as Terraform. Preferred Qualifications • Familiar with the Hadoop ecosystem, including Hive, Spark and customize at least one system at code-level • Analytical and mathematical mind, capable of evaluating and solving various complex problems • Ability to work individually or as part of a team • Ability to learn quickly in a fast-paced environment • Excellent oral and written communication skills
工作职责
You will design and build data warehouses on cloud, to provide efficient analytical and reporting capabilities across Apple’s global and regional sales and finance teams. You will develop highly scalable data pipelines to load data from various source systems, use Apache Airflow to orchestrate, schedule and monitor the workflows. Build generic and reusable solutions meeting data warehousing design standards for complex business requirements. You will be required to understand existing solutions, fine-tune them and support them as needed. Data quality is our goal and we expect you to meet our high standards on data and software quality. We are a rapidly growing team with plenty of interesting technical and business challenges to solve.We seek a self starter, who is willing to learn fast, adapt well to changing requirements and work with cross functional teams.
• Drive reliability engineering initiatives, including infrastructure automation, service monitoring, incident response, and capacity planning. • Leading and participating in technical design discussions across cross functional teams. • Collaborate with application teams to define and enforce architectural best practices, CI/CD standards, and cloud-native patterns. • Diagnose complex production issues through in-depth troubleshooting and implement resilient solutions to prevent recurrence. • Contribute to the development of internal tools that improve observability, system health, and operational transparency. • Analyze and optimize existing systems, providing enhancements and ongoing support as needed. • Stay current with new technologies and proactively recommend improvements to existing cloud architectures and processes. • Develop and maintain server-side logic, data processing, and application workflows. • Mentor junior engineers and promote a culture of knowledge sharing and continuous improvement.
• Working on backend and frontend design and development of web applications. • Collecting requirements and provide consultation to end users about their needs and use cases. • Analyzing performance bottlenecks. • Supporting and maintaining large scale data platform with high QoS. • Building infrastructure and microservices for various big-data scenarios.
• Design, develop, and manage Streaming and Batch pipelines, supporting key functionalities such as large-scale index construction, web page crawling and feature extraction, image processing, and context re-writing. • Optimize continuously a platform to manage, schedule, and monitor hundreds of pipelines. • Optimize continuously a platform to view, track, debug, and operate massive scale Ads Data. • Evaluate and optimize code and design, to maximize performance, minimize complexity. • Mentor junior SDE and solely drive feature development from ground zero.
• Response and Resolution: You own, investigate, and solve complex customer technical issues and act as an advisor to the customer, collaborating within and across teams and leveraging troubleshooting tools and practices.• Readiness: You lead in building communities with peer delivery roles and share your knowledge through readiness programs, technical coaching and mentoring of others. • You deepen your technical and professional proficiency to enable you to resolve complex customer issues, through training and readiness.• Product/Process Improvement: You engage with Microsoft Engineering/ Supportability teams to investigate potential product defects and help develop automation techniques and diagnostic tools driving Microsoft product improvements. • Respond to and resolve critical customer issues as part of a 24x7 on-call rotation.