Data Engineer: Large-Scale Ads Pipelines

Apple Inc.; New York (NY); On-site; USD 150,000 - 210,000; Full time

Job summary

Apple Inc. in Austin, TX seeks a Software Engineer for the Apple Ads data engineering team to design, build, and operate scalable data pipelines processing large volumes of advertising events using Spark, Kafka, and cloud storage.

The role emphasizes data correctness, privacy, reliability, and performance, with opportunities to own end-to-end systems from design to production support and observability.

Qualifications

• 3+ years of professional software or data engineering experience
• Strong CS fundamentals: data structures, algorithms, concurrency, distributed systems
• Strong programming in Java and/or Scala with production-quality software
• Hands-on experience building and operating large-scale data pipelines with Apache Spark
• Experience with Kafka, Hadoop, S3/object storage, or equivalent big-data infrastructure
• Strong SQL skills and working with large analytical datasets
• Bachelor's degree in CS/SE/CE or related field or equivalent practical experience

Responsibilities

• Design, develop, and operate large-scale distributed data processing pipelines using Spark and related big-data technologies
• Build reliable batch, near-real-time, and streaming pipelines for processing high-volume advertising and measurement data
• Develop production-quality software primarily using Java, Scala, and/or Python
• Design scalable data architectures for processing and storing very large datasets
• Build pipelines using Spark, Kafka, S3/object storage, Iceberg, Hadoop, and cloud-native infrastructure
• Develop efficient data transformations, aggregations, joins, and data-processing algorithms over large datasets
• Analyze and optimize Spark applications for performance, memory utilization, shuffle efficiency, parallelism, and compute cost
• Design systems that handle late-arriving data, retries, partial failures, reprocessing, and evolving schemas
• Build data-quality controls, validation, reconciliation, and monitoring for correctness
• Design privacy-conscious data handling principles into architecture
• Develop observability, metrics, alerting, and debugging for production pipelines
• Investigate and resolve issues across distributed compute, storage, orchestration, and downstream data systems
• Participate in architecture reviews and contribute to data platform decisions
• Write clean, well-tested code and participate in code reviews
• Own services and pipelines through design, development, deployment, monitoring, and production support
• Collaborate with cross-functional teams to deliver scalable Apple Ads solutions

Skills

Java/Scala

Distributed systems

Spark

SQL

Python

Education

Bachelor's degree in CS/SE/CE or related field

Tools

Kafka

Hadoop

S3

Iceberg

Job description

Apple Inc. in Austin, TX seeks a Software Engineer for the Apple Ads data engineering team to design, build, and operate scalable data pipelines processing large volumes of advertising events using Spark, Kafka, and cloud storage.

The role emphasizes data correctness, privacy, reliability, and performance, with opportunities to own end-to-end systems from design to production support and observability.