Senior Staff Data Engineer: Lead Scalable Data Pipelines

Pandora; Washington; In loco; USD 127.000 - 215.000; Tempo pieno

Descrizione del lavoro

SiriusXM is seeking a Senior Staff Data Engineer to build and maintain backend data products and reporting systems for AdsWizz. You will design scalable data pipelines and APIs powering measurement and revenue analytics across multiple platforms in North America.

You will mentor junior engineers, collaborate with product and operations teams, and drive production deployments with a focus on reliability and performance.

Competenze

• 12+ years of software engineering experience in Python or Java.
• 7+ years designing, building, and managing data pipelines using Spark, BigQuery, AWS EMR, and GCP Cloud Analytics.
• 7+ years of experience crafting REST API based-microservices and scalable products, utilizing diverse cloud platforms (ideally AWS).
• Cloud data warehouse & analytics platforms (Snowflake, BigQuery).
• Observability tools like Prometheus, Grafana, ELK stack.
• Data pipeline expectations framework experience (like Monte Carlo data, Great Expectations, Soda).
• Working with containers (Docker, Kubernetes).
• Messaging platforms and stream data processing (like Kafka, Flink, Pub/Sub).
• Collaboration tools like Miro (or Lucidchart), Jira and Confluence.
• Strong understanding of engineering software processes, lifecycle methodology, configuration management, release management, and system verification and testing.
• Ability to work independently and oversee entire projects or significant parts, focusing on research and completing the tasks on time.
• Strong analytical and problem-solving skills, with meticulous attention to detail and a dedication to continuous improvement.
• Nice to have expertise in Caching implementations (like Redis, Memcached, etc.).
• Nice to have expertise in Designing and maintaining Public APIs and data contracts.
• Nice to have Security basics (e.g., OAuth2 standard).
• Nice to have Foundational Amazon Cloud Services, like S3, CloudTrail, SQS, SNS, Lambda, API Gateway, ElasticCache, Athena, Kinesis, EKS, Cognito, and others.
• Nice to have NoSQL databases knowledge (Druid, DynamoDB, SingleStore, or others).
• Nice to have hands on experience with AI coding assistants and tools to help with coding and data analytics.
• Bachelor’s Degree in Computer Science/Mathematics or a similar field.
• Must have legal right to work in the U.S.

Mansioni

• Design and build high-performance, reliable, and scalable reporting APIs and data pipelines.
• Lead high-level architecture discussions and planning sessions work with ad measurement, revenue and addressability data.
• Work with various teams of engineers building software in a collaborative development process.
• Collaborate with the Product team to clarify the scope of the projects by giving thoughtful feedback which challenges and clarifies requirements intent.
• Execute tasks with utmost clarity and precision, demonstrating a strong sense of ownership and providing clear direction to drive projects forward effectively.
• Collaborate with the Global Operations and Cloud Infrastructure teams to ensure flawless production deployments and support the Incident Management team.
• Responsible for mentoring and guiding junior engineers.

Conoscenze

Python

Java

Data pipelines

REST APIs

Cloud platforms

BigQuery

Spark

Kubernetes

Docker

Kafka

Pub/Sub

Prometheus

Grafana

ELK

Miro/Jira/Confluence

Software processes

Independent/ownership

Analytics/problem solving

Caching (Redis/Memcached)

APIs and data contracts

Security basics

AWS/GCP

NoSQL

AI coding tools

Bachelor's degree

Legal right to work in U.S.

Formazione

Bachelor's Degree in Computer Science/Mathematics

Strumenti

Docker

Kubernetes

Snowflake

BigQuery

AWS EMR

GCP Cloud Analytics

Prometheus

Grafana

ELK

Kafka

Pub/Sub

Descrizione del lavoro

SiriusXM is seeking a Senior Staff Data Engineer to build and maintain backend data products and reporting systems for AdsWizz. You will design scalable data pipelines and APIs powering measurement and revenue analytics across multiple platforms in North America.

You will mentor junior engineers, collaborate with product and operations teams, and drive production deployments with a focus on reliability and performance.