Senior Data Engineer - Scale Data Pipelines & Self-Service

Atlassian; Washington (District of Columbia); A distancia; USD 139.000 - 219.000; Jornada completa

Descripción de la vacante

At Atlassian, we hire talented people who can work from any location and collaborate across global teams. We are seeking a Senior Data Engineer to design premier data architecture that drives strategic decision-making and business insights.

You will partner with leadership, engineers, product managers, and data scientists to translate requirements into scalable data solutions, develop ELT/ETL pipelines, and own end-to-end data engineering lifecycle while mentoring others.

Formación

• BE in Computer Science or equivalent with 6+ years of professional Data Engineer experience.
• Experience building scalable data pipelines in Spark with Airflow.
• Experience with Databricks and its APIs.
• Experience with modern databases (Redshift, DynamoDB, MongoDB, Postgres) and data lakes.
• Proficient in Python/Scala and SQL.
• Champion CI/CD with Bitbucket and Git.
• Experience with large-scale batch and streaming data processing.
• Experience working for SaaS companies.
• Experience with Machine Learning.
• Committed code to open source projects.
• Experience building self-service tooling and platforms.

Responsabilidades

• Partner across engineering to lead high-impact company-wide initiatives.
• Mentor and upskill junior engineers.
• Collaborate with leadership, product engineers, program managers, and data scientists to prioritize data requirements.
• Design and architect scalable, high-performance data solutions.
• Develop, launch, and optimize ELT/ETL pipelines for large datasets.
• Intelligently design robust data models for fast storage and retrieval.
• Implement data quality frameworks for accuracy and freshness.
• Maintain end-to-end data engineering lifecycle ownership for team solutions.
• Participate in on-call rotation for platform stability.
• Partner with software teams to build next-generation data systems for self-service analytics.

Conocimientos

Spark (ETL)

Airflow

Databricks APIs

Databases

Python

Scala

SQL

CI/CD

Big data processing

SaaS

Machine Learning

Open source

Self-service tooling

Educación

BE in Computer Science or equivalent

Herramientas

Databricks

Airflow

Spark

Bitbucket

Git

Descripción del empleo

At Atlassian, we hire talented people who can work from any location and collaborate across global teams. We are seeking a Senior Data Engineer to design premier data architecture that drives strategic decision-making and business insights.

You will partner with leadership, engineers, product managers, and data scientists to translate requirements into scalable data solutions, develop ELT/ETL pipelines, and own end-to-end data engineering lifecycle while mentoring others.