Senior Data Engineer

Atlassian; New York (NY); Hybrid; USD 167,000 - 219,000; Full time

Job summary

Atlassian is hiring a Senior Data Engineer to design premier data architecture and ELT/ETL pipelines, partnering with product and data scientists to translate business needs into scalable data solutions.

You will mentor engineers, own data quality and models, and collaborate with software teams to enable self-service data consumption across the organization. The role supports on-call rotation for platform reliability.

Qualifications

• BE in Computer Science or equivalent with 6+ years of professional experience as a Data Engineer or in a similar role.
• Experience building scalable data pipelines in Spark using Airflow scheduler/executor framework or similar scheduling tools.
• Experience with Databricks and its APIs.
• Experience with modern databases (Redshift, DynamoDB, MongoDB, PostgreSQL or similar) and data lakes.
• Proficient in one or more programming languages such as Python/Scala and rock-solid SQL skills.
• Champion automated builds and deployments using CICD tools like Bitbucket, Git
• Experience working with large-scale, high-performance data processing systems (batch and streaming)
• Experience working for SAAS companies
• Experience with Machine Learning
• Committed code to open source projects

Responsibilities

• Partner across engineering organizations to spearhead and execute high-impact, company-wide initiatives.
• Mentor and upskill junior engineers, fostering a culture of technical excellence and continuous growth.
• Collaborate with leadership, product engineers, program managers, and data scientists to deeply understand and prioritize business data requirements.
• Leverage deep technical expertise to design and architect scalable, high-performance data solutions.
• Develop, launch, and optimize highly efficient, reliable ELT/ETL pipelines capable of processing both large-scale and specialized datasets.
• Intelligently design robust data models optimized for high-speed storage, accessibility, and downstream retrieval.
• Implement and deploy rigorous data quality frameworks to guarantee data accuracy, freshness, and trust.
• Maintain full technical ownership of the end-to-end data engineering lifecycle for your team's solutions.
• Participate in the team’s on-call rotation to ensure platform stability and support operational health.
• Partner with software engineering teams to design and build next-generation data systems that enable rapid, self-service data consumption.

Skills

Python

Scala

SQL

Spark

Airflow

CI/CD

Team Leadership

Education

BE in Computer Science or equivalent

Tools

Apache Spark

Airflow

Databricks

Redshift

DynamoDB

MongoDB

PostgreSQL

Bitbucket

Git

Job description

Working at Atlassian

Atlassians can choose where they work – whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity.

Overview

Atlassians can choose where they work – whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity.

Responsibilities

Our Product DE organization is looking for a Senior Data Engineer reporting to the Senior Data Engineering Manager. You will be responsible for designing premier data architecture and solutions that drive strategic decision-making. Beyond technical execution, you will collaborate with business stakeholders to translate operational needs into technical requirements and spearhead initiatives to improve overall system efficiency.

In This Role, You Will

• Partner across engineering organizations to spearhead and execute high-impact, company-wide initiatives,
• Mentor and upskill junior engineers, fostering a culture of technical excellence and continuous growth.
• Collaborate with leadership, product engineers, program managers, and data scientists to deeply understand and prioritize business data requirements.
• Leverage deep technical expertise to design and architect scalable, high-performance data solutions.
• Develop, launch, and optimize highly efficient, reliable ELT/ETL pipelines capable of processing both large-scale and specialized datasets.
• Intelligently design robust data models optimized for high-speed storage, accessibility, and downstream retrieval.
• Implement and deploy rigorous data quality frameworks to guarantee data accuracy, freshness, and trust.
• Maintain full technical ownership of the end-to-end data engineering lifecycle for your team's solutions.
• Participate in the team’s on-call rotation to ensure platform stability and support operational health.
• Partner with software engineering teams to design and build next-generation data systems that enable rapid, self-service data consumption.

Compensation

At Atlassian, we strive to design equitable, explainable, and competitive compensation programs. We follow consistent hiring practices and account for each candidate's skills, knowledge, and experience when setting base pay within the range. Please visit go.atlassian.com/payzones for more information on which locations are included in each of our geographic pay zones. However, please confirm the zone for your specific location with your recruiter. This role may also be eligible for benefits, bonuses, commissions, and equity.

Pay Ranges

In The United States, we have three geographic pay zones. For this role, our current base pay ranges for new hires in each zone are:

• Zone A: $167,400 - $218,550
• Zone B: $150,660 - $196,695
• Zone C: $138,942 - $181,397

Qualifications

• A BE in Computer Science or equivalent with 6+ years of professional experience as a Data Engineer or in a similar role
• Experience building scalable data pipelines in Spark using Airflow scheduler/executor framework or similar scheduling tools.
• Experience with Databricks and its APIs.
• Experience with modern databases (Redshift, Dynamo DB, Mongo DB, Postgres or similar) and data lakes.
• Proficient in one or more programming languages such as Python/Scala and rock-solid SQL skills.
• Champion automated builds and deployments using CICD tools like Bitbucket, Git
• Experience working with large-scale, high-performance data processing systems (batch and streaming)
• Experience working for SAAS companies
• Experience with Machine Learning
• Committed code to open source projects
• Experience building self-service tooling and platforms

Benefits & Perks

Atlassian offers a wide range of perks and benefits designed to support you, your family and to help you engage with your local community. Our offerings include health and wellbeing resources, paid volunteer days, and so much more. To learn more, visit go.atlassian.com/perksandbenefits.

About Atlassian

At Atlassian, we're motivated by a common goal: to unleash the potential of every team. Our software products help teams all over the planet and our solutions are designed for all types of work. Team collaboration through our tools makes what may be impossible alone, possible together. We believe that the unique contributions of all Atlassians create our success. To ensure that our products and culture continue to incorporate everyone's perspectives and experience, we never discriminate based on race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status. All your information will be kept confidential according to EEO guidelines.

To provide you the best experience, we can support with accommodations or adjustments at any stage of the recruitment process. Simply inform our Recruitment team during your conversation with them.

To learn more about our culture and hiring process, visit go.atlassian.com/crh.

In line with local law, identity verification (which may include use of biometric data) is a condition of employment with Atlassian for employment fraud purposes.