Senior Data Engineer

Atlassian; Washington (District of Columbia); Remote; USD 139.000 - 219.000; Vollzeit

Zusammenfassung

At Atlassian, we hire talented people who can work from any location and collaborate across global teams. We are seeking a Senior Data Engineer to design premier data architecture that drives strategic decision-making and business insights.

You will partner with leadership, engineers, product managers, and data scientists to translate requirements into scalable data solutions, develop ELT/ETL pipelines, and own end-to-end data engineering lifecycle while mentoring others.

Qualifikationen

• BE in Computer Science or equivalent with 6+ years of professional Data Engineer experience.
• Experience building scalable data pipelines in Spark with Airflow.
• Experience with Databricks and its APIs.
• Experience with modern databases (Redshift, DynamoDB, MongoDB, Postgres) and data lakes.
• Proficient in Python/Scala and SQL.
• Champion CI/CD with Bitbucket and Git.
• Experience with large-scale batch and streaming data processing.
• Experience working for SaaS companies.
• Experience with Machine Learning.
• Committed code to open source projects.
• Experience building self-service tooling and platforms.

Aufgaben

• Partner across engineering to lead high-impact company-wide initiatives.
• Mentor and upskill junior engineers.
• Collaborate with leadership, product engineers, program managers, and data scientists to prioritize data requirements.
• Design and architect scalable, high-performance data solutions.
• Develop, launch, and optimize ELT/ETL pipelines for large datasets.
• Intelligently design robust data models for fast storage and retrieval.
• Implement data quality frameworks for accuracy and freshness.
• Maintain end-to-end data engineering lifecycle ownership for team solutions.
• Participate in on-call rotation for platform stability.
• Partner with software teams to build next-generation data systems for self-service analytics.

Kenntnisse

Spark (ETL)

Airflow

Databricks APIs

Databases

Python

Scala

SQL

CI/CD

Big data processing

SaaS

Machine Learning

Open source

Self-service tooling

Ausbildung

BE in Computer Science or equivalent

Tools

Databricks

Airflow

Spark

Bitbucket

Git

Jobbeschreibung

Working at Atlassian

Atlassians can choose where they work – whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity.

Overview

Atlassians can choose where they work – whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity.

Responsibilities

Our Product DE organization is looking for a Senior Data Engineer reporting to the Senior Data Engineering Manager. You will be responsible for designing premier data architecture and solutions that drive strategic decision-making. Beyond technical execution, you will collaborate with business stakeholders to translate operational needs into technical requirements and spearhead initiatives to improve overall system efficiency.

In This Role, You Will

• Partner across engineering organizations to spearhead and execute high-impact, company-wide initiatives,
• Mentor and upskill junior engineers, fostering a culture of technical excellence and continuous growth.
• Collaborate with leadership, product engineers, program managers, and data scientists to deeply understand and prioritize business data requirements.
• Leverage deep technical expertise to design and architect scalable, high-performance data solutions.
• Develop, launch, and optimize highly efficient, reliable ELT/ETL pipelines capable of processing both large-scale and specialized datasets.
• Intelligently design robust data models optimized for high-speed storage, accessibility, and downstream retrieval.
• Implement and deploy rigorous data quality frameworks to guarantee data accuracy, freshness, and trust.
• Maintain full technical ownership of the end-to-end data engineering lifecycle for your team's solutions.
• Participate in the team’s on-call rotation to ensure platform stability and support operational health.
• Partner with software engineering teams to design and build next-generation data systems that enable rapid, self-service data consumption.

Compensation

At Atlassian, we strive to design equitable, explainable, and competitive compensation programs. We follow consistent hiring practices and account for each candidate's skills, knowledge, and experience when setting base pay within the range. Please visit go.atlassian.com/payzones for more information on which locations are included in each of our geographic pay zones. However, please confirm the zone for your specific location with your recruiter. This role may also be eligible for benefits, bonuses, commissions, and equity.

Pay Ranges

In The United States, we have three geographic pay zones. For this role, our current base pay ranges for new hires in each zone are:

• Zone A: $167,400 - $218,550
• Zone B: $150,660 - $196,695
• Zone C: $138,942 - $181,397

Qualifications

• A BE in Computer Science or equivalent with 6+ years of professional experience as a Data Engineer or in a similar role
• Experience building scalable data pipelines in Spark using Airflow scheduler/executor framework or similar scheduling tools.
• Experience with Databricks and its APIs.
• Experience with modern databases (Redshift, Dynamo DB, Mongo DB, Postgres or similar) and data lakes.
• Proficient in one or more programming languages such as Python/Scala and rock-solid SQL skills.
• Champion automated builds and deployments using CICD tools like Bitbucket, Git
• Experience working with large-scale, high-performance data processing systems (batch and streaming)
• Experience working for SAAS companies
• Experience with Machine Learning
• Committed code to open source projects
• Experience building self-service tooling and platforms

Benefits & Perks

Atlassian offers a wide range of perks and benefits designed to support you, your family and to help you engage with your local community. Our offerings include health and wellbeing resources, paid volunteer days, and so much more. To learn more, visit go.atlassian.com/perksandbenefits.

About Atlassian

At Atlassian, we're motivated by a common goal: to unleash the potential of every team. Our software products help teams all over the planet and our solutions are designed for all types of work. Team collaboration through our tools makes what may be impossible alone, possible together. We believe that the unique contributions of all Atlassians create our success. To ensure that our products and culture continue to incorporate everyone's perspectives and experience, we never discriminate based on race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status. All your information will be kept confidential according to EEO guidelines.

To provide you the best experience, we can support with accommodations or adjustments at any stage of the recruitment process. Simply inform our Recruitment team during your conversation with them.

To learn more about our culture and hiring process, visit go.atlassian.com/crh.

In line with local law, identity verification (which may include use of biometric data) is a condition of employment with Atlassian for employment fraud purposes.