Principal Data Engineer

Atlassian; India; On-site; INR 4,000,000 - 7,000,000; Full time

Benefits offered by this job

Flexible location

Equity

Bonus/Commission eligibility

Job summary

Atlassian is seeking a Principal Data Engineer to join the Data Engineering Team as a tech lead and architect. You will build world-class data solutions powering crucial business decisions, shaping data models, and enabling a data-driven culture across the organization.

You will own the technical evolution of data capabilities, coordinate across teams, and drive scalable data pipelines with high data quality and security.

Qualifications

• 12+ years in a Data Engineer role as an individual contributor.
• At least 2 years of experience as a tech lead for a Data Engineering team.
• Experience delivering large, multi-team data initiatives.
• Strong cross-team communication and stakeholder management.
• Experience building streaming pipelines and low-latency analytics.
• Experience with SQL, Spark, Redshift, and AWS data services.

Responsibilities

• Own the technical evolution of data engineering capabilities.
• Direct and coordinate technical work across data engineering teams.
• Maintain data quality and address performance, scale, and security considerations.
• Set technical direction balancing customer needs with maintainability.
• Architect solutions and coordinate engineers toward implementation.
• Mentor and coach a team of data engineers and collaborate with adjacent teams.
• Collaborate with other departments to build a multi-functional team.

Skills

Data engineering

Technical leadership

Communication

Tools

SQL

Spark

Redshift

Airflow

Kafka

Hive

Flink

Job description

Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity.

Atlassian is looking for a Principal Data Engineer to join our Data Engineering Team and play a tech lead & architect role to build world-class data solutions and applications that power crucial business decisions throughout the organization. We are looking for an open-minded, structured thinker who is passionate about building systems at scale. You will enable a world-class engineering practice, drive the approach with which we use data, develop backend systems and data models to serve the needs of insights and play an active role in building Atlassian's data-driven culture.

Own the technical evolution of the data engineering capabilities and be responsible for ensuring solutions are being delivered incrementally, meeting outcomes, and promptly escalating risks and issues

Establish a deep understanding of how things work in data engineering, use this to direct and coordinate the technical aspects of work across data engineering, and systematically improve productivity across the teams.

Maintain a high bar for operational data quality and proactively address performance, scale, complexity and security considerations.

Drive complex decisions that can impact the work in data engineering. Set the technical direction and balance customer and business needs with long-term maintainability & scale.

Understand and define the problem space, and architect solutions. Coordinate a team of engineers towards implementing them, unblocking them along the way if necessary.

Lead a team of data engineers through mentoring and coaching, work closely with the engineering manager, and provide consistent feedback to help them manage and grow the team

Work with close counterparts in other departments as part of a multi-functional team, and build this culture in your team.

At Atlassian, we strive to design equitable, explainable, and competitive compensation programs. We follow consistent hiring practices and account for each candidate’s skills, knowledge, and experience when setting base pay within the range.

This role may also be eligible for benefits, bonuses, commissions, and equity.

On your first day, we'll expect:

• You have 12+ years of experience in a Data Engineer role as an individual contributor.
• You have at least 2 years of experience as a tech lead for a Data Engineering team.
• You are an engineer with a track record of driving and delivering large (multi-person or multi-team) and complex efforts.
• You are a great communicator and maintain many of the essential cross-team and cross-functional relationships necessary for the team's success.
• Experience with building streaming pipelines with a micro-services architecture for low-latency analytics.
• Experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, and column stores (e.g. Redshift)
• Experience building scalable data pipelines using Spark using Airflow scheduler/executor framework or similar scheduling tools.
• Experience working in a technical environment with the latest technologies like AWS data services (Redshift, Athena, EMR) or similar Apache projects (Spark, Flink, Hive, or Kafka).
• Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team.
• Industry experience working with large-scale