Principal Data Engineer

Hire Today; Bengaluru; On-site; INR 1,800,000 - 2,500,000; Full time

Job summary

Hire Today is seeking a Principal Data Engineer in Bengaluru, India to lead the architecture and evolution of scalable data engineering systems. You will mentor a team of data engineers and work on building large-scale streaming and batch data processing systems.

The ideal candidate should be well-versed in cloud technologies like AWS and have extensive experience in data engineering skills. This role is crucial for supporting business-critical decision making across the organization.

Qualifications

• Bachelor's degree in a relevant field.
• Experience leading Data Engineering teams is preferred.

Responsibilities

• Lead technical evolution of data engineering capabilities.
• Build streaming and batch data pipelines.
• Maintain operational data quality and system scalability.
• Mentor and coach data engineers.
• Coordinate cross-functional engineering initiatives.
• Drive technical direction and long-term maintainability.
• Work with analytics infrastructure and cloud technologies.

Skills

SQL

Spark

Redshift

Airflow

AWS

EMR

Flink

Hive

Kafka

Microservices

Cloud Computing

Batch Processing

Python

Scala

Analytics

Distributed Systems

Education

Bachelor's degree in Computer Science, Engineering, Data Science, or Information Technology

Job description

Atlassian is seeking a Principal Data Engineer to lead the architecture and evolution of scalable data engineering systems and analytics platforms supporting business critical decision making across the organization. The role involves technical leadership mentoring and building large scale streaming and batch data processing systems.

Responsibilities

• Lead technical evolution of data engineering capabilities
• build streaming and batch data pipelines
• maintain operational data quality and system scalability
• mentor and coach data engineers
• coordinate cross functional engineering initiatives
• drive technical direction and long term maintainability
• work with analytics infrastructure and cloud technologies

Skills required

• SQL
• Spark
• Redshift
• Airflow
• AWS
• EMR
• Flink
• Hive
• Kafka
• Microservices
• Cloud Computing
• Batch Processing
• Python
• Scala
• Analytics
• Distributed Systems

Minimum Qualifications

• Bachelor's degree in Computer Science Engineering Data Science Information Technology or related field

Preferred Qualifications

• Experience leading Data Engineering teams
• Experience with AWS data services and streaming architectures