Azure Data Engineer: Databricks & Data Migration (Sydney)

Tata Consultancy Services; Sydney; On-site; AUD 150,000 - 190,000; Full time

Benefits offered by this job

Competitive salary

Global exposure

Certification support

Career progression

Job summary

Tata Consultancy Services in Sydney is seeking an experienced Data Engineer to design, implement, and maintain data pipelines migrating data from Salesforce, Oracle, and SQL Server to Azure Databricks. You will work with data architects, analysts, and other engineers to deliver scalable cloud-based data solutions.

The role emphasizes data governance, security, and optimal performance across Azure services, including Data Lake and Synapse, with opportunities to grow through certifications and

Qualifications

• 7+ years of data engineering experience, including Azure-based migrations.
• Hands-on experience with Salesforce, Oracle, and SQL Server migrations to Azure Databricks.
• Proficiency in Python, Spark, SQL, and Databricks notebooks.
• Strong ETL, data modeling, and data governance knowledge.
• Experience with Azure Data Lake, Synapse, and cloud architectures.

Responsibilities

• Design, implement, and maintain data pipelines migrating data to Azure Databricks.
• Collaborate with data architects and stakeholders to define migration requirements.
• Perform end-to-end ETL using Azure Databricks and related services.
• Develop and optimize data workflows for performance and reliability.
• Ensure data governance, security, and compliance within migration processes.
• Provide ongoing support and enhancements to pipelines and models.
• Document pipeline designs, codebases, and migration procedures.
• Own delivery responsibility for Engineering – Commercials stream.

Skills

Azure Databricks

Ms Fabric

Python

Spark

SQL

ETL

Data governance

Git & CI/CD

Azure Data Lake

Azure Synapse Analytics

Tools

Azure Databricks

Microsoft Fabric

Git

CI/CD

Azure Data Lake

Azure Synapse Analytics

Databricks notebooks

Job description

Tata Consultancy Services in Sydney is seeking an experienced Data Engineer to design, implement, and maintain data pipelines migrating data from Salesforce, Oracle, and SQL Server to Azure Databricks. You will work with data architects, analysts, and other engineers to deliver scalable cloud-based data solutions.

The role emphasizes data governance, security, and optimal performance across Azure services, including Data Lake and Synapse, with opportunities to grow through certifications and