Junior Data Engineer: Scale Data Pipelines with Databricks

Remotedxb; Dubai; On-site; AED 180,000 - 320,000; Full time

Job summary

Capital Technology Group is seeking a data engineer to design and optimize scalable data pipelines leveraging Databricks, AWS, and SQL. You will collaborate with product and analytics teams in an agile environment to deliver reliable data models and insights from diverse data sources.

The role requires 1+ year of data engineering experience, hands-on AWS, Databricks, dbt, Python, and Java, plus the ability to mentor juniors and implement IaC with Terraform.

Qualifications

• 1+ years of professional experience in data engineering.
• Deep expertise in Databricks.
• Hands-on experience with AWS native services.
• Proficiency in dbt, SQL (PostgreSQL), Python, and Java.
• Experience with data pipelines, data modeling, and performance optimization.

Responsibilities

• Build and maintain scalable data pipelines and models using Databricks, dbt, and SQL
• Develop robust data solutions leveraging AWS services including Redshift, RDS, S3, Glue, Lambda, DMS, and CloudWatch
• Implement data transformations and integrations using Python and Java
• Implement infrastructure-as-code using Terraform
• Monitor and optimize system health and performance using CloudWatch and Splunk
• Mentor junior engineers and conduct code reviews
• Collaborate with cross-functional stakeholders in agile environments

Skills

Databricks

SQL

Python

Java

Data pipelines

Data modeling

Performance tuning

Education

Bachelor's degree in Computer Science, Engineering or related field

Tools

dbt

Terraform

Docker

Kubernetes

Splunk

Job description

Capital Technology Group is seeking a data engineer to design and optimize scalable data pipelines leveraging Databricks, AWS, and SQL. You will collaborate with product and analytics teams in an agile environment to deliver reliable data models and insights from diverse data sources.

The role requires 1+ year of data engineering experience, hands-on AWS, Databricks, dbt, Python, and Java, plus the ability to mentor juniors and implement IaC with Terraform.