Data Engineer ( AWS & Databricks)

Tekskills Inc.; Mumbai; Hybrid; INR 1,500,000 - 2,400,000; Full time

Job summary

Tekskills Inc. in Mumbai is seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines using AWS, Databricks, Python, and SQL. The role involves hands-on development, batch ETL, and collaboration with cross-functional teams in an Agile environment.

You will work with large-scale datasets, implement best practices for ingestion and processing, and monitor Databricks jobs to ensure reliability and performance. Prior exposure to GCP is a plus.

Qualifications

• 3+ years hands-on Databricks experience.
• 5+ years AWS data engineering experience.
• Strong Python and Scala programming skills.
• Proficient in ETL development and SQL.
• Experience with workflow orchestration and monitoring Databricks jobs.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and AWS.
• Develop with Python, Scala, and SQL.
• Orchestrate workflows and manage job scheduling.
• Monitor and tune Databricks jobs for performance.
• Work with large-scale datasets and ensure data quality.
• Collaborate with cross-functional teams to translate requirements into solutions.
• Perform root cause analysis and documentation of processes.
• Participate in Agile teams and use JIRA.

Skills

Databricks expertise

AWS data engineering

Python

Scala

ETL development

SQL

Workflow orchestration

Monitoring & debugging Databricks

Root cause analysis

Agile / JIRA

Tools

JIRA

Job description

Job Description:

We are seeking an experienced and hands-on Data Engineer with strong expertise in AWS and Databricks to join our growing data engineering team. The ideal candidate will be passionate about building scalable data pipelines and delivering high-quality data solutions.

Responsibilities:

• Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and AWS services
  
• Hands-on development using Python, Scala, and SQL
  
• Orchestrate workflows and manage job scheduling
  
• Optimize and monitor Databricks jobs for performance and reliability
  
• Work with large-scale datasets and implement best practices for data ingestion and processing
  
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions
  
• Root cause analysis and performance tuning
  
• Document data engineering processes and developer guides
  
• Work in an Agile environment using tools like JIRA
  
• Batch ETL experience is essential; real-time pipeline experience is a plus
  
• Exposure to Google Cloud Platform (GCP) is a plus

Required Skills & Experience:

• 3+ years of hands-on experience with Databricks
  
• 5+ years of experience with AWS data engineering services
  
• Strong proficiency in Python and Scala
  
• Experience with ETL development and SQL
  
• Knowledge of workflow orchestration tools
  
• Experience with monitoring, tuning, and debugging Databricks jobs
  
• Ability to perform root cause analysis and improve data quality/processes
  
• Experience working in Agile teams and using JIRA