Data Engineer ( AWS & Databricks)

Tekskills Inc.; Delhi; Hybrid; INR 1,500,000 - 2,600,000; Full time

Job summary

Tekskills Inc. is seeking an experienced Data Engineer with strong AWS and Databricks expertise to build scalable data pipelines and deliver high-quality data solutions.

You will design, develop, and maintain ETL processes, write Python and Scala code, and optimize Databricks jobs for performance and reliability. Work with large-scale datasets, implement ingestion best practices, orchestrate workflows, monitor pipelines, and collaborate with cross-functional teams in an Agile environment using

Qualifications

• 3+ years of hands-on experience with Databricks.
• 5+ years of experience with AWS data engineering services.
• Strong proficiency in Python and Scala.
• Experience with ETL development and SQL.
• Knowledge of workflow orchestration tools.
• Experience with monitoring, tuning, and debugging Databricks jobs.
• Ability to perform root cause analysis and improve data quality/processes.
• Experience working in Agile teams and using JIRA.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and AWS services.
• Hands-on development using Python, Scala, and SQL.
• Orchestrate workflows and manage job scheduling.
• Optimize and monitor Databricks jobs for performance and reliability.
• Work with large-scale datasets and implement best practices for data ingestion and processing.
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
• Root cause analysis and performance tuning.
• Document data engineering processes and developer guides.
• Work in an Agile environment using JIRA.
• Batch ETL experience is essential; real-time pipeline experience is a plus.
• Exposure to Google Cloud Platform (GCP) is a plus.

Skills

Databricks

AWS

Python

Scala

SQL

ETL

Workflow Orchestration

JIRA

Monitoring

Root Cause Analysis

Agile

Job description

Job Description:

We are seeking an experienced and hands-on Data Engineer with strong expertise in AWS and Databricks to join our growing data engineering team. The ideal candidate will be passionate about building scalable data pipelines and delivering high-quality data solutions.

Responsibilities:

• Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and AWS services
  
• Hands-on development using Python, Scala, and SQL
  
• Orchestrate workflows and manage job scheduling
  
• Optimize and monitor Databricks jobs for performance and reliability
  
• Work with large-scale datasets and implement best practices for data ingestion and processing
  
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions
  
• Root cause analysis and performance tuning
  
• Document data engineering processes and developer guides
  
• Work in an Agile environment using tools like JIRA
  
• Batch ETL experience is essential; real-time pipeline experience is a plus
  
• Exposure to Google Cloud Platform (GCP) is a plus

Required Skills & Experience:

• 3+ years of hands-on experience with Databricks
  
• 5+ years of experience with AWS data engineering services
  
• Strong proficiency in Python and Scala
  
• Experience with ETL development and SQL
  
• Knowledge of workflow orchestration tools
  
• Experience with monitoring, tuning, and debugging Databricks jobs
  
• Ability to perform root cause analysis and improve data quality/processes
  
• Experience working in Agile teams and using JIRA