Data Engineer ( AWS & Databricks)

Tekskills Inc.; Hyderabad; Híbrido; INR 1.200.000 - 1.800.000; Jornada completa

Descripción de la vacante

Tekskills Inc. is seeking an experienced Data Engineer in Hyderabad to join our growing data engineering team. The candidate will build scalable data pipelines with Databricks on AWS, delivering high-quality data solutions.

You will code in Python and Scala, design ETL processes, and orchestrate workflows. The role requires strong SQL skills, experience with data ingestion, and a proactive approach to performance tuning in an Agile environment.

Formación

• 3+ years hands-on Databricks experience.
• 5+ years in AWS data engineering services.
• Strong Python and Scala skills.
• Experience with ETL development and SQL.
• Knowledge of workflow orchestration tools.
• Agile experience with JIRA.

Responsabilidades

• Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and AWS services.
• Hands-on development using Python, Scala, and SQL.
• Orchestrate workflows and manage job scheduling.
• Optimize and monitor Databricks jobs for performance and reliability.
• Work with large-scale datasets and implement best practices for data ingestion and processing.
• Collaborate with cross-functional teams to translate business requirements into technical solutions.
• Root cause analysis and performance tuning.
• Document data engineering processes and developer guides.
• Work in an Agile environment using JIRA.
• Batch ETL experience is essential; real-time pipeline experience is a plus.
• Exposure to Google Cloud Platform (GCP) is a plus.

Conocimientos

Databricks

AWS

Python

Scala

SQL

ETL

Workflow orchestration

Monitoring

Root cause analysis

Agile

JIRA

Descripción del empleo

We are seeking an experienced and hands-on Data Engineer with strong expertise in AWS and Databricks to join our growing data engineering team. The ideal candidate will be passionate about building scalable data pipelines and delivering high-quality data solutions.

Responsibilities:

• Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and AWS services
• Hands-on development using Python, Scala, and SQL
• Orchestrate workflows and manage job scheduling
• Optimize and monitor Databricks jobs for performance and reliability
• Work with large-scale datasets and implement best practices for data ingestion and processing
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions
• Root cause analysis and performance tuning
• Document data engineering processes and developer guides
• Work in an Agile environment using tools like JIRA
• Batch ETL experience is essential; real-time pipeline experience is a plus
• Exposure to Google Cloud Platform (GCP) is a plus

Required Skills & Experience:

• 3+ years of hands-on experience with Databricks
• 5+ years of experience with AWS data engineering services
• Strong proficiency in Python and Scala
• Experience with ETL development and SQL
• Knowledge of workflow orchestration tools
• Experience with monitoring, tuning, and debugging Databricks jobs
• Ability to perform root cause analysis and improve data quality/processes
• Experience working in Agile teams and using JIRA