AWS Databricks Engineer

Tekskills Inc.; Dadri; Sur place; INR 1 500 000 - 2 800 000; Plein temps

Résumé du poste

Tekskills Inc. is seeking an AWS Databricks Engineer to design, build, and optimize scalable data pipelines and analytics solutions on cloud platforms.

The ideal candidate should have hands-on experience with Databricks, Spark, PySpark, SQL and AWS services such as S3, Glue and Redshift, and will design ETL/ELT workflows while ensuring governance, security, and performance on Databricks clusters.

Qualifications

• Proficient in designing scalable data pipelines with Databricks and Spark.
• Strong SQL and Python (PySpark) skills for ETL/ELT workflows.
• Experience with AWS data services (S3, Glue, Redshift).

Responsabilités

• Design and develop scalable data pipelines using Databricks and Apache Spark
• Build ETL/ELT workflows using Python, SQL, and PySpark
• Integrate data from multiple sources (structured & unstructured)
• Optimize data processing and performance on Databricks clusters
• Work with AWS services like S3, Glue, Redshift, Lambda, EC2, and RDS
• Implement data governance, security, and best practices
• Collaborate with data engineers, analysts, and business stakeholders

Connaissances

Databricks

Spark

PySpark

SQL

AWS

Glue

Redshift

Outils

Delta Lake

MLflow

Airflow

Kafka

Description du poste

Job Summary

• We are looking for a skilled AWS Databricks Engineer to design, build, and optimize scalable data pipelines and analytics solutions on cloud platforms.


• The ideal candidate should have strong hands‑on experience with Databricks, Spark, and AWS services.

Responsibilities

• Design and develop scalable data pipelines using Databricks and Apache Spark


• Build ETL/ELT workflows using Python, SQL, and PySpark


• Integrate data from multiple sources (structured & unstructured)


• Optimize data processing and performance on Databricks clusters


• Work with AWS services like S3, Glue, Redshift, Lambda, EC2, and RDS


• Implement data governance, security, and best practices


• Collaborate with data engineers, analysts, and business stakeholders

Required Skills

• Databricks


• Spark


• PySpark


• SQL


• AWS


• Glue


• Redshift

Nice to Have

• Delta Lake


• MLflow


• Lakehouse architecture


• Airflow


• Kafka


• Streaming data pipelines

Immediate joiners preferred.