AWS Databricks Engineer

Tekskills Inc.; Chennai; On-site; INR 1,800,000 - 2,600,000; Full time

Job summary

Tekskills Inc. is seeking a skilled AWS Databricks Engineer to design, build, and optimize scalable data pipelines and analytics solutions on cloud platforms. The ideal candidate should have strong hands-on experience with Databricks, Spark, and AWS services.

Responsibilities include designing data pipelines, building ETL/ELT workflows, integrating data from multiple sources, and collaborating with cross-functional teams to ensure governance and security of data assets.

Qualifications

• Strong hands-on experience with Databricks, Spark, and AWS services.
• Experience in designing, building and optimizing scalable data pipelines.
• Proficient in Python, SQL and PySpark for ETL/ELT workflows.
• Knowledge of data governance and security best practices.

Responsibilities

• Design and develop scalable data pipelines using Databricks and Apache Spark.
• Build ETL/ELT workflows using Python, SQL, and PySpark.
• Integrate data from multiple sources (structured & unstructured).
• Optimize data processing and performance on Databricks clusters.
• Work with AWS services like S3, Glue, Redshift, Lambda, EC2, and RDS.
• Implement data governance, security, and best practices.
• Collaborate with data engineers, analysts, and business stakeholders.

Skills

Databricks

Spark

PySpark

SQL

AWS

Glue

Redshift

Tools

Airflow

Kafka

Delta Lake

MLflow

Job description

Job Summary

• We are looking for a skilled AWS Databricks Engineer to design, build, and optimize scalable data pipelines and analytics solutions on cloud platforms.


• The ideal candidate should have strong hands‑on experience with Databricks, Spark, and AWS services.

Responsibilities

• Design and develop scalable data pipelines using Databricks and Apache Spark


• Build ETL/ELT workflows using Python, SQL, and PySpark


• Integrate data from multiple sources (structured & unstructured)


• Optimize data processing and performance on Databricks clusters


• Work with AWS services like S3, Glue, Redshift, Lambda, EC2, and RDS


• Implement data governance, security, and best practices


• Collaborate with data engineers, analysts, and business stakeholders

Required Skills

• Databricks


• Spark


• PySpark


• SQL


• AWS


• Glue


• Redshift

Nice to Have

• Delta Lake


• MLflow


• Lakehouse architecture


• Airflow


• Kafka


• Streaming data pipelines

Immediate joiners preferred.