AWS Databricks Engineer

Tekskills; Gurugram District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Tekskills is seeking an experienced AWS Databricks Engineer to design, develop, and optimize scalable data pipelines on cloud platforms. You will work hands-on with Databricks, Apache Spark, PySpark, SQL, and AWS services to build reliable data processing solutions that scale with business needs.

Collaborate with data engineers, analysts, and business teams to ensure data quality, performance, and governance.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field.
• Strong hands-on experience with Databricks, Spark, PySpark, SQL, and AWS.
• Experience designing scalable data pipelines and data warehousing.

Responsibilities

• Design and develop scalable data pipelines using Databricks and PySpark.
• Build and maintain ETL/ELT workflows for large-scale data processing.
• Work with AWS services such as S3, Glue, Redshift, EMR, and Lambda.
• Develop and optimize SQL queries for large datasets.
• Implement data warehousing and lakehouse architectures.
• Collaborate with data engineers, analysts, and business teams to support analytics and reporting requirements.
• Ensure data quality, performance optimization, and scalability of data pipelines.

Skills

Databricks

Spark

PySpark

SQL

AWS

ETL Pipelines

Data warehousing

Performance tuning

Education

Bachelors in CS/Engineering

Tools

Delta Lake

Airflow

Kafka

S3

Redshift

Job description

Job Summary

We are looking for an experienced AWS Databricks Engineer to design, develop, and optimize scalable data pipelines and data processing solutions on cloud platforms. The ideal candidate should have strong hands-on experience with Databricks, Spark, PySpark, SQL, and AWS services.

Job Details

• Notice Period: Immediate Joiners Preferred

Responsibilities

• Design and develop scalable data pipelines using Databricks and PySpark.
• Build and maintain ETL/ELT workflows for large-scale data processing.
• Work with AWS services such as S3, Glue, Redshift, EMR, and Lambda.
• Develop and optimize SQL queries for large datasets.
• Implement data warehousing and lakehouse architectures.
• Collaborate with data engineers, analysts, and business teams to support analytics and reporting requirements.
• Ensure data quality, performance optimization, and scalability of data pipelines.

Required Skills

• Strong hands-on experience with Databricks, Apache Spark, and PySpark.
• Advanced proficiency in SQL.
• Experience building ETL / ELT pipelines.
• Hands-on experience with AWS services (S3, Glue, Redshift, EMR, Lambda).
• Experience with data warehousing and big data technologies.
• Strong understanding of data pipeline architecture and performance optimization.

Nice to Have

• Experience with Delta Lake / MLflow / Lakehouse architecture.
• Exposure to Airflow, Kafka, or streaming data pipelines.
• Experience working in cloud-based data platforms.

Education

• Bachelors degree in Computer Science, Engineering, or related field.