AWS Databricks Developer

Tata Consultancy Services; Hyderabad, Bengaluru; On-site; INR 2,500,000 - 4,200,000; Full time

Job summary

Tata Consultancy Services invites applications for an AWS Databricks Developer with 7+ years of experience to design and develop scalable data-processing applications using Apache Spark and Scala.

You will deploy Scala-based JARs on AWS Databricks clusters, build high-volume batch and streaming pipelines, and implement ETL/ELT workflows while integrating with AWS services like S3, Glue and Redshift.

Qualifications

• 7+ years of experience in data engineering or related roles.
• Strong experience with Apache Spark and Scala.
• Experience deploying Scala-based applications on AWS Databricks.
• Experience building ETL/ELT pipelines.
• Proficient with AWS services and data warehousing concepts.

Responsibilities

• Design and develop scalable data-processing applications using Apache Spark and Scala.
• Develop reusable frameworks, utilities, and libraries and package them as JAR files.
• Deploy and execute Scala-based JAR applications on AWS Databricks clusters.
• Build and maintain high-volume batch and streaming data pipelines.
• Develop ETL and ELT workflows using Databricks, Spark, Scala, and SQL.
• Integrate Databricks with AWS services such as S3, Glue, IAM, Secrets Manager, CloudWatch, and Redshift.

Skills

Apache Spark

Scala

Databricks

AWS services

SQL

ETL/ELT

Streaming data

Tools

Databricks

Job description

Job Description

TCS invites application for AWS Databricks Developer

Experience Range: 7+ Years

Location: Bangalore/ Hyderabad

Notice Period: 60 days or less

• Design and develop scalable data-processing applications using Apache Spark and Scala.
• Develop reusable frameworks, utilities, and libraries and package them as JAR files.
• Deploy and execute Scala-based JAR applications on AWS Databricks clusters.
• Build and maintain high-volume batch and streaming data pipelines.
• Develop ETL and ELT workflows using Databricks, Spark, Scala, and SQL.
• Integrate Databricks with AWS services such as S3, Glue, IAM, Secrets Manager, CloudWatch, and Redshift.