Data Engineer(Scala) – 5 Years to 15 Years – Hyderabad & Bengaluru

Theitmind

Hyderabad

On-site

INR 1,500,000 - 2,900,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Theitmind is hiring a seasoned Data Engineer (Scala) to join our Hyderabad & Bengaluru team. You will work across big data processing stacks, leveraging Hadoop, Kafka, Spark, and Spark Structured Streaming.

You will craft robust software with SOLID principles, build scalable pipelines, and drive data quality initiatives. You will also contribute to automated testing, containerized deployments, and CI/CD pipelines using Jenkins, Maven, GitHub, and GitHub Actions.

Qualifications

  • Must have experience with Scala + Spark + Airflow + Docker/Kubernetes
  • Scala coding experience
  • Spark
  • Airflow
  • Docker

Responsibilities

  • Big Data Processing using Hadoop, Kafka, Spark and Spark Structured Streaming.
  • Follow SOLID & DRY principles with good software architecture and design implementation.
  • Develop advanced Scala code with functional programming, case classes, and complex data structures/algorithms.
  • Create automated frameworks for unit and integration testing.
  • Deploy and manage Spark workloads on Kubernetes clusters.
  • Implement data validation and data quality checks.
  • Handle DevOps tasks with Jenkins, Maven, GitHub, GitHub Actions, CI/CD.

Skills

Scala
Spark
Airflow
Hadoop
Kafka
Spark Structured Streaming
CI/CD

Tools

Docker
Kubernetes
Jenkins
Maven
GitHub
GitHub Actions

Job description

Data Engineer(Scala) – 5 Years to 15 Years – Hyderabad & Bengaluru

Experience: 5–12 years

Job Description:

  • Big Data Processing: Hadoop, Kafka, Spark & Spark Structured Streaming.
  • Experience on SOLID & DRY principles with Good Software Architecture & Design implementation experience
  • Advanced Scala experience (e.g. Functional Programming, using Case classes, Complex Data Structures & Algorithms)
  • Proficient in developing automated frameworks for unit & integration testing.
  • Experience with Docker and Helm and related container technologies.
  • Proficient in deploying and managing Spark workloads on Kubernetes clusters.
  • Experience in evaluation and implementation of Data Validation & Data Quality
  • Devops experience in Jenkins, Maven, Github, Github actions, CI/CD

Must Have exp in the following:

  • (Scala + Spark + Airflow + Docker/Kubernetes)
  • Scala Coding Exp
  • Spark
  • Airflow
  • Docker
Required Experience: 5 Years to 15 Years

Our Team will get in touch with you and get you started on your journey.

Specialists in End-to-End BPM Suite Implementation and Delivery Services.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Big Data Engineer
Big Data Engineer

Global Infovision • Chennai, Bengaluru

Hybrid
INR 1,500,000 - 2,600,000
Data Engineer
Data Engineer

Altysys • Gurugram District

On-site
INR 800,000 - 1,200,000
Big Data Engineer (5-15 Years)
Big Data Engineer (5-15 Years)

Infosys • Dadri, Hyderabad, Bengaluru

Remote
INR 1,200,000 - 2,200,000
Big Data Engineer
Big Data Engineer

Infosys • Hyderabad, Pune District, Bengaluru

On-site
INR 1,200,000 - 2,000,000
Data Engineer
Data Engineer

Crayon Data • Chennai District

On-site
INR 800,000 - 1,200,000
Senior Data Engineer
Senior Data Engineer

INFOSLAB CONSULTANCY PRIVATE LIMITED • Hyderabad

On-site
INR 1,200,000 - 1,800,000
Data Engineer
Data Engineer

Cortex Consultants LLC • Hyderabad

On-site
INR 1,200,000 - 2,400,000
Senior Data Engineer
Senior Data Engineer

Distilhire • Bengaluru

Hybrid
INR 2,500,000 - 4,000,000
Data Engineer
Data Engineer

novio • Mumbai

On-site
INR 800,000 - 1,500,000
Data Engineer
Data Engineer

MINDTEL • Pune District

Hybrid
INR 1,200,000 - 2,100,000