Data Engineer

AS Technology Corporation; Hyderabad; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

A leading technology firm in Hyderabad is seeking a skilled Big Data Developer to build scalable data processing systems. The ideal candidate must have expertise in Java, Python, or Scala and experience with Big Data technologies. Essential duties include developing data processing pipelines and working with Apache Kafka and Spark Streaming. This role requires problem-solving skills and a good understanding of the Big Data ecosystem. Strong background in data engineering is a plus.

Qualifications

• Strong programming experience in Java, Python or Scala.
• Hands-on experience with Kafka and Spark Streaming.
• Experience with Big Data ecosystem tools.

Responsibilities

• Develop and maintain scalable data processing pipelines using Big Data technologies.
• Work with Apache Kafka for real-time data ingestion and streaming.
• Build and manage real-time data processing applications using Spark Streaming.

Skills

Java

Python

Scala

Kafka

Spark Streaming

Big Data technologies

Problem-solving

Tools

Databricks

Apache Kafka

Spark

Job description

We are looking for a skilled Big Data Developer with strong programming expertise and experience in building scalable data processing systems. The ideal candidate should have hands-on experience in Java, Python, or Scala along with strong knowledge of Big Data technologies.

Key Responsibilities:

• Develop and maintain scalable data processing pipelines using Big Data technologies.
• Work with Apache Kafka for real-time data ingestion and streaming.
• Build and manage real-time data processing applications using Spark Streaming.
• Write efficient and high-quality code using Java, Python, or Scala.
• Optimize and manage large-scale data workflows and streaming architectures.
• Collaborate with cross-functional teams to design and implement data solutions.

Required Skills:

• Strong programming experience in Java / Python / Scala.
• Experience with Big Data ecosystem tools.
• Hands-on experience with Kafka and Spark Streaming.
• Strong problem‑solving skills and programming fundamentals.

Good to Have:

• Experience with Databricks.
• Strong background in data engineering and distributed systems.