Spark Scala Developer

Infosys; Hyderabad; On-site; INR 800,000 - 1,200,000; Full time

Job summary

Infosys in Hyderabad is seeking a skilled data engineer to design and maintain Spark-based data processing pipelines. The ideal candidate will have a Bachelor's degree in Engineering or Computer Science and considerable experience in Spark, Scala, and SQL optimization.

Your role will include performance tuning and ensuring data quality and reliability while collaborating with stakeholders to deliver technical solutions. Strong analytical skills and problem-solving abilities are essential.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 5+ years of experience with strong hands-on development in Spark and Scala.
• Solid experience writing and optimizing SQL for analytics.

Responsibilities

• Design, develop, and maintain Spark-based batch processing pipelines.
• Tune Spark jobs for improved performance and efficiency.
• Collaborate with stakeholders to translate data requirements into technical solutions.

Skills

Spark development

Scala programming

SQL optimization

Data quality assurance

Data engineering

Education

Bachelor of Engineering in Computer Science or related field

Tools

Apache Spark

Scala

Job description

Educational Requirements

Bachelor of Engineering

Service Line

Data Analytics Unit

Responsibilities

• Data Engineering Development – Design, develop, and maintain Spark-based batch processing pipelines using Scala for large datasets.
• Implement efficient transformations, aggregations, and joins, ensuring correctness and scalability.
• Write optimized SQL for data extraction, validation, and reconciliation across sources and targets.
• Performance, Quality Reliability – Tune Spark jobs (partitioning, caching, shuffles, memory/executor settings) to improve runtime and cost efficiency.
• Build data quality checks and validations to ensure accuracy, completeness, and consistency of outputs.
• Troubleshoot production issues, perform root-cause analysis, and implement preventive fixes.
• Collaboration, Delivery – Work with stakeholders to understand data requirements and translate them into technical solutions.
• Participate in code reviews, follow engineering best practices, and contribute to reusable components.
• Document pipelines, logic, and operational runbooks for maintainability and onboarding.

Qualifications

• Bachelors degree in Computer Science, Engineering, or a related field (or equivalent practical experience).
• 59 years of overall experience with strong hands-on development in Spark and Scala.
• Solid experience writing and optimizing SQL for analytics and data processing use cases.
• Strong understanding of distributed processing concepts, data transformations, and performance considerations.
• Ability to debug and resolve issues in data pipelines with a focus on reliability and quality.

Technical and Professional Requirements

• Technology->Big Data - Data Processing->Spark
• Technology->Java->Apache->Scala

Preferred Skills

• Technology->Java->Apache->Scala
• Technology->Big Data - Data Processing->Spark