Senior Spark & Scala Data Lead (Hybrid)

BrightClaim; New York (NY); Hybrid; USD 80,000 - 100,000; Full time

Job summary

Genpact is seeking a Sr. Tech Lead for Application Development N to lead and shape data processing solutions using Spark and Scala.

You will collaborate with cross-functional teams to define data requirements, design scalable architectures, and drive reliable deployments in a hybrid environment in the United States. The role emphasizes hands-on leadership, performance optimization of Spark applications, and mentoring junior engineers.

Qualifications

• Bachelor's degrees in Computer Engineering, CS, Information Technology, or a related field.
• Advanced degree (Masters) in Software Engineering is a plus.
• Strong knowledge of Spark and Scala required.
• Experience with test-driven deployment practices is a plus.
• Excellent problem-solving and communication skills.

Responsibilities

• Develop and maintain data processing applications using Spark and Scala.
• Collaborate with cross-functional teams to understand data requirements and design efficient solutions.
• Implement test-driven deployment practices to enhance the reliability of application.
• Deploy artifacts from lower to higher environment ensuring smooth transition.
• Troubleshoot and debug Spark performance issues to ensure optimal data processing.
• Work in an agile environment, contributing to sprint planning, development and delivering high quality solutions on time.
• Provide essential support for production batches, addressing issues and providing fix to meet critical business needs.
• Strong knowledge of Scala programming language.
• Excellent problem-solving and analytical skills.
• Proficiency in Spark, including the development and optimization of Spark applications.
• Ability to troubleshoot and debug performance issues in Spark.
• Understanding of design patterns and data structures for efficient data processing.
• Familiarity with database concepts and SQL.
• Experience with test-driven deployment practices (Good to have).
• Familiarity with Python (Good to have).
• Knowledge of Databricks (Good to have).
• Understanding of Snowflake for data storage and retrieval (Good to have).
• Understanding of DevOps practices (Good to have).

Skills

Actimize

Agile Methodology

Scala (Programming Language)

Spark ML

Education

Bachelors - Computer Engineering

Bachelors - Computer Science

Bachelors - Information Technology

Masters - Software Engineering

Tools

Spark

Databricks

Snowflake

Python

DevOps

SQL

Job description

Genpact is seeking a Sr. Tech Lead for Application Development N to lead and shape data processing solutions using Spark and Scala.

You will collaborate with cross-functional teams to define data requirements, design scalable architectures, and drive reliable deployments in a hybrid environment in the United States. The role emphasizes hands-on leadership, performance optimization of Spark applications, and mentoring junior engineers.