Senior Scala/Spark Engineer - Data Analytics & Performance

SRS Consulting Inc; New York (NY); On-site; USD 120,000 - 170,000; Full time

Job summary

SRS Consulting Inc. is seeking a seasoned Scala/Spark developer in New York to design, implement, and optimize data processing solutions. The role demands hands-on expertise with Spark, Scala, and DB2 SQL, plus strong data analysis skills and experience with HDFS platforms.

Collaboration with multiple stakeholders and adherence to Agile practices are essential. The candidate will contribute to architecture, performance tuning, and end-to-end testing, ensuring scalable, reliable data pipelines

Qualifications

• 5+ years as a Hands On Scala/Spark developer.
• Hands on SQL writing skills on DB2 databases.
• Ability to optimize code for performance, scalability, and configurability.
• At least 2 years of experience in an HDFS platform development project.

Responsibilities

• Understand and implement tactical or strategic solutions for business problems.
• Discuss business needs and technology requirements with stakeholders.
• Define and derive strategic and tactical solutions as needed.
• Write technical designs and solution documents per Agile (SCRUM) standards.
• Perform data analysis to aid development and business needs.
• Perform unit testing of developed code leveraging automated BDD frameworks.
• Participate in testing to validate technology solutions.
• Follow MS standards for automated release processes across environments.
• Perform automated regression test suites and support UAT.
• Collaborate with FCT & NFRT teams.

Skills

Scala & Spark

SQL on DB2

Performance optimization

HDFS development

Data analysis & profiling

Communication

Job description

SRS Consulting Inc. is seeking a seasoned Scala/Spark developer in New York to design, implement, and optimize data processing solutions. The role demands hands-on expertise with Spark, Scala, and DB2 SQL, plus strong data analysis skills and experience with HDFS platforms.

Collaboration with multiple stakeholders and adherence to Agile practices are essential. The candidate will contribute to architecture, performance tuning, and end-to-end testing, ensuring scalable, reliable data pipelines