Senior PySpark & Big Data Engineer

Infosys Limited; New York (NY); On-site; USD 82,000 - 127,000; Full time

Benefits offered by this job

Disability benefits

Health & dependent care

Insurance (various)

401(k) plan

Job summary

Infosys is seeking a Technology Consultant 2 in the Data and Analytics DNA unit to help transform data into actionable insights. Responsibilities span requirements elicitation, design discussions, coding, code reviews, testing, and training.

The role emphasizes end-to-end SDLC, collaboration across teams, and ensuring high software quality through structured testing and production support. Travel may be required.

Qualifications

• Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
• This position may require relocation and/or travel to work/project location.
• Candidates authorized to work for any employer in the United States without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role now or in the future.

Responsibilities

• Contribute to the requirements elicitation process by documenting assigned parts of business requirements, in line with guidance provided
• Facilitate software application design discussions, and document design decisions to guide the technical team towards building software solutions
• Participate in coding and integrate new features or updates into existing applications, with a focus on maintaining system stability
• Conduct code reviews, do changes to the codebase and maintain code repositories
• Implement test strategies, analyse results, and coordinate bug fixes to uphold the software quality standards
• Develop user training programs, documentation, and support frameworks to ensure a smooth transition to new software applications
• Actively participate in resolving production issues and recommend preventive strategies to enhance system reliability
• Maintain detailed records of code, testing techniques, and support activities to enrich the knowledge base and assist other similar projects

Skills

Big Data expertise

Spark/PySpark

SQL

Python

Shell scripting

Education

Bachelor's degree

Tools

Spark

Hadoop

HDFS

YARN

Confluent Kafka

HBase

Hive

Impala

NoSQL databases

Job description

Infosys is seeking a Technology Consultant 2 in the Data and Analytics DNA unit to help transform data into actionable insights. Responsibilities span requirements elicitation, design discussions, coding, code reviews, testing, and training.

The role emphasizes end-to-end SDLC, collaboration across teams, and ensuring high software quality through structured testing and production support. Travel may be required.