PySpark Engineer for Big Data & AI Solutions

Infosys; New York (NY); On-site; USD 82,000 - 127,000; Full time

Benefits offered by this job

Medical/Dental/Vision

401(k) plan

Paid holidays

Paid Time Off

Long‑term/Short‑term Disability

Job summary

Infosys DNA unit seeks a Technology Consultant 2 to contribute to data analytics solutions. You will document requirements, guide design discussions, code and review, implement tests, and help deploy scalable data-driven applications across a fast‑moving enterprise.

Ideal candidates have strong Spark/Hadoop ecosystem experience, NoSQL, and Python scripting. Relocation/travel may be required; US work authorization is essential.

Qualifications

• Bachelor’s degree required or foreign equivalent; three years of progressive experience may be considered in lieu of education.
• Willingness to relocate and travel to work/project locations.
• Authorized to work in the United States without visa sponsorship.

Responsibilities

• Contribute to requirements elicitation by documenting business requirements.
• Facilitate software design discussions and document design decisions.
• Participate in coding and integrate features into existing applications while maintaining stability.
• Conduct code reviews and maintain code repositories.
• Implement test strategies, analyze results, and coordinate bug fixes.
• Develop user training materials, documentation, and support frameworks.
• Resolve production issues and propose preventive strategies for reliability.
• Maintain records of code, testing techniques, and support activities.

Skills

Spark

Hadoop

HDFS

YARN

Confluent Kafka

HBase

Hive

Impala

NoSQL

PySpark

SQL

Python

Shell scripting

Education

Bachelor’s degree or foreign equivalent

Job description

Infosys DNA unit seeks a Technology Consultant 2 to contribute to data analytics solutions. You will document requirements, guide design discussions, code and review, implement tests, and help deploy scalable data-driven applications across a fast‑moving enterprise.

Ideal candidates have strong Spark/Hadoop ecosystem experience, NoSQL, and Python scripting. Relocation/travel may be required; US work authorization is essential.