Senior PySpark Engineer - Data & AI Platforms

Infosys; Richardson (TX); On-site; USD 120,000 - 150,000; Full time

Benefits offered by this job

Medical/Dental/Vision/Life Insurance

Long-term/Short-term Disability

401(k) plan

Paid holidays plus PTO

Job summary

Infosys is seeking a Technology Consultant 2 in the US to drive data and analytics initiatives using Databricks, AWS, Python/PySpark, and SQL. You will work across the full SDLC, design software, write code, review changes, and ensure reliability of data pipelines.

The role emphasizes translating complex requirements into actionable tasks, collaborating with cross-functional teams, and delivering scalable data solutions in a fast-paced environment.

Qualifications

• Experience with Databricks, AWS, Python/PySpark, Scala, Spark, Kafka and SQL.
• Familiarity with Unity Catalog and data engineering concepts.
• Ability to translate business requirements into technical tasks.

Responsibilities

• Contribute to requirements elicitation and document business requirements.
• Facilitate software design discussions and document design decisions.
• Participate in coding and integrate features into applications.
• Conduct code reviews and maintain repositories.
• Implement test strategies, analyze results, and coordinate fixes.
• Develop user training materials and support frameworks.
• Resolve production issues and recommend preventive measures.
• Maintain records of code, tests, and support activities.

Skills

Databricks

AWS

Python/PySpark

Scala

Spark

Kafka

Unity Catalog

SQL

Education

Bachelor’s degree or foreign equivalent

Job description

Infosys is seeking a Technology Consultant 2 in the US to drive data and analytics initiatives using Databricks, AWS, Python/PySpark, and SQL. You will work across the full SDLC, design software, write code, review changes, and ensure reliability of data pipelines.

The role emphasizes translating complex requirements into actionable tasks, collaborating with cross-functional teams, and delivering scalable data solutions in a fast-paced environment.