Data Engineer - Hadoop & PySpark Expert

Infosys; Charlotte (TX); On-site; USD 82,000 - 127,000; Full time

Benefits offered by this job

Medical/Dental/Vision/Life Insurance

Long-term/Short-term Disability

401(k) plan

Paid holidays plus Paid Time Off

Job summary

Infosys invites applications for Technology Consultant 2 in the Financial Services unit. The role focuses on requirements elicitation, design discussions, coding, testing, and deployment of data-intensive applications.

You will work with Hadoop ecosystems, Python scripting, and orchestration tools (Airflow, Autosys) to deliver scalable solutions across banking, wealth management, and insurance sectors.

Qualifications

• Bachelor’s degree or foreign equivalent from an accredited institution.
• Will consider three years of progressive experience in lieu of every year of education.
• Experience in data warehousing architectures.
• Experience with Hadoop ecosystem (Cloudera).
• Experience with Big Data technologies like Hadoop, Hive, Spark; Python and Unix shell scripting.
• Experience with orchestration tools like Autosys, Airflow.
• Knowledge of SQL and large SQL-based systems.
• Understanding of Agile methodologies and technologies.

Responsibilities

• Contribute to requirements elicitation by documenting parts of business requirements.
• Facilitate software design discussions and document decisions for the team.
• Participate in coding and integrate new features into existing apps.
• Conduct code reviews and maintain code repositories.
• Implement test strategies and coordinate bug fixes.
• Develop user training and documentation for new software.
• Resolve production issues and propose preventive improvements.
• Maintain detailed records for knowledge sharing.

Skills

Data warehousing

Big Data

Python

Unix shell scripting

SQL

Agile methodologies

Cloud and containerization

Education

Bachelor’s degree or foreign equivalent

Three years progressive experience in lieu of education

Tools

Hadoop

Cloudera

Airflow

Autosys

Tableau

Job description

Infosys invites applications for Technology Consultant 2 in the Financial Services unit. The role focuses on requirements elicitation, design discussions, coding, testing, and deployment of data-intensive applications.

You will work with Hadoop ecosystems, Python scripting, and orchestration tools (Airflow, Autosys) to deliver scalable solutions across banking, wealth management, and insurance sectors.