Hadoop PySpark Data Engineer – Big Data Innovator

Infosys; Charlotte (NC); On-site; USD 82,419 - 126,600; Full time

Benefits offered by this job

Medical insurance

Long-term/Short-term disability

401(k) plan

Job summary

Infosys is seeking a Technology Consultant 2 to contribute to data and analytics initiatives, focusing on capturing business requirements, guiding design discussions, and integrating new features into our software stack. The role involves hands-on coding, code reviews, and maintaining robust test strategies to ensure quality.

You will work with Hadoop ecosystem components (Cloudera), Spark, Hive, and cloud-based data platforms, collaborating with cross-functional teams to deliver

Qualifications

• Experience with data warehousing and big data tools in production environments.
• Proficiency in Python and SQL for data processing tasks.
• Experience with ETL/ELT processes and data modeling.

Responsibilities

• Document business requirements and guide software design decisions.
• Participate in coding and integrate new features into applications.
• Conduct code reviews and maintain repositories.
• Implement test strategies and coordinate bug fixes.
• Develop user training materials and support frameworks.
• Resolve production issues and improve system reliability.

Skills

Data warehousing

Hadoop (Cloudera)

Python

Unix shell scripting

Autosys

Airflow

SQL

Agile methodologies

Education

Bachelor's degree

Tools

Hive

Spark

Google Cloud / cloud basics

Job description

Infosys is seeking a Technology Consultant 2 to contribute to data and analytics initiatives, focusing on capturing business requirements, guiding design discussions, and integrating new features into our software stack. The role involves hands-on coding, code reviews, and maintaining robust test strategies to ensure quality.

You will work with Hadoop ecosystem components (Cloudera), Spark, Hive, and cloud-based data platforms, collaborating with cross-functional teams to deliver