Hadoop & PySpark Data Engineer | Big Data Innovator

Mary Dickson; Newark (DE); On-site; USD 82,000 - 127,000; Full time

Benefits offered by this job

Medical/Dental/Vision/Life Insurance

Long-term/Short-term Disability

Health and Dependent Care Reimburse- m

401(k) plan

Paid holidays

Paid Time Off

Job summary

Infosys Limited is seeking a Technology Consultant 2 in the US to contribute across the SDLC, from requirements to implementation. The role emphasizes data warehousing, Hadoop-based tech, and production-grade Big Data pipelines using Python, PySpark, and SQL.

You will collaborate with cross-functional teams to design, develop, and deploy robust data solutions. You will engage in code reviews, testing, and operational support, while ensuring smooth knowledge transfer and training for user

Qualifications

• Experience in data warehousing architectures and design.
• Proficient with Hadoop ecosystem (Cloudera) and Big Data tech (Hive, Spark, PySpark).
• Strong Python and Unix shell scripting skills; experience with production Big Data environments.
• Knowledge of Autosys/Airflow for orchestration and SQL in large systems.
• Familiarity with Agile methodologies and cloud/containerization basics.

Responsibilities

• Contribute to requirements elicitation and document business needs.
• Facilitate design discussions and document decisions for development teams.
• Code, integrate features, review code, and maintain repositories.
• Implement test strategies, analyze results, and coordinate bug fixes.
• Develop training materials and support frameworks for new software.
• Resolve production issues and propose preventive reliability measures.

Skills

Data warehousing

Hadoop

Big Data

Python

Unix shell scripting

Agile methodologies

Education

Bachelor's degree or foreign equivalent

Tools

Hadoop ecosystem (Cloudera)

Hive

Spark

PySpark

Autosys

Airflow

SQL

Cloud

Containerization

Tableau

Job description

Infosys Limited is seeking a Technology Consultant 2 in the US to contribute across the SDLC, from requirements to implementation. The role emphasizes data warehousing, Hadoop-based tech, and production-grade Big Data pipelines using Python, PySpark, and SQL.

You will collaborate with cross-functional teams to design, develop, and deploy robust data solutions. You will engage in code reviews, testing, and operational support, while ensuring smooth knowledge transfer and training for user