Big Data Engineer — Hadoop & PySpark

Infosys; Charlotte (TX); On-site; USD 82,000 - 127,000; Full time

Benefits offered by this job

Medical insurance

401(k) plan

Paid holidays

Disability insurance

Paid Time Off

Job summary

Infosys DNA invites a Technology Consultant 2 to drive data warehousing initiatives and AI-powered analytics. You will contribute to requirements, design discussions, and coding efforts while ensuring system stability and quality.

The role emphasizes cross-functional collaboration and end-to-end SDLC delivery in a fast‑paced environment. You will engage in data warehousing, Hadoop, Hive, Spark, Python, and SQL in production settings, employing tools like Autosys and Airflow to orchestrate

Qualifications

• Experience in data warehousing architectural approaches.
• Cloudera Hadoop ecosystem experience.
• Big Data production environment experience.
• Experience with Hadoop, Hive, Spark, Python, and Unix scripting.
• Experience with orchestration tools like Autosys and Airflow.
• Strong SQL knowledge and large relational database experience.
• Understanding of Agile methodologies.

Responsibilities

• Document assigned parts of business requirements per guidance.
• Facilitate design discussions and record decisions to guide development.
• Participate in coding and integrate features into applications.
• Conduct code reviews and maintain code repositories.
• Implement test strategies, analyze results, and coordinate fixes.
• Develop user training, documentation, and support frameworks.
• Resolve production issues and suggest preventive strategies.
• Maintain detailed records of code, tests, and support activities.

Skills

Data warehousing

Hadoop ecosystem

Big Data production

Python scripting

Unix shell scripting

Autosys

Airflow

SQL

Agile methodologies

Education

Bachelor's degree or equivalent

Tools

Tableau

Autosys

Airflow

Job description

Infosys DNA invites a Technology Consultant 2 to drive data warehousing initiatives and AI-powered analytics. You will contribute to requirements, design discussions, and coding efforts while ensuring system stability and quality.

The role emphasizes cross-functional collaboration and end-to-end SDLC delivery in a fast‑paced environment. You will engage in data warehousing, Hadoop, Hive, Spark, Python, and SQL in production settings, employing tools like Autosys and Airflow to orchestrate