Data Engineer

INFOSYS NOVA HOLDINGS LLC; Charlotte (NC); On-site; USD 90,000 - 135,000; Full time

Job summary

INFOSYS NOVA HOLDINGS LLC is seeking a Data Engineer in Charlotte, NC, to design, build, and maintain data engineering features and standalone PySpark scripts. You will translate business requirements into robust data transformation processes and collaborate with the team to deliver scalable solutions.

You will work with Python, PySpark, and AWS within an OO programming approach, ensuring code quality, testing, and documentation across the framework.

Qualifications

• Strong hands-on experience with Python.
• Strong hands-on experience with PySpark and data transformations.
• Solid understanding of Object-Oriented Programming concepts.
• Experience developing standalone scripts based on defined business logic.

Responsibilities

• Design, develop, and implement new features within an existing framework using Python and PySpark.
• Create efficient PySpark scripts for data transformations driven by business logic.
• Use OOP concepts to address complex problems and build robust, reusable solutions.
• Collaborate with team members to understand requirements and deliver solutions aligned with business objectives.
• Translate business requirements into technical solutions and data transformation processes.
• Test, debug, and troubleshoot code to ensure accurate and reliable results.
• Identify and resolve complex software and data-related issues.
• Develop standalone scripts and applications to support data processing needs.
• Follow coding best practices and contribute to enhancement of the existing framework.
• Document programming tasks, processes, and procedures to support future troubleshooting and maintenance.
• Communicate effectively with teammates about requirements, technical challenges, and solutions.
• Work independently with minimal supervision while still contributing to the team’s overall outcomes.

Skills

Python

PySpark

Object-Oriented Programming

Data transformations

Standalone scripts

Troubleshooting

AWS

Data engineering frameworks

Large-scale data processing

Tools

AWS

Job description

This Data Engineer role at INFOSYS NOVA HOLDINGS LLC focuses on building and maintaining data engineering features and standalone PySpark scripts.

Responsibilities

• Design, develop, and implement new features within an existing framework using Python and PySpark.
• Create efficient, effective PySpark scripts for data transformations driven by business logic.
• Use Object-Oriented Programming concepts to address complex problems and build robust, reusable solutions.
• Collaborate with team members to understand requirements and deliver solutions aligned with business objectives.
• Translate business requirements into technical solutions and data transformation processes.
• Test, debug, and troubleshoot code to ensure accurate and reliable results.
• Identify and resolve complex software and data-related issues.
• Develop standalone scripts and applications to support data processing needs.
• Follow coding best practices and contribute to enhancement of the existing framework.
• Document programming tasks, processes, and procedures to support future troubleshooting and maintenance.
• Communicate effectively with teammates about requirements, technical challenges, and solutions.
• Work independently with minimal supervision while still contributing to the team’s overall outcomes.

Requirements

• Strong hands-on experience with Python.
• Strong hands-on experience with PySpark and data transformations.
• Solid understanding of Object-Oriented Programming concepts.
• Experience developing standalone scripts based on defined business logic.
• Strong problem-solving and troubleshooting skills.
• Ability to understand complex requirements and translate them into effective technical solutions.
• Experience working with data engineering frameworks and large-scale data processing.
• Excellent written and verbal communication skills.
• Ability to work independently with minimal supervision.

Technologies

• Python
• PySpark
• Object-Oriented Programming
• AWS

Preferred Skills

• AWS / cloud technologies
• Large-scale data processing
• Data transformation and ETL
• Software development best practices
• Framework development and enhancement
• Automated testing and debugging
• Data engineering tools and technologies

Location: Charlotte, NC (onsite)
Compensation: USD 90,000 - 135,000 per yearly