Ab Initio lead Developer

Accord Technologies Inc; Charlotte (NC); On-site; USD 90,000 - 120,000; Full time

Job summary

A tech company based in Charlotte, NC is looking for an Ab Initio Developer with expertise in Python and PySpark. The role involves designing, developing, and maintaining data integration solutions while collaborating with analysts to gather requirements. Key qualifications include proficiency in data modeling and experience with big data technologies such as Hadoop and Spark. The position offers a W2 contract, emphasizing teamwork and detail-oriented problem solving.

Qualifications

• Proven experience as an Ab Initio Developer in a data engineering environment.
• Strong proficiency in Python programming.
• Hands-on experience with PySpark.

Responsibilities

• Develop and maintain ETL workflows using Ab Initio.
• Collaborate with stakeholders to gather requirements.
• Implement data processing solutions utilizing Python and PySpark.

Skills

Ab Initio

Python

PySpark

SQL

Data Modeling

Problem Solving

Communication

Tools

AWS

Azure

GCP

Kafka

Hive

Airflow

Oozie

Job description

Ab Initio lead Developer with Python & PySpark

Charlotte, NC (Onsite)

Openings: 4

Position type: W2 contract

Job Description

We are seeking a skilled Ab Initio Developer with strong experience in Python and PySpark to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining large-scale data integration and processing solutions, ensuring high performance and data quality.

Responsibilities

• Develop and maintain ETL workflows using Ab Initio.
• Collaborate with data analysts and other stakeholders to gather requirements and translate them into effective data pipelines.
• Implement data processing solutions utilizing Python and PySpark for big data processing tasks.
• Optimize existing data workflows for performance and reliability.
• Perform data validation, cleaning, and transformation activities.
• Troubleshoot and resolve data pipeline issues in production environments.
• Document technical specifications and develop best practices for data processing.

Requirements

• Proven experience as an Ab Initio Developer in a data engineering environment.
• Strong proficiency in Python programming.
• Hands-on experience with PySpark (Spark with Python API).
• Good understanding of big data technologies and concepts (Hadoop, Spark, etc.).
• Familiarity with SQL and relational databases.
• Experience with data modeling and schema design.
• Strong problem-solving skills and attention to detail.
• Excellent communication and teamwork skills.
• Experience with cloud platforms such as AWS, Azure, or GCP.
• Knowledge of other big data tools and frameworks (e.g., Kafka, Hive).
• Familiarity with orchestration tools like Airflow or Oozie.