Data Engineer

Coforge; Fort Mill (SC); On-site; USD 110,000 - 140,000; Full time

Job summary

Coforge is hiring a senior Data Engineer in Fort Mill, SC to design and support robust ETL pipelines using Snowflake, DBT, Python and Airflow. You will own data integration across source systems, ensure data quality and drive reconciliation across stages.

You will analyze existing Informatica workflows, collaborate with stakeholders, and deliver scalable data solutions. The ideal candidate is hands-on, self-motivated and able to work independently on complex data projects.

Qualifications

• Strong hands-on experience in Snowflake, DBT, Python, Apache Airflow, AWS Glue, Amazon S3, SQL Server/T-SQL, Informatica.
• Analyze existing scheduled ETL jobs using Informatica workflows and SQL Server stored procedures.
• Senior, hands-on, self-motivated and independent Data Engineer.

Responsibilities

• Analyze existing scheduled ETL jobs developed using Informatica workflows and SQL Server stored procedures.
• Understand and document complex data extraction, transformation, filtering and file-generation logic.
• Trace dependencies across scheduled jobs, stored procedures, Informatica workflows and intermediate database tables.
• Validate the completeness, accuracy and consistency of data generated by upstream processing jobs.
• Perform end-to-end data reconciliation across source records, processed records, rejected records and downstream outputs.
• Investigate missing or incorrect records and identify issues related to source data, transformation logic, business rules or downstream processing.
• Develop and enhance data pipelines, transformation models and automated data-quality and reconciliation controls.
• Collaborate with business and technical stakeholders to understand requirements, validate processing rules and resolve data issues.
• Must be senior, hands-on, self-motivated and independent Data Engineer

Skills

Snowflake

DBT

Python

Apache Airflow

AWS Glue

Amazon S3

SQL Server/T-SQL

Informatica

Kafka

Job description

Skills: Snowflake, DBT, Python, Apache Airflow, AWS Glue, Amazon S3, SQL Server/T-SQL, Informatica

Location: Fort Mill SC

Job Description:

We at Coforge are hiring Data Engineer with the following skill sets.

• Strong hands-on experience in Snowflake, DBT, Python, Apache Airflow, AWS Glue, Amazon S3, SQL Server/T-SQL, Informatica - Good to have Kafka
• Analyze existing scheduled ETL jobs developed using Informatica workflows and SQL Server stored procedures.
• Understand and document complex data extraction, transformation, filtering and file-generation logic.
• Trace dependencies across scheduled jobs, stored procedures, Informatica workflows and intermediate database tables.
• Validate the completeness, accuracy and consistency of data generated by upstream processing jobs.
• Perform end-to-end data reconciliation across source records, processed records, rejected records and downstream outputs.
• Investigate missing or incorrect records and identify issues related to source data, transformation logic, business rules or downstream processing.
• Develop and enhance data pipelines, transformation models and automated data-quality and reconciliation controls.
• Collaborate with business and technical stakeholders to understand requirements, validate processing rules and resolve data issues.
• Must be senior, hands-on, self-motivated and independent Data Engineer