AWS Data Engineer

Coforge Limited; Fort Mill (SC); On-site; USD 120,000 - 180,000; Full time

Job summary

Coforge Limited is seeking a Senior AWS Data Engineer to design, develop, and maintain ETL pipelines loading data into Snowflake. You will use Airflow and Glue for orchestration, implement HVR-based data replication, and optimize SQL for analysis.

Collaboration with analysts is essential to meet business data requirements. The role requires extensive experience in data engineering, strong Python and SQL skills, and a solid understanding of cloud data architectures.

Qualifications

• 6-8 years of experience in data engineering.
• Strong SQL and Python proficiency.
• Experience with ETL processes and data integration architectures.
• Knowledge of Snowflake data warehousing and cloud concepts.

Responsibilities

• Design, develop, and maintain ETL pipelines to load data into Snowflake.
• Leverage AWS Airflow and Glue for orchestration and processing tasks.
• Implement data replication/integration with HVR for real-time data.
• Optimize SQL queries for performance and reliability.
• Collaborate with analysts to translate data needs into solutions.
• Document data processes and ensure data quality and governance.

Skills

AWS services

Airflow

Glue

SQL

Python

ETL processes

Data governance

Education

Bachelor’s degree in computer science or related field

Tools

Snowflake

HVR

Git

Job description

Job Title / Role: Senior AWS Data Engineer

Key Skills: AWS services, Airflow, Glue, SQL, HVR

Experience: 8+

Location: Fort Mill, SC

Shift: General

Mode: Full-time

We at Coforge are seeking “Senior AWS Data Engineer” with the following skill set:

• Design, develop, and maintain ETL processes to extract, transform, and load data from various sources into Snowflake.
• Utilize AWS services such as Airflow and Glue for orchestration and data processing tasks.
• Implement data integration solutions using HVR to ensure real-time data availability.
• Write and optimize SQL queries for data retrieval and manipulation.
• Collaborate with data analysts and other stakeholders to understand data requirements and deliver solutions that meet business needs.
• Monitor and troubleshoot data pipelines to ensure high availability and performance.
• Document data processes and maintain data quality standards.
• Stay updated with the latest industry trends and technologies related to data engineering and cloud computing.

Mandatory Skills:

• Proven experience with AWS services, particularly Airflow and Glue.
• Strong knowledge of Snowflake and its data warehousing capabilities.
• Proficiency in SQL for data manipulation and analysis.
• Experience with Python for data processing and automation tasks.
• Hands-on experience with ETL processes and tools.
• Strong understanding of cloud computing concepts and architectures.
• Preferred Skills:
• Experience with HVR for data replication and integration.
• Familiarity with data modelling and database design principles.
• Knowledge of data governance and data quality best practices.
• Experience with version control systems such as Git.
• Understanding of Agile methodologies and project management practices.

Qualifications:

• Bachelor’s degree in computer science, Information Technology, or a related field.
• 6-8 years of experience in data engineering or a related role.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.
• Ability to work independently and as part of a team in a fast-paced environment.