Senior Data Engineer in Fort Mill

Energy Jobline ZR; Fort Mill (SC); On-site; USD 120,000 - 160,000; Full time

Job summary

Energy Jobline ZR in Fort Mill, SC is seeking a Senior Data Engineer to design, develop, and maintain robust ETL pipelines into Snowflake. You'll leverage AWS services like Airflow and Glue for orchestration and work with stakeholders to translate data requirements into scalable solutions.

The role emphasizes real-time data integration with HVR, strong SQL and Python skills, and a solid background in data modeling and cloud architecture.

Qualifications

• Bachelor's degree required in CS/IT or related field.
• 6–8 years of data engineering experience.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.
• Ability to work independently and in a team.

Responsibilities

• Design, develop, and maintain ETL processes for Snowflake.
• Use AWS Airflow and Glue for orchestration.
• Implement real-time data integration with HVR.
• Write and optimize SQL queries.
• Collaborate with analysts and stakeholders.
• Monitor data pipelines for availability and performance.
• Document data processes and ensure data quality.
• Stay updated on data engineering and cloud trends.

Skills

AWS Airflow

AWS Glue

Snowflake

SQL

Python

ETL

Cloud computing

Data modeling

Git

Agile

Education

Bachelor's degree in CS/IT or related field

Tools

HVR

Git

Job description

Job Description

Senior Data Engineer

Fort Mill, SC

Responsibilities:

• Design, develop, and maintain ETL processes to extract, transform, and load data from various sources into Snowflake.
• Utilize AWS services such as Airflow and Glue for orchestration and data processing tasks.
• Implement data integration solutions using HVR to ensure real-time data availability.
• Write and optimize SQL queries for data retrieval and manipulation.
• Collaborate with data analysts and other stakeholders to understand data requirements and deliver solutions that meet business needs.
• Monitor and troubleshoot data pipelines to ensure high availability and performance.
• Document data processes and maintain data quality standards.
• Stay updated with the latest industry trends and technologies related to data engineering and cloud computing.

Mandatory Skills:

• Proven experience with AWS services, particularly Airflow and Glue.
• Strong knowledge of Snowflake and its data warehousing capabilities.
• Proficiency in SQL for data manipulation and analysis.
• Experience with Python for data processing and automation tasks.
• Hands-on experience with ETL processes and tools.
• Strong understanding of cloud computing concepts and architectures.

Skills:

• Experience with HVR for data replication and integration.
• Familiarity with data modeling and database design principles.
• Knowledge of data governance and data quality best practices.
• Experience with version control systems such as Git.
• Understanding of Agile methodologies and project management practices.

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 6-8 years of experience in data engineering or a related role.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.
• Ability to work independently and as part of a team in a fast-paced environment.