A technology solutions firm in Durham, NC is seeking an experienced Data Engineer to design scalable data pipelines and contribute to an enterprise-wide Data Lake on AWS. The role requires a strong background in Python, SQL, and AWS services, with responsibilities including building cloud infrastructure for data analytics, optimizing data models, and ensuring data integrity. The ideal candidate is passionate about data and enjoys working in a collaborative environment.
Qualifications
Extensive experience with relational databases such as Oracle or Snowflake.
Hands-on experience with AWS services including S3, Glue, Redshift, etc.
Experience with ETL technologies such as Informatica or SnapLogic.
Responsibilities
Design and implement scalable ETL/ELT pipelines using AWS services.
Integrate structured and unstructured data into data lakes and warehouses.
Monitor data pipelines and troubleshoot issues to ensure reliability.
Skills
Python
SQL
AWS
Data modeling
ETL/ELT processes
Agile methodologies
Education
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
Tools
AWS Glue
Terraform
Apache Airflow
Informatica
Job description
A technology solutions firm in Durham, NC is seeking an experienced Data Engineer to design scalable data pipelines and contribute to an enterprise-wide Data Lake on AWS. The role requires a strong background in Python, SQL, and AWS services, with responsibilities including building cloud infrastructure for data analytics, optimizing data models, and ensuring data integrity. The ideal candidate is passionate about data and enjoys working in a collaborative environment.