Data Engineer

The Value Maximizer; South Carolina; On-site; USD 90,000 - 120,000; Full time

Job summary

A data solutions company in South Carolina seeks a skilled Data Engineer to design, build, and maintain scalable data pipelines using AWS technologies. The candidate should have strong hands-on experience with AWS services, expertise in ETL/ELT development, and familiarity with modern data warehousing. Strong problem-solving and collaboration skills are essential. This role offers an opportunity to work in a fast-paced environment with diverse data teams.

Qualifications

• Hands-on experience with AWS services for data processing.
• Proficiency in Python and SQL for analytical tasks.
• Experience in designing and optimizing ETL/ELT workflows.

Responsibilities

• Design and maintain scalable data pipelines using AWS services.
• Build and optimize ETL/ELT workflows.
• Implement data lakes and data warehouses on AWS.
• Collaborate with stakeholders to understand data needs.

Skills

AWS services (S3, Glue, Redshift)

Python

SQL

ETL/ELT pipelines

Apache Spark / PySpark

Workflow orchestration (Airflow)

Streaming frameworks (Kinesis/Kafka)

DevOps

Agile/Scrum

Job description

Overview

Job Summary: We are looking for a skilled Data Engineer with strong hands-on experience in AWS to design, build, and maintain scalable data pipelines and cloud-based data platforms. The ideal candidate will have expertise in modern data warehousing, ETL/ELT development, and distributed data processing while ensuring data quality, performance, and security.

Responsibilities

• Design, develop, and maintain scalable data pipelines using AWS services
• Build and optimize ETL/ELT workflows for structured and unstructured data
• Implement data lakes and data warehouses on AWS
• Work with large datasets to ensure high performance, reliability, and data integrity
• Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements
• Perform data modeling for analytical and operational use cases
• Ensure data quality, governance, and security best practices
• Monitor and troubleshoot data workflows and production issues
• Support CI/CD and automation for data platform deployments

Required Skills & Experience

• Strong hands-on experience with AWS services such as S3, Glue, Redshift, Lambda, EMR, Athena, and RDS
• Proficiency in Python and SQL for data processing and analysis
• Experience in building and optimizing ETL/ELT pipelines
• Solid understanding of data warehousing and data lake architecture
• Experience with Apache Spark / PySpark
• Knowledge of workflow orchestration tools (Airflow or similar)
• Familiarity with streaming frameworks (Kinesis/Kafka) is a plus
• Experience with data modeling and performance tuning
• Understanding of DevOps, CI/CD, and infrastructure as code (Terraform/CloudFormation)
• Experience working in Agile/Scrum environments

Good to Have

• Experience with Snowflake on AWS
• Exposure to real-time data processing
• AWS certification (e.g., AWS Certified Data Analytics / Solutions Architect)

Soft Skills

• Strong problem-solving and analytical skills
• Excellent communication and stakeholder management
• Ability to work in a fast-paced, collaborative environment