A consulting firm is seeking a Mid-Senior level data engineer in Alpharetta, GA. This role involves leading Redshift projects, optimizing ETL processes, and mentoring junior engineers. The ideal candidate will have strong experience with AWS tools and a B.E/B.Tech/MCA degree. This is a full-time position with opportunities for hybrid work.
Lead the design and administration of Redshift data warehouses.
Optimize ETL/ELT pipelines using Talend and HVR.
Develop and maintain BI dashboards using Spotfire.
Implement DevOps practices for ETL workflows.
Mentor junior engineers promoting best practices.
Skills
AWS Redshift
AWS Glue
Talend
HVR
Spotfire
CI/CD
AWS
Education
Engineer - B.E / B.Tech / MCA
Job description
Location: Alpharetta, GA || Cincinnati, OH (Hybrid 2-3 days a week)
Duration: Full Time
Job Summary:
Lead the design, implementation, and administration of Redshift data warehouses, including cluster setup, schema design, and table management.
Architect and optimize ETL/ELT pipelines using Talend for batch processing and HVR for real-time replication and CDC.
Develop, maintain, and optimize BI dashboards and reporting using Spotfire.
Write, review, and optimize complex SQL queries for analytics, reporting, and ETL transformations.
Monitor and enhance Redshift performance: query tuning, distribution/sort key optimization, concurrency scaling, and workload management.
Integrate Redshift with AWS services: S3, Glue, Lambda, Redshift Spectrum, and IAM roles.
Implement DevOps practices: CI/CD pipelines for ETL workflows, automated deployments, version control, and testing.
Ensure data security, backup, recovery, and compliance for Redshift environments.
Collaborate with enterprise architects, business stakeholders, and analytics teams to define best practices, data architecture, and roadmap.
Mentor and guide junior and mid-level engineers, promoting best practices in data engineering, cloud architecture, and DevOps.
Contribute to strategic initiatives, including platform optimization, cost efficiency, and migration projects.
Primary Skills 1 Required: Advanced - Professional with high knowledge, significant ability and hands‑on experience. Can provide supervision to others in AWS Redshift
Primary Skill 2 Required: Experienced & Practioner with Basic knowledge with demonstrated hands‑on experience. Requires no / minimal supervision in AWS Glue, Talend, HVR and S3
Secondary Skill 1 Required: Experienced & Practioner with Basic knowledge with demonstrated hands‑on experience. Requires no / minimal supervision in Spotfire
Secondary Skill 2 Required: Experienced & Practioner with Basic knowledge with demonstrated hands‑on experience. Requires no / minimal supervision in AWS and Devops CI/CD