Data Engineering Manager

HC3.io. HC3, Inc.; Irondale (AL); Remote; USD 60,000 - 80,000; Full time

Job summary

An innovative firm is seeking a Data Engineering Manager to lead a talented team in optimizing data workflows and enhancing processing efficiency through AI-driven automation. This full-time remote role requires a blend of hands-on technical expertise and strategic vision, focusing on ETL methodologies and cloud-based platforms. The ideal candidate will have extensive experience in data engineering, leadership skills, and a passion for leveraging AI/ML techniques in data processing. Join a forward-thinking company that values creativity and problem-solving, and make a significant impact in the field of data engineering.

Qualifications

• 5+ years of experience in ETL development and data engineering.
• 3+ years of leadership experience in software development roles.
• Hands-on experience with ETL tools and cloud-based platforms.

Responsibilities

• Lead and manage ETL developers and data engineers.
• Develop and maintain ETL pipelines for data processing.
• Implement AI-driven automation to enhance efficiency.

Skills

Problem-solving skills

Project management skills

Stakeholder communication

Leadership skills

AI/ML techniques interest

Education

5+ years of ETL development experience

3+ years of leadership experience

Experience with unstructured data

Tools

ETL tools

Microsoft Visual Studio

AWS Glue

Redshift

Docker

Kubernetes

Job description

Job Details

Job Location: Remote - Irondale, AL

Salary Range: Undisclosed

Travel Percentage: Negligible

Job Shift: Day

Description

Purpose

The Data Engineering Manager brings strong expertise in ETL methodologies, data transformation, and cloud-based data platforms to lead a data engineering team in optimizing data handling and workflows. This role’s focus on leveraging AI-driven automation techniques will enhance data processing efficiency over time. The ideal candidate for this position has a blend of hands-on technical ability, leadership skills specific to data engineering, and strategic vision for data processing.

Responsibilities

The responsibilities for this position include the following:

• Provide general Leadership, Management, and Accountability (LMA) for ETL developers and data engineers, ensuring best practices in data processing.
• Develop and maintain ETL pipelines for structured and unstructured data processing.
• Implement AI-driven automation techniques to improve ETL efficiency over time.
• Ensure data quality, security, and compliance in all processes and foster a culture of continuous improvement.
• Establish and track KPIs for ETL performance, AI-driven automation, data integrity, and team productivity.

Qualifications

Competencies and Qualities

Qualified candidates must have the following competencies and qualities:

• Excellent problem-solving, project management, and stakeholder communication skills
• Interest in AI/ML techniques for data processing, with a willingness to apply AI-driven automation over time
• Able to lead a team to achieve high-level goals by initiating detailed, actionable plans
• Attentive to the skill level and performance of direct reports
• Resourceful and creative problem solver

Education Experience and Certifications

Required

• 5+ years of experience in ETL development, data engineering, or a related field
• 3+ years of leadership experience in a software development or data engineering role
• Experience working with unstructured data and data transformation techniques
• Hands-on experience with ETL tools and data processing frameworks
• Proficiency in Microsoft development tools, including Visual Studio, using C#
• Experience with cloud-based data platforms (AWS Glue, Redshift, etc.)
• Strong knowledge of database systems, data lakes, and data warehouse solutions

Preferred

• Hands-on experience or familiarity with AI/ML techniques for data transformation and anomaly detection
• Experience with DevOps practices, CI/CD pipelines, and containerization (Docker, Kubernetes)
• Experience with S3, EC2, Secrets Manager, CloudWatch, RDS
• Experience building complicated Regular Expressions
• Knowledge of data governance and regulatory compliance frameworks

Supervisory Responsibility

This position provides direct oversight and direction to a team of ETL developers/data engineers, to include assigning work, hiring for open positions, and conducting performance reviews.

Work Environment

This is a remote position with regular meetings and critical team discussions at the main HC3 office in Irondale, Alabama.

Travel

This position requires little to no travel. This role may be required to occasionally travel to an HC3 office for team meetings.

Physical Demand

This role will require using a computer for long periods of time while either sitting or standing.

Position Type and Expected Hours

This is a full-time position for five, eight-hour days (at least 40 hours) per week.

Other Duties

Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties, or responsibilities. Activities, duties, and responsibilities may change at any time with or without notice.