Data Engineer Manager

Deploy Alloy; Birmingham (AL); Remote; USD 120,000 - 160,000; Full time

Job summary

A growing tech company is seeking a Data Engineering Manager to lead a team in optimizing data handling and workflows. The ideal candidate will harness AI-driven automation techniques and possess substantial experience in data processing, fostering a culture of continuous improvement within the team. This remote position requires strong leadership skills and proficiency in ETL methodologies, while ensuring data quality and compliance. Applicants should have over 5 years of relevant experience and a knack for problem-solving.

Qualifications

• 5+ years in ETL development/data engineering.
• 3+ years of leadership experience.
• Hands-on with ETL tools and data processing frameworks.

Responsibilities

• Provide leadership for ETL developers and data engineers.
• Develop ETL pipelines for structured and unstructured processing.
• Implement AI-driven automation for improved ETL efficiency.

Skills

Problem-solving

Project management

Stakeholder communication

AI/ML techniques

Team leadership

Resourcefulness

Education

5+ years of experience in ETL development or data engineering

3+ years of leadership experience in software development or data engineering

Hands-on experience with ETL tools and data processing frameworks

Proficiency in Microsoft development tools, including Visual Studio, C#

Experience with cloud-based data platforms (AWS Glue, Redshift)

Job description

The Data Engineering Manager brings strong expertise in ETL methodologies, data transformation, and cloud-based data platforms to lead a data engineering team in optimizing data handling and workflows. This roles focus on leveraging AI-driven automation techniques will enhance data processing efficiency over time. The ideal candidate for this position has a blend of hands-on technical ability, leadership skills specific to data engineering, and strategic vision for data processing.

Responsibilities

The responsibilities for this position include the following:

Provide general Leadership, Management, and Accountability (LMA) for ETL developers and data engineers, ensuring best practices in data processing.

Develop and maintain ETL pipelines for structured and unstructured data processing.

Implement AI-driven automation techniques to improve ETL efficiency over time.

Ensure data quality, security, and compliance in all processes and foster a culture of continuous improvement.

Establish and track KPIs for ETL performance, AI-driven automation, data integrity, and team productivity.

Qualifications

Competencies and Qualities

Qualified candidates must have the following competencies and qualities:

Excellent problem-solving, project management, and stakeholder communication skills

Interest in AI/ML techniques for data processing, with a willingness to apply AI-driven automation over time

Able to lead a team to achieve high-level goals by initiating detailed, actionable plans

Attentive to the skill level and performance of direct reports

Resourceful and creative problem solver

Education Experience and Certifications

Required

5+ years of experience in ETL development, data engineering, or a related field

3+ years of leadership experience in a software development or data engineering role

Experience working with unstructured data and data transformation techniques

Hands-on experience with ETL tools and data processing frameworks

Proficiency in Microsoft development tools, including Visual Studio, using C#

Experience with cloud-based data platforms (AWS Glue, Redshift, etc).

Strong knowledge of database systems, data lakes, and data warehouse solutions

Preferred

Hands-on experience or familiarity with AI/ML techniques for data transformation and anomaly detection

Experience with DevOps practices, CI/CD pipelines, and containerization (Docker, Kubernetes)

Experience with S3, EC2, Secrets Manager, CloudWatch, RDS

Experience building complicated Regular Expressions

Knowledge of data governance and regulatory compliance frameworks

Supervisory Responsibility

This position provides direct oversight and direction to a team of ETL developers/ data engineers, including assigning work, hiring for open positions, and conducting performance reviews.

This is a remote position, but there are regular meetings and critical team discussions at our client's main office in Irondale, Alabama.

Travel

This position requires little to no travel, but it may occasionally require trips to our client's office for team meetings.

Physical Demand

This role will require using a computer for long periods of time while either sitting or standing.

Position Type and Expected Hours

This is a full-time position for five, eight-hour days (at least 40 hours) per week.

Other Duties

Please note that this job description is not designed to cover or contain a comprehensive listing of activities, duties, or responsibilities. Activities, duties, and responsibilities may change at any time with or without notice.