Director ETL and Data Engineering

Career Techniques; New York (NY); Hybrid; USD 180,000 - 240,000; Full time

Job summary

Career Techniques is seeking a Director of ETL and Data Engineering to lead a team in building enterprise data integration platforms and ETL pipelines in New York. You will ensure data integrity, security, and availability while enabling analytics and automated business processes.

You will architect scalable data platforms, mentor engineers, oversee testing and governance, and collaborate with stakeholders to define data processes.

Qualifications

• 7+ years professional software development experience.
• 3+ years in a technical leadership or senior engineering role.
• 5+ years hands-on ETL, shell scripting, and process orchestration.
• Expert knowledge of database and data warehouse design principles.
• Experience with Scrum and Agile methodologies.
• Excellent communication with stakeholders.

Responsibilities

• Lead a team to deliver scalable data integration solutions.
• Architect ETL pipelines and data platforms.
• Provide hands-on technical leadership and code reviews.
• Oversee security, data governance, and quality.
• Drive agile development and testing strategies.
• Collaborate with analysts and business owners on requirements.
• Maintain in-person on-site presence per hybrid schedule.

Skills

ETL pipelines

Data warehousing

Data modeling

Agile leadership

Programming languages

Data governance

Team leadership

Security awareness

Education

Bachelor’s or Master’s degree in software engineering or related field

Tools

Airflow

SQL

Python

Shell scripting

Job description

Director of ETL and Data Engineering

The Director of ETL and Data Engineering leads a team of software engineers in designing, building, and maintaining enterprise data integration solutions, ETL pipelines, and data platforms across the firm's business and corporate units. This role ensures data integrity, consistency, and availability across systems while supporting business process automation, integration, and analytics. The role ensures data quality, security, and operational excellence, collaborating closely with stakeholders to develop consistent data processes and technical solutions. The Director provides hands‑on technical leadership and drives adoption of modern data engineering and software development practices.

RESPONSIBILITIES

• Drive project initiatives to deliver robust and scalable solutions that advance the firm's data engineering capabilities, incorporating new technologies as appropriate.
• Architect and design ETL pipelines, data platforms, and application solutions that are scalable, maintainable, reusable and well-tested.
• Lead a team of Software Engineers while maintaining hands‑on development responsibilities for critical applications and data solutions.
• Manage and maintain a portfolio of applications and data integration processes, identifying opportunities to standardize and streamline workflows.
• Collaborate with Business Analysts, technical teams, and business owners to identify requirements and design new products or extensions to existing products.
• Provide technical oversight to the development process including code reviews and mentoring of the technical team.
• Deliver solutions end-to-end, ensuring delivery milestones are met and stakeholder expectations are managed.
• Lead agile development practices and continuous improvement initiatives across the team.
• Design and oversee automated testing strategies including unit tests to ensure application logic is fully exercised for each application component.
• Ensure all solutions comply with enterprise security and privacy guidelines and maintain data governance standards.
• Utilize the hybrid work schedule to maintain regular in-person, on-site presence that fosters team collaboration, relationship building, and effective technical leadership.
• Effective performance of the essential functions of this position requires regular in-person, on-site interaction with colleagues, both for purposes of relationship building and meaningful collaboration.

QUALIFICATIONS

• Expert knowledge of database and data warehouse design principles, including when to build new structures versus reusing existing ones, optimization strategies, and balancing solution complexity with business needs.
• Strong experience designing and implementing ETL/ELT pipelines using modern data integration tools and frameworks.
• Proficiency with data orchestration and workflow management tools.
• Experience with data warehousing concepts, data modeling, and analytics platform design.
• Strong full‑lifecycle application development experience from requirements gathering through deployment and maintenance.
• Deep understanding of coding best practices and design patterns with a focus on performance and scalability.
• Demonstrated experience with Scrum and Agile methodologies, including experience leading agile teams.
• Expert‑level proficiency in one or more programming languages and ability to quickly become productive in new technical environments.
• Excellent oral and written communication skills, including the ability to translate technical concepts for non‑technical stakeholders.

EDUCATION and/or EXPERIENCE

• Bachelor’s and/or Master’s degree in software engineering, science, technology, engineering or mathematics or combination of equivalent education and experience.
• 7+ years of professional software development experience.
• 3+ years of experience in a technical leadership or senior engineering role.
• 5+ years hands‑on experience with ETL, shell scripting, and process orchestration tools.