Principal Data Engineer

TechDigital Group; Detroit (MI); On-site; USD 150,000 - 190,000; Full time

Job summary

TechDigital Group is seeking a Principal Data Engineer to design, build, and evolve modern data solutions for analytics, ML, and AI within an Insurance Data & Analytics focus. You will lead cloud-based data platforms and scalable pipelines across structured and unstructured data.

The ideal candidate has 10+ years in data engineering, expertise in Snowflake and AWS, and strong data governance, API development, and Data Vault skills. Insurance domain knowledge is a significant plus.

Qualifications

• 10+ years of progressive experience in data engineering, including analytics-focused data warehouse environments like Snowflake.
• Hands-on experience delivering cloud-based data platforms on AWS (S3, Lambda, DynamoDB).
• Expertise in Data Vault data modeling and large-scale data ingestion, transformation, cleansing, and deduplication.
• Strong Python and scripting skills with Git, DevOps practices, and modern software engineering.
• Insurance data domain knowledge is a major plus for analytics use cases.

Responsibilities

• Design, build, and optimize modern data pipelines and enterprise data solutions for analytics, reporting, data science, and AI use cases.
• Develop cloud-based data engineering solutions including data lakes, warehouses, and platforms.
• Design scalable data structures using Data Vault to enable auditable, resilient data solutions.
• Build data ingestion, transformation, preparation, and quality processes across structured and unstructured data sources.
• Develop robust data integration, API services, and NoSQL/relational data processing at scale.
• Enable trusted, high-quality data for analytics, ML, and AI-driven capabilities.
• Collaborate with business and technology teams to define data requirements and align with priorities.
• Advance Insurance Data and Analytics platform capabilities with scalable engineering and governance-aligned practices.
• Establish data quality, validation, metadata, lineage, and monitoring processes.
• Apply Agile methods to deliver scalable, reliable data solutions and promote engineering standards across data platforms.
• Evaluate tools/tech to improve performance, delivery, and long-term supportability.
• Mentor engineers and drive strong delivery outcomes across initiatives.

Skills

Snowflake

AWS

dbt

Data Vault modeling

Python

Data governance

API development

DevOps

Education

Bachelor's degree in Computer Science, Information Systems, or a related field

Tools

Qlik Replicate

InfoSphere DataStage

CP4D

AWS Lambda

S3

Job description

The Opportunity

Are you passionate about data, architecture, software development, and analytics? Do you bring deep experience with cloud technologies, data warehousing, data integration, data modeling, and API development? Do you believe in modern engineering practices, collaboration, and innovation to build the next generation of enterprise data and AI platforms? If so, we'd like to talk with you.

our financial client is seeking a Principal Data Engineer to help design, build, and evolve modern data solutions within our Enterprise Data and AI organization. This role is ideal for a strong technical leader with hands‑on experience delivering cloud‑based data platforms, scalable data pipelines, and enterprise data solutions that support analytics, reporting, data science, and AI use cases.

The ideal candidate will bring experience implementing data lakes, cloud data warehouses, and modern data engineering solutions, including data ingestion, transformation, standardization, preparation, data quality management, and structured and unstructured data processing. This role also requires experience with relational and NoSQL data technologies, large‑scale data integration, API development, and enterprise data modeling, including Data Vault.

Experience with modern cloud data platform technologies, data architecture, and software engineering practices is essential. Knowledge of AI/ML, data science, and LLM‑related use cases is also a plus. Knowledge of the insurance business data domain is a significant advantage, particularly in supporting solutions that enable Insurance Data and Analytics capabilities. This role will be responsible for creating, maintaining, and optimizing enterprise data pipelines and related processes that support strategic analytics, machine learning, and AI‑driven business capabilities across Insurance line of business.

The selected candidate will help build and advance critical platform capabilities, including Insurance Data and Analytics solutions, data ingestion and transformation frameworks, governance‑aligned data engineering processes, and trusted data foundations for analytics and AI. The ideal candidate will bring proven experience leading cloud data engineering initiatives, driving scalable solution design, and establishing strong engineering standards across complex enterprise environments.

The Work Itself

• Design, build, and optimize modern data pipelines and enterprise data solutions that support analytics, reporting, data science, and AI use cases.
• Develop and implement cloud‑based data engineering solutions, including data lakes, cloud data warehouses, and enterprise data platforms.
• Design scalable data structures and support enterprise data storage using Data Vault modeling to enable flexible, auditable, and resilient data solutions.
• Build and support data ingestion, transformation, preparation, and quality processes across structured and unstructured data sources.
• Develop robust solutions for large‑scale data integration, relational and NoSQL data processing, and API‑based data services.
• Enable trusted, high‑quality, and accessible data for analytics, machine learning, and AI‑driven business capabilities.
• Partner with business and technology teams to define data requirements, transformation rules, integration needs, and solution designs that align to enterprise and line‑of‑business priorities.
• Help advance Insurance Data and Analytics platform capabilities through scalable engineering, strong data foundations, and governance‑aligned practices.
• Establish and maintain data quality, validation, monitoring, metadata, and lineage processes to support reliable and well‑managed enterprise data assets.
• Apply modern software engineering methods and Agile practices to deliver scalable, reliable, and maintainable data solutions.
• Promote engineering, operational, and design standards across data platforms and services.
• Evaluate and recommend tools, technologies, and approaches that improve performance, delivery, and long‑term supportability.
• Collaborate across business and IT teams to solve complex technical challenges and deliver practical, scalable solutions.
• Support enterprise data governance, data management, and data security requirements.
• Provide technical leadership, mentor team members, and contribute to strong delivery outcomes through effective collaboration and sound engineering practices.

The Skills You Bring

• Bachelor's degree in Computer Science, Information Systems, or a related field; advanced degree preferred.
• 10+ years of progressive experience in data engineering, including deep expertise in analytics‑focused data warehouse environments such as Snowflake.
• Extensive hands‑on experience designing and delivering cloud‑based data solutions on AWS, including services such as S3, AWS CLI, Lambda, and DynamoDB.
• Strong experience with modern data engineering and integration tools such as dbt, Qlik Replicate, InfoSphere DataStage, and CP4D.
• Deep expertise in data modeling, including Data Vault, and in designing scalable, auditable, and resilient data structures that support enterprise analytics, reporting, and AI use cases.
• Proven experience architecting and optimizing large‑scale data ingestion, transformation, cleansing, standardization, and deduplication processes across complex data environments.
• Strong programming and automation skills in Python and other scripting languages used to support enterprise data engineering solutions.
• Demonstrated experience leading the design and implementation of enterprise data pipelines using Git, DevOps practices, and modern software engineering approaches.
• Strong background in large‑scale data integration, API development, and data migration across distributed systems and platforms.
• Deep understanding of data governance, data management, metadata, lineage, and data security, with the ability to embed these practices into engineering solutions.
• Proven ability to lead end‑to‑end solution delivery, working independently while providing technical direction across multiple initiatives and technologies.
• Demonstrated success establishing and enforcing engineering, design, and operational standards across teams and platforms.
• Ability to evaluate emerging tools, technologies, and architectural approaches, and recommend scalable solutions that improve performance, maintainability, and long‑term supportability.
• Proven ability to influence, advise, and partner effectively with senior business and technology stakeholders to identify strategic challenges, assess options, and recommend solutions.
• Strong track record of mentoring engineers, promoting engineering excellence, and contributing to high‑performing teams.
• Extensive experience across the full software development lifecycle, including architecture, design, implementation, testing, deployment, and operational support.
• Knowledge of the insurance business data domain is a major plus, including familiarity with insurance data concepts, business processes, and analytics use cases.
• Ability to design trusted, high‑quality data foundations that enable advanced analytics, machine learning, and AI‑driven business capabilities.
• Strong problem‑solving, communication, and leadership skills, with the ability to translate complex technical concepts into practical business solutions.
• Insurance Business data domain knowledge.

Mandatory Skills:

Desired Skills:

The Skills You Bring Bachelor's degree in Computer Science, Information Systems, or a related field; advanced degree preferred. 10+ years of progressive experience in data engineering, including deep expertise in analytics‑focused data warehouse environments such as Snowflake. Extensive hands‑on experience designing and delivering cloud‑based data solutions on AWS, including services such as S3, AWS CLI, Lambda, and DynamoDB. Strong experience with modern data engineering and integration tools such as dbt, Qlik Replicate, InfoSphere DataStage, and CP4D. Deep expertise in data modeling, including Data Vault, and in designing scalable, auditable, and resilient data structures that support enterprise analytics, reporting, and AI use cases. Proven experience architecting and optimizing large‑scale data ingestion, transformation, cleansing, standardization, and deduplication processes across complex data environments. Strong programming and automation skills in Python and other scripting languages used to support enterprise data engineering solutions. Demonstrated experience leading the design and implementation of enterprise data pipelines using Git, DevOps practices, and modern software engineering approaches. Strong background in large‑scale data integration, API development, and data migration across distributed systems and platforms. Deep understanding of data governance, data management, metadata, lineage, and data security, with the ability to embed these practices into engineering solutions. Proven ability to lead end‑to‑end solution delivery, working independently while providing technical direction across multiple initiatives and technologies. Demonstrated success establishing and enforcing engineering, design, and operational standards across teams and platforms. Ability to evaluate emerging tools, technologies, and architectural approaches, and recommend scalable solutions that improve performance, maintainability, and long‑term supportability. Proven ability to influence, advise, and partner effectively with senior business and technology stakeholders to identify strategic challenges, assess options, and recommend solutions. Strong track record of mentoring engineers, promoting engineering excellence, and contributing to high‑performing teams. Extensive experience across the full software development lifecycle, including architecture, design, implementation, testing, deployment, and operational support. Knowledge of the insurance business data domain is a major plus, including familiarity with insurance data concepts, business processes, and analytics use cases. Ability to design trusted, high‑quality data foundations that enable advanced analytics, machine learning, and AI‑driven business capabilities. Strong problem‑solving, communication, and leadership skills, with the ability to translate complex technical concepts into practical business solutions. Insurance Business data domain knowledge.