Director, Data Engineering

Insight Global; Irvine (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Insight Global is seeking a seasoned Data Engineering Leader in Irvine, CA to oversee enterprise data platforms, pipelines, and cloud-based architecture. You will shape the data roadmap, drive modern data warehousing, and partner with BI and analytics to elevate data quality and reporting.

The role requires a strong Azure background, hands-on ETL tooling, and expertise in SQL, Python, Spark, and Airflow. Collaboration with stakeholders and AI-driven data initiatives are key aspects of this

Qualifications

• A minimum of 10 years in data engineering or data architecture within enterprise environments.
• 5+ years of management experience leading data engineering teams or technical groups.
• Strong background with cloud data platforms, data warehousing, and large-scale pipeline development.
• Proven Azure experience; Microsoft Fabric is a big plus.
• Hands-on with ETL/data integration tools such as Azure Data Factory, AWS Glue, Boomi.
• Strong SQL and Python skills.
• Experience with Spark, Airflow, and Kafka; knowledge of data modeling and data quality.
• Familiarity with AI/ML data enablement and analytics initiatives.
• Excellent communication to partner with technical and non-technical stakeholders.
• Bachelor's degree required; Master's preferred.

Responsibilities

• Lead the Data Engineering function, overseeing enterprise data platforms, pipelines, and cloud architecture.
• Define, develop and execute the team's data roadmap and long-term strategy.
• Collaborate with BI and analytics leaders to improve data quality, reporting capabilities, and enterprise data models.
• Drive cloud data strategy and modernization across Azure, Microsoft Fabric, and data warehouses.
• Support and scale AI-enabled data initiatives, including AI-assisted ETL and automation.
• Work cross-functionally with business and technical stakeholders to translate needs into data solutions.
• Support integration projects such as HR data, EMR integration, and upcoming financial system updates.
• Increase AI usage across department to enhance data quality, automation, and data cleanup.
• Improve visibility with patient data tracking and accurate data capture post-service.

Skills

Data engineering leadership

Management experience

Cloud data platforms

Azure

Azure Data Factory

Python

SQL

Spark

Airflow

Kafka

Education

Bachelor's degree

Master's degree preferred

Tools

Azure Data Factory

AWS Glue

Boomi

Job description

Job Description

Daily responsibilities include:

• Lead the Data Engineering function, overseeing enterprise data platforms, pipelines, and cloud-based data architecture
• Help define, develop and execute the teams data roadmap and long-term strategy
• Collaborate with BI and analytics leaders to improve data quality, reporting capabilities, and enterprise data models
• Drive cloud data strategy and modernization efforts across Azure, Microsoft Fabric, enterprise data warehouses, and data pipeline architecture.
• Support and scale AI-enabled data initiatives, including AI-assisted ETL, data ingestion, and automation
• Work cross-functionally with business and technical stakeholders, translating business needs into data solutions
• Some initiatives include:Supporting integration projects, including HR data, EMR integration, and upcoming financial system updates
• Increase AI across department and organization, with goal to use AI end to end for data quality, automation, code reviews, ETL optimization, and data cleanup standardization
• Improve visibility with patient data tracking (accurately capturing data post service)

Skills and Requirements

• 10 years of experience in data engineering, data architecture, or related fields within enterprise environments
• 5+ years of experience of management experience, leading data engineering teams or technical teams
• Strong background with cloud data platforms, data warehousing, and large-scale data pipeline development
• Strong cloud experience is a must have. Azure experience preferred, with Microsoft Fabric being a big plus
• Hands-on experience with ETL/data integration tools such as Azure Data Factory, AWS Glue, Boomi, or similar
• Strong SQL and Python skills
• Experience with modern data frameworks and technologies including Spark, Airflow, and KafkaKnowledge of data modeling, data integration, data quality, and enterprise data warehousing
• Familiarity with AI/ML data enablement and supporting analytics and reporting initiatives
• Strong communication skills with the ability to partner effectively with both technical and non-technical stakeholders
• Bachelor's degree required, Master's degree preferred

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [e-mail].