Lead Data Engineer, Research Data Platform

Insight Global; San Diego (CA); On-site; USD 110,000 - 170,000; Full time

Job summary

Insight Global is seeking a Data Engineer for a leading semiconductor research organization. You will help shape the data foundation that supports R&D, building data pipelines and enabling access to research data at scale.

You will collaborate with lab owners, experimental teams, ML scientists, and IT to establish architecture standards, governance, security, and scalable data platforms.

Qualifications

• Experience building and optimizing data pipelines.
• Ability to integrate diverse data sources and enable scalable data access.
• Knowledge of data governance, security, and metadata management.
• Collaborative mindset and ability to work with ML scientists and engineers.

Responsibilities

• Define and evolve data architecture standards for Source Research.
• Build and integrate data pipelines connecting research protos, test benches, simulations, and HPC resources.
• Establish data governance, data lineage, access controls, and metadata management.
• Monitor and optimize data pipelines for reliability, performance, and cost.
• Partner with Source Research, Engineering, and IT to align on a common data platform architecture.
• Enable integration of physics-based models, AI workflows, and simulation workflows.
• Document platform architecture and communicate technical concepts to stakeholders.

Job description

Insight Global is seeking a Data Engineer for a leading semiconductor research organization. You will help shape the data foundation that supports R&D, building data pipelines and enabling access to research data at scale.

You will collaborate with lab owners, experimental teams, ML scientists, and IT to establish architecture standards, governance, security, and scalable data platforms.