Senior Data Engineer - Azure & Databricks (Hybrid/Remote)

Socotec; New York (NY); Hybrid; USD 140,000 - 190,000; Full time

Job summary

SOCOTEC in the United States is seeking a Senior Data Engineer to design and build scalable data systems powering our enterprise analytics and digital platforms. You will help architect the modern data stack, enabling reliable ingestion, transformation, and modeling across ERP, CRM, and operational databases.

The role requires hands-on experience with Databricks, Apache Spark, and Delta Lake, plus the ability to lead large data initiatives and collaborate with engineering and business teams.

Qualifications

• 7-10 years hands-on experience with Databricks
• Experience designing and owning large enterprise data projects
• Strong SQL and Python skills

Responsibilities

• Build SOCOTEC's Enterprise Data Platform
• Design and implement scalable data pipelines ingesting data from ERP, CRM, and databases
• Develop and maintain data models for analytics, AI, and operations
• Architect and implement MDM platforms using Databricks
• Design data models for golden records across systems
• Implement data governance, lineage, and quality frameworks
• Build ingestion pipelines for large-scale structured and semi-structured data
• Implement batch and near-real-time data processing pipelines
• Optimize large-scale data processing for performance and cost efficiency
• Partner with AI teams to deliver high-quality datasets for ML/AI applications
• Support data architecture standards, monitoring, and security across the platform
• Define data modeling, pipeline design, and data quality standards

Skills

Databricks

Spark

Python

SQL

Data modeling

Distributed systems

Tools

Databricks

Apache Spark

Delta Lake

Job description

SOCOTEC in the United States is seeking a Senior Data Engineer to design and build scalable data systems powering our enterprise analytics and digital platforms. You will help architect the modern data stack, enabling reliable ingestion, transformation, and modeling across ERP, CRM, and operational databases.

The role requires hands-on experience with Databricks, Apache Spark, and Delta Lake, plus the ability to lead large data initiatives and collaborate with engineering and business teams.