Senior Data Engineer (Azure & Databricks)

SOCOTEC; New York (NY); Hybrid; USD 149,000 - 190,000; Full time

Benefits offered by this job

Hybrid work arrangement

Competitive compensation and benefits

Job summary

SOCOTEC is seeking a Senior Data Engineer to design and build scalable data systems powering SOCOTEC’s digital platforms and analytics. You will craft the modern data stack, enable reliable ingestion, transformation, and modeling across enterprise systems.

You will collaborate with software engineers and platform teams to ensure a reliable, scalable data ecosystem that supports operational needs and advanced analytics, with emphasis on the Databricks stack and governance best practices.

Qualifications

• : 7-10 years hands-on Databricks experience
• :
• ],
• job_responsibilities_description
• :[],
• CoT_job_summary_short
• COMPANY NAME: SOCOTECKEY POINTS: Build scalable data platforms, lead enterprise data initiatives, enable analytics/AI
• job_summary_short
• <p>SOCOTEC is seeking a Senior Data Engineer to design and build scalable data systems powering SOCOTEC’s digital platforms and analytics. You will craft the modern data stack, enable reliable ingestion, transformation, and modeling across enterprise systems.</p><p>You will collaborate with software engineers and platform teams to ensure a reliable, scalable data ecosystem that supports operational needs and advanced analytics, with emphasis on the Databricks stack and governance best practices.</p>
• contract_type
• fulltime
• location_type
• hybrid
• remote_scope
• national
• perks
• :[{
• name
• Hybrid work arrangement},{
• name
• Competitive compensation and benefits

Responsibilities

• Build SOCOTEC’s Enterprise Data Platform
• Lead Master Data Management initiatives
• Design enterprise-scale data pipelines
• Enable data for AI and analytics
• Drive data architecture and best practices

Skills

Databricks

Apache Spark

Delta Lake

Python

SQL

Data modeling

ETL/ELT pipelines

Cloud platforms

Distributed systems

Tools

Databricks

Apache Spark

Delta Lake

AWS

Azure

Job description

Company Description

SOCOTEC is a provider of niche consulting services within the architecture, engineering and construction industries focusing on high-performance buildings and specialty structures. Through an integrated, holistic approach, our professionals provide solutions for building envelope, energy efficiency, sustainability, code advisory and construction advisory projects

Description Du Poste

SOCOTEC is a provider of niche consulting services within the architecture, engineering and construction industries focusing on high-performance buildings and specialty structures. Through an integrated, holistic approach, our professionals provide solutions for building envelope, energy efficiency, sustainability, code advisory and construction advisory projects

SOCOTEC’s combination of expertise, experience and methods are increasingly recognized as best-in-class fueling significant growth.

SOCOTEC is proud to announce that it has been officially certified as a Great Place to Work by the renowned global authority on workplace culture, Great Place to Work®.

Job Description

As a Senior Data Engineer, you will design and build scalable data systems that power SOCOTEC’s digital platforms and enterprise analytics. You will play a key role in architecting our modern data stack, enabling reliable ingestion, transformation, and modeling of data across multiple enterprise systems.

This role requires strong experience in Databricks, distributed data processing, and enterprise data architecture, along with the ability to lead large data initiatives and collaborate with engineering and business teams.

You will work closely with software engineers and platform teams to ensure SOCOTEC’s data ecosystem is reliable, scalable, and optimized for both operational systems and advanced analytics.

Key Responsibilities

Build SOCOTEC’s Enterprise Data Platform

• Design and implement scalable data pipelines that ingest and transform data from enterprise systems such as ERP, CRM, and operational databases.
• Develop and maintain data pipelines in Databricks using Spark and Delta Lake.
• Build and maintain data models that support analytics, AI applications, and operational systems.

Lead Master Data Management (MDM) Initiatives

• Architect and implement SOCOTEC’s custom MDM platform using Databricks.
• Design data models that establish consistent “golden records” across multiple enterprise systems.
• Implement data governance, lineage, and quality frameworks.

Design Enterprise-Scale Data Pipelines

• Build reliable ingestion pipelines for large-scale structured and semi-structured data.
• Implement batch and near-real-time data processing pipelines.
• Optimize large-scale data processing jobs for performance and cost efficiency.

Enable Data for AI and Advanced Analytics

• Partner with AI and software engineering teams to deliver high-quality datasets for machine learning and AI applications.
• Build data pipelines that support SOCOTEC’s digital products, analytics dashboards, and operational platforms.

Drive Data Architecture and Best Practices

• Define standards for data modeling, pipeline design, and data quality.
• Implement monitoring, observability, and alerting data systems.
• Ensure scalability, reliability, and security across the data platform.

Qualifications

• 7-10 years with hands on experience with Databricks
• Experience designing and owning large enterprise data projects
• Strong hands-on experience with Databricks, Apache Spark, and Delta Lake
• Experience building enterprise-scale ETL/ELT pipelines
• Experience working in enterprise environments with complex data systems
• Strong SQL and Python skills

Preferred Experience

• Experience building Master Data Management (MDM) systems
• Experience with modern cloud data stacks (AWS, Azure, or GCP)
• Experience integrating data from ERP systems such as Deltek, SAP, or Oracle
• Experience with data governance, data lineage, and metadata management
• Familiarity with lakehouse architectures and modern data platforms

Technical Skills

• Databricks
• Apache Spark
• Delta Lake
• Python
• SQL
• Data modeling
• ETL / ELT pipeline development
• Cloud data platforms (AWS / Azure)
• Data architecture and distributed systems

We are looking for someone who:

• Has owned and delivered large-scale data platforms
• Is comfortable working in complex enterprise environments
• Can design systems that scale across multiple business units and data sources
• Is passionate about building reliable data infrastructure that enables analytics and AI

Why Join SOCOTEC Digital Assurance

You will be joining a growing technology group building advanced platforms for the built environment, including:

• AI-powered compliance systems
• Intelligent inspection workflows
• Enterprise analytics platforms
• Large-scale data infrastructure supporting engineering services

Our goal is to transform how data and expertise flow across the built environment, enabling smarter decisions, faster compliance, and more efficient infrastructure.

If you are passionate about building modern data platforms and solving complex data challenges at scale, we’d love to hear from you.

Additional Information

Additional information

For more information, please visit www.socotec.us

Job Type: Full-Time, 4 days a week in office with one hybrid/ remote day

Salary: $149-190k

Applicants must be legally authorized to work in the United States without the need for current or future employer sponsorship.

All your information will be kept confidential according to EEO guidelines.

SOCOTEC is an Equal Opportunity Employer.