Senior Data Engineer

DNV Germany Holding GmbH; United Kingdom; Hybrid; GBP 109,000 - 118,000; Full time

Job summary

A global leader in energy solutions is hiring a Senior Data Engineer to build and optimize data pipelines and workflows using Azure. This position requires expertise in Azure Databricks, Python, and PostgreSQL, with at least 5 years of experience. The role offers a dynamic hybrid schedule and generous benefits, including paid time off and education reimbursement. Join a collaborative team dedicated to a carbon-free future!

Benefits

Generous paid time off

Multiple Medical and Dental plans

401(k) with company match

Education reimbursement program

Flexible work schedule

Qualifications

• Minimum 5 years of professional data engineering experience, with at least 3 years on Azure-based solutions.
• Demonstrated ability to manage multiple projects and context switch effectively.
• Excellent written and verbal communication skills in English.

Responsibilities

• Build ETL/ELT pipelines using Azure Databricks, PostgreSQL, and Python.
• Implement orchestration and messaging using Azure Service Bus and Databricks Workflows.
• Partner with ML engineers to deliver clean, well-modeled data.

Skills

Azure Databricks (Apache Spark)

Azure DevOps (pipelines, repos, CI/CD)

PostgreSQL

Python

SQL (T-SQL, PostgreSQL dialects)

Education

Bachelor’s degree in Computer Science or related discipline

Job description

AboutEnergy Systems

We help customers navigate the complex transition to a decarbonized and more sustainable energy future. We do this by assuring that energy systems work safely and effectively, using solutions that are increasingly digital. We also help industries and governments to navigate the many complex, interrelated transitions taking place globally and regionally, in the energy industry.

Energy Management’s Analytics & Data Science team works to accelerate the transition toward a carbon-free future through software and analytics.
Working with the Analytics & Data Science team in DNV – Energy Management’s Technology group is more than just a job; it’s an opportunity to be part of a collaborative community where you can learn, grow, and thrive. Join a dynamic and diverse technology team that values innovation, impact, and sustainability. Help us build scalable, cloud-native data solutions that support demand side management, demand flexibility, and transportation electrification programs.

This role is based at our DNV office in North Andover, MA, Chalfont, PA, New York, NY, Rochester, NY, Troy, NY presenting a dynamic hybrid schedule where employees will typically spend three (3) days per week working from either a DNV office. Further details regarding role-specific requirements will be shared during the interview process. The position may also be considered at other DNV offices within the Eastern Time Zone.

What You’ll Do

As a Senior Data Engineer, you will:

• Develop & Optimize Data Pipelines: Build ETL/ELT pipelines using Azure Databricks (Spark), PostgreSQL, and Python to support large-scale data processing and analytics.
• Architect & Automate Workflows: Implement orchestration and messaging using Azure Service Bus and Databricks Workflows for automated, scalable operations.
• Enable ML & Advanced Analytics: Partner with ML engineers and software engineers to deliver clean, well-modeled data for feature engineering and operational ML pipelines.
• Ensure Data Quality & Reliability: Apply validation frameworks, observability tools, and monitoring using Azure Monitor and related services.
• Optimize for Performance & Scalability: Tune Spark jobs, queries, and pipelines for distributed computing efficiency.
• Implement DevOps & CI/CD: Build and maintain Azure DevOps pipelines for testing, version control, and automated deployment of data solutions.
• Foster Collaboration & Mentorship: Work with software developers, analytics engineers, and ML engineers to align data efforts with business goals, while mentoring junior engineers.

Benefits

• Generous paid time off (vacation, sick days, company holidays, personal days)
• Multiple Medical and Dental benefit plans to choose from, Vision benefits
• Spending accounts – FSA, Dependent Care, Commuter Benefits, company-seeded HSA
• Employer-paid, therapist-led, virtual care services through Talkspace
• 401(k) with company match
• Company provided life insurance, short-term, and long-term disability benefits
• Education reimbursement program
• Flexible work schedule with hybrid opportunities
• Charitable Matched Giving and Volunteer Rewards through our Impact Program
• Volunteer time off (VTO) paid by the company
• Career advancement opportunities

Benefits vary based on position, tenure, location, and employee election

For California, Washington, New York, Washington, D.C., Illinois, and Maryland: “DNV provides a reasonable range of compensation for this role. The actual compensation is influenced by a wide array of factors, including but not limited to skill set, level of experience, and specific location. For the states of California, Washington, New York, Washington, D.C., Illinois, and Maryland only, the starting pay range for this role is $145,000 - $155,000.

DNV is a proud equal opportunity employer committed to building an inclusive and diverse workforce. All employment is decided on the basis of qualifications, merit, or business need, without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status. DNV is committed to ensuring equal employment opportunity, including providing reasonable accommodations to individuals with a disability. US applicants with a physical or mental disability who require a reasonable accommodation for any part of the application or hiring process may contact the North America Recruitment Department ([e-mail]). Information received relating to accommodation will be addressed confidentially.

For more information:

https://www.eeoc.gov/know-your-rights-workplace-discrimination-illegal

What is Required

• Bachelor’s degree in Computer Science or related discipline, or equivalent work experience in data engineering.
• Minimum 5 years of professional data engineering experience, with at least 3 years on Azure-based solutions.
• Proficiency in:
  • Azure Databricks (Apache Spark)
  • Azure DevOps (pipelines, repos, CI/CD)
  • Azure Service Bus
  • PostgreSQL
  • Python and SQL (T-SQL, PostgreSQL dialects)
• Demonstrated ability to manage multiple projects and context switch effectively.
• Excellent written and verbal communication skills in English.
• We conduct pre-employment drug and background screening.

What is Preferred

• Prior experience in the energy industry.
• Experience with time-series data modeling, storage, and processing at scale.
• Familiarity with event-driven architectures and real-time/streaming data pipelines.
• Experience operationalizing ML models and supporting MLOps practices in Azure.

Immigration-related employment benefits, for example visa sponsorship, are not available for this position