Senior Data Engineer

National Grid Plc

New York (NY)

Hybrid

USD 129,000 - 180,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

National Grid is seeking a Senior Data Engineer to design and evolve a cutting-edge forecasting platform. You’ll help teams access high-quality data for forecasting, analytics, and reporting in a hybrid setup across Waltham, MA, Brooklyn, NY or Hicksville, NY offices.

You’ll build scalable data pipelines, champion data quality, and collaborate with analytics and business units to improve data models and architectures while mentoring junior engineers in coding standards and best practices.

Qualifications

  • Strong experience in data engineering, analytics or BI with ~5 years' experience.
  • Proficient in Python, PySpark and SQL.
  • Experience with Databricks and scalable data solutions.

Responsibilities

  • Design, build and support scalable data pipelines from multiple sources.
  • Develop data integrations and APIs for increasing data volumes.
  • Champion data quality and governance across the organisation.
  • Develop scalable data solutions aligned with architectural roadmaps.
  • Partner with analytics and business teams to improve data models and accessibility.
  • Design and enhance data integration and quality frameworks with strong testing.
  • Build distributed data solutions for streaming events.
  • Investigate and resolve complex data issues using data analysis.
  • Mentor junior engineers on coding standards and good practices.

Skills

Python
PySpark
SQL
Databricks
Azure data technologies
Data quality
Agile
Data modeling

Education

Bachelor's degree in Computer Science / Mathematics / Statistics

Tools

Databricks
Azure Data Factory
Azure Functions

Job description

As a Senior Data Engineer, you'll play a key role in building and evolving a cutting-edge forecasting platform, helping teams across National Grid access high-quality data and make smarter, more informed decisions.

Working within a collaborative, cross-functional development team, you'll design and build scalable, end-to-end data pipelines that bring together large and complex datasets from multiple sources. Using agile ways of working and strong engineering principles, you'll ensure our data is reliable, accessible and ready to power forecasting, analytics and reporting.

You'll also have the opportunity to help shape the future of our data engineering capability, modernising our architecture, tools and ways of working to improve scalability, performance and speed of delivery.

This is an exciting opportunity for an innovative engineer who is passionate about data, data quality and modern technology, and wants to build solutions that make a real impact at scale.

National Grid is hiring a Senior Data Engineer. This role operates under a hybrid working model and is open to candidates based in either our Waltham, MA, Brooklyn, NY or Hicksville, NY office locations. Hybrid work expectations are subject to business needs and company policy.

What You'll Do
  • Design, build and support scalable data pipelines, ensuring they are robust, well-tested and ready to meet growing business needs.
  • Build and evolve data integrations and APIs, enabling us to manage increasing volumes and complexity of data.
  • Champion data quality and governance, ensuring data is secure, consistent, reliable and accessible across the organisation.
  • Develop scalable data solutions that align with our architectural roadmaps and standards across data integration, storage, reporting and analytics.
  • Partner with analytics and business teams to improve data models, increase accessibility and enable better, data-driven decision making.
  • Design and enhance data integration and quality frameworks, supported by strong unit, integration and functional testing.
  • Build and automate distributed data solutions that collect and process streaming events from multiple sources.
  • Investigate and resolve complex data issues, using data analysis to identify root causes and deliver effective solutions.
  • Guide and mentor junior engineers, sharing best practice around coding, engineering standards and optimisation.
Qualifications

You’ll be an experienced Data Engineer who enjoys solving complex problems, working with large-scale data and building high-quality solutions that make data easier to access and use.

We’d love you to bring:

  • Strong experience in data engineering, analytics or business intelligence, ideally with around 5 years' relevant experience.
  • Strong programming skills, particularly Python, alongside hands-on experience with PySpark and SQL.
  • Strong experience working with Databricks and building scalable data solutions.
  • Experience designing and developing integrations across multiple systems and APIs.
  • Hands-on experience with Azure data technologies, such as Azure Data Lake, Azure Data Factory, Azure DevOps and Azure Functions.
  • Strong SQL expertise, including working with and optimising queries across large-scale, complex datasets.
  • Experience with data warehousing and developing ETL and/or ELT pipelines.
  • An understanding of Agile software development methodologies and modern engineering practices.
  • Excellent problem-solving and troubleshooting skills, with a structured and process-driven approach.
  • Strong documentation skills and a focus on creating maintainable, well-engineered solutions.
  • A degree or equivalent experience, ideally within Computer Science, Mathematics, Statistics or another technical discipline.

It would be great if you also have:

  • Experience designing data schemas and working with SQL and NoSQL databases.
  • Knowledge or experience with Kafka, Flink, Fivetran or Matillion.
  • Exposure to Data Science and Machine Learning.
  • A background in software engineering.
  • Experience working with Snowflake.

#LI-NH2

#LI-HYBRID

Waltham: $129k- $170k a year

Brooklyn/Hicksville: $137k- $180k a year

National Grid will not be providing visa sponsorship for this position now or in the future. You must have the ability to work without a need for current or future visa sponsorship.

National Grid utilizes an assessment that evaluates the job qualifications/characteristics using AI or statistically based scoring. For more information, please view NYC Local Law 144.

This position has a career path which provides for advancement opportunities within and across bands as you develop and evolve in the position; gaining experience, expertise and acquiring and applying technical skills. Candidates will be assessed and provided offers against the minimum qualifications of this role and their individual experience.

National Grid is committed to providing equal employment opportunities to all employees and applicants for employment regardless of protected class. We do not discriminate on the basis of race, color, religion, sex (including pregnancy, gender identity, and sexual orientation), national origin, age, disability, genetic information, or any other protected status in accordance with applicable federal, state, and local laws. National Grid maintains affirmative action programs for individuals with disabilities and protected veterans.

Our employment practices are designed to ensure that all individuals are treated fairly and with respect throughout the hiring process and during employment. National Grid complies with all applicable federal, state, and local anti-discrimination laws. We are dedicated to fostering a workplace that is free from unlawful discrimination and harassment, and we encourage a culture of respect for all.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

National Grid Plc • Hicksville (NY)

Hybrid
USD 129,000 - 180,000
Senior Data Engineer
Senior Data Engineer

National Grid Plc • Waltham (MA)

Hybrid
USD 129,000 - 180,000
Staff Data Engineer
Staff Data Engineer

National Grid Plc • Waltham (MA)

Hybrid
USD 151,000 - 177,000
Staff Data Engineer
Staff Data Engineer

National Grid Plc • New York (NY)

Hybrid
USD 135,000 - 190,000
Staff Data Engineer
Staff Data Engineer

National Grid Plc • City of Syracuse (NY)

Hybrid
USD 135,000 - 190,000
Staff Software Engineer
Staff Software Engineer

National Grid Plc • New York (NY)

Hybrid
USD 129,000 - 161,000
Staff Software Engineer
Staff Software Engineer

National Grid Plc • Waltham (MA)

Hybrid
USD 129,000 - 151,000
Graduate Development Program, Associate Data Analyst, Substation Engineering
Graduate Development Program, Associate Data Analyst, Substation Engineering

National Grid Plc • Northborough (MA)

On-site
USD 73,000 - 86,000
Technical Program Manager
Technical Program Manager

National Grid Plc • Waltham (MA)

Hybrid
USD 158,000 - 198,000
Technical Program Manager
Technical Program Manager

National Grid Plc • New York (NY)

Hybrid
USD 158,000 - 198,000