Senior Data Engineer - SC Cleared in London

Energy Jobline ZR; City Of London; On-site; GBP 70,000 - 90,000; Full time

Job summary

A leading global energy job board is seeking a Senior Data Engineer with expertise in streaming and batch data pipelines. The role involves collaborating with major cloud providers and engaging with stakeholders to align data initiatives with business strategies. Ideal candidates will have strong experience with Python and cloud platforms like AWS and Databricks, as well as relevant certifications.

Qualifications

• Proven experience as a Data Engineer focused on streaming and batch processing.
• Hands-on experience with cloud-based data platforms like AWS or Databricks.
• Strong programming skills in Python, Scala, or Java.

Responsibilities

• Design, develop, and maintain streaming and batch data pipelines.
• Collaborate with cloud providers to conduct PoCs for data platform solutions.
• Engage with key stakeholders to align data initiatives with business strategies.

Skills

Data Engineering

Cloud-based data platforms (AWS, Databricks, Snowflake)

Python

ETL/ELT processes

Data modeling

Education

Certifications in AWS, Azure, or Databricks

Tools

Snowflake

IBM DataStage

Job description

Energy Jobline is the largest and fastest growing global Energy Job Board and Energy Hub. We have an audience reach of over 7 million energy professionals, 400,000+ monthly advertised global energy and engineering jobs, and work with the leading energy companies worldwide.

We focus on the Oil & Gas, Renewables, Engineering, Power, and Nuclear markets as well as emerging technologies in EV, Battery, and Fusion. We are committed to ensuring that we offer the most exciting career opportunities from around the world for our jobseekers.

Job Description: Senior Data Engineer – SC Cleared

We are seeking a hands‑on Senior Data Engineer with deep expertise in building and managing streaming and batch data pipelines. The ideal candidate will have strong experience working with large‑scale data systems operating on cloud‑based platforms such as AWS, Databricks or Snowflake. This role also involves close collaboration with hyperscalers and data platform vendors to evaluate and document Proofs of Concept (PoCs) for modern data platforms, while effectively engaging with senior stakeholders across the organisation.

Key Responsibilities

• Design, develop, and maintain streaming and batch data pipelines using modern data engineering tools and frameworks.
• Work with large volumes of structured and unstructured data, ensuring high performance and scalability.
• Collaborate with cloud providers and data platform vendors (e.g., AWS, Microsoft Azure, Databricks, IBM, Snowflake) to conduct PoCs for data platform solutions.
• Evaluate PoC outcomes and provide comprehensive documentation including architecture, performance benchmarks, and recommendations.
• Engage with key stakeholders including Heads of Architecture, Enterprise Architects, Product Owners, and Security teams to align data platform initiatives with business and technical strategies.

Required Experience & Skills

• Proven experience as a Data Engineer with a strong focus on streaming and batch processing.
• Hands‑on experience with cloud‑based data platforms such as AWS, Databricks, IBM, Snowflake.
• Strong programming skills in Python, Scala, or Java.
• Experience with data modeling, ETL/ELT processes, and data warehousing.
• Experience conducting and documenting PoCs with hyperscalers or data platform vendors.

Qualifications

• Certifications in AWS, Azure, or Databricks.
• Experience with Snowflake, IBM DataStage, or other enterprise data tools.
• Knowledge of CI/CD pipelines and infrastructure as code (e.g., Terraform, CloudFormation).
• Familiarity with data governance frameworks and compliance standards.

If you are interested in applying for this job please press the Apply Button and follow the application process. Energy Jobline wishes you the very best of luck in your next career move.