Big Data and Analytics Engineer

London Stock Exchange Group; London; On-site; GBP 60,000 - 100,000; Full time

Job summary

An established industry player is seeking a highly skilled Data and Analytics Engineer to revolutionize their data infrastructure. This role involves designing and managing data pipelines, collaborating with cross-functional teams, and delivering actionable insights. The ideal candidate will have a strong background in data analytics, programming skills in Python or Java, and experience with cloud services. Join a dynamic organization that values innovation, sustainability, and diversity, and play a critical role in shaping the future of financial markets.

Benefits

Healthcare

Retirement Planning

Paid Volunteering Days

Wellbeing Initiatives

Qualifications

• 5-10 years of experience in data and analytics.
• Bachelor's in Computer Science or equivalent experience.
• Strong programming skills in Python, Java, or Scala.

Responsibilities

• Design and optimize data pipelines and architectures.
• Collaborate with data scientists to deliver solutions.
• Conduct advanced data analysis and ensure data quality.

Skills

Data Analytics

Python

Java

SQL

ETL Workflows

Data Modeling

Cloud Services

Machine Learning

Real-time Data Processing

Education

Bachelor's in Computer Science

Equivalent Experience

Tools

Databricks

Spark

Kafka

Hadoop

Azure

AWS

GCP

Clickhouse

Apache Druid

Job description

We are seeking a highly skilled and innovative Data and Analytics Engineer to join our team. In this role, you will be responsible for designing, building, and managing our data infrastructure and analytics solutions to enable data-driven decision-making across the organization. You will work on sophisticated datasets and collaborate with cross-functional teams to unlock insights and deliver actionable intelligence.

We are embarking on a journey to transform our data pipelines and platforms, with a strong emphasis on innovation.

Key Responsibilities:

1. Design, develop, and optimize data pipelines, architectures, and data integration workflows.
2. Build scalable and efficient data storage solutions, such as data lakes, warehouses, or cloud-based systems.
3. Collaborate with data scientists and analysts to understand data requirements and deliver solutions.
4. Develop and maintain ETL processes for ingesting, transforming, and loading data from diverse sources.
5. Conduct advanced data analysis, modeling, and visualization to identify patterns and insights. Ensure data quality, reliability, and security across systems.
6. Work with distributed computing frameworks (e.g., Spark, Hive, Hadoop) to process and analyze large datasets.

Essential Skills:

1. 5-10 years of experience in data and analytics.
2. Bachelor's or equivalent experience in computer science, engineering, or a related field.
3. Strong programming skills in languages such as Python, Java, or Scala. Hands-on experience with SQL and data modeling.
4. Proven understanding of ETL workflows within databases/warehouses such as Oracle, PostgreSQL, SQL Server, etc.
5. Proficiency with data tools (e.g., Databricks, Spark, Kafka, Hadoop, Presto) and cloud services (e.g., Azure, AWS, GCP).

Nice to Have:

1. Experience with machine learning frameworks and tools such as Azure ML Studio, AWS SageMaker, etc.
2. Knowledge of real-time data processing and stream analytics like Azure Event Hubs or similar.
3. Hands-on experience with real-time analytical databases such as Clickhouse or Apache Druid/Pinot or similar.

LSEG is a leading global financial markets infrastructure and data provider. Our purpose is driving financial stability, empowering economies, and enabling customers to create sustainable growth.

Our purpose is the foundation on which our culture is built. Our values of Integrity, Partnership, Excellence, and Change underpin our purpose and set the standard for everything we do, every day. They guide our decision-making and actions.

Working with us means being part of a dynamic organization of 25,000 people across 65 countries. We value your individuality and encourage you to bring your true self to work to help enrich our diverse workforce. You will be part of a collaborative and creative culture that encourages new ideas and is committed to sustainability. You will play a critical role in re-engineering the financial ecosystem to support sustainable economic growth, including the green economy and inclusive opportunities.

LSEG offers tailored benefits, including healthcare, retirement planning, paid volunteering days, and wellbeing initiatives.

We are proud to be an equal opportunities employer, committed to non-discrimination and reasonable accommodations for religious practices, mental health, or physical disabilities.

Please review our privacy notice carefully, as it describes how we handle your personal information, your rights, and contact information.

If submitting as a Recruitment Agency Partner, ensure candidates are aware of this privacy notice.