Data Engineer - Hybrid/Remote Data Pipelines & Analytics

Prima; Milano; Ibrido; GBP 55.000 - 75.000; Tempo pieno

Vantaggi offerti da questo lavoro

Flexible working arrangements

Access to learning resources

Private healthcare

Gym discounts

Wellbeing programs

Descrizione del lavoro

A leading motor insurance provider in the UK is seeking a Data Engineer to join their Engineering team. You will design data products for analytics, implement data best practices, and engage with data scientists to refine infrastructure. The ideal candidate has expertise in batch processing, cloud solutions with AWS, and proficiency in Python. This role offers flexible working conditions and a range of employee perks, promoting a positive and innovative work culture.

Competenze

• Expert in batch processing and streaming data pipelines.
• Experience with data lake and analytics platforms.
• Proficiency in Python and software engineering best practices.

Mansioni

• Shape data product architecture for analytics and science.
• Lead data transformation with best practices.
• Build reusable technology for data ingestion and serving.

Conoscenze

Batch and distributed data processing

Near real-time streaming data pipelines

Proficient in Python programming

Expertise in RDBMS and Data Warehousing

DevOps and CI/CD pipeline management

Knowledge of MLOps

Strumenti

Kafka

Flink

Spark

AWS

Apache Oozie

Apache Airflow

Descrizione del lavoro

A leading motor insurance provider in the UK is seeking a Data Engineer to join their Engineering team. You will design data products for analytics, implement data best practices, and engage with data scientists to refine infrastructure. The ideal candidate has expertise in batch processing, cloud solutions with AWS, and proficiency in Python. This role offers flexible working conditions and a range of employee perks, promoting a positive and innovative work culture.