Hybrid Data Engineer: Real-Time Data Pipelines

Optum; Dublin; Hybrid; EUR 90,000 - 140,000; Full time

Job summary

Optum in Ireland is hiring a data engineering leader to design, build, and automate data pipelines for production release of data engineering, ML, and BI processes. You will transform data, implement scalable Big Data solutions and collaborate with business and technology partners to ensure high-quality results.

Required experience includes SQL proficiency, cloud platforms (Azure, AWS, GCP), Spark/Databricks, Airflow, Kubernetes and Python/Java/Scala. Hybrid Dublin/Letterkenny work model offered.

Qualifications

• Extensive experience in Data Engineering and data processing.
• Strong SQL proficiency and database knowledge.
• Experience ETL design and data warehousing principles.

Responsibilities

• Design, build and implement automation for data engineering, ML and BI processes.
• Transform data and apply business logic with partners.
• Develop scalable Big Data solutions and maintain code quality.
• Analyze raw data sources and determine structural requirements for new software.
• Migrate data from legacy systems to new solutions.
• Create data models and flowcharts for data pipelines.
• Define security and backup strategies for data solutions.
• Build real-time data pipelines and monitoring models.
• Write technical documentation.

Skills

Data Engineering

SQL Proficiency

Relational Databases

Non-relational Databases

ETL Expertise

Public Cloud (Azure AWS GCP)

Spark Databricks

Airflow

Kubernetes Docker

Python / Java / Scala

Agile & Scrum

Tools

Hadoop

Snowflake

Vertica

Redshift

Synapse

Job description

Optum in Ireland is hiring a data engineering leader to design, build, and automate data pipelines for production release of data engineering, ML, and BI processes. You will transform data, implement scalable Big Data solutions and collaborate with business and technology partners to ensure high-quality results.

Required experience includes SQL proficiency, cloud platforms (Azure, AWS, GCP), Spark/Databricks, Airflow, Kubernetes and Python/Java/Scala. Hybrid Dublin/Letterkenny work model offered.