AWS Data Migration Engineer

RichRelevance; Nordrhein-Westfalen; Vor Ort; EUR 65.000 - 85.000; Vollzeit

Zusammenfassung

RichRelevance is looking for an experienced software developer to integrate complex customer TV and Digital Ad viewing data with a focus on Big Data Analytics. The candidate will collaborate with cross-functional teams to automate data pipelines and create high-performance solutions on AWS and Databricks.

The ideal applicant has over 8 years of experience in software development, especially with Big Data technologies and AWS services. This role is crucial for analyzing performance metrics and ensuring data quality for strategic planning.

Qualifikationen

• 8+ years of software development experience.
• Experience with Big Data technologies, Hadoop ecosystem, and programming in Scala, PySpark, and Python.
• Experience with requirement gathering, design, support, migration, automation, and monitoring of data pipelines.
• Strong knowledge of AWS services and Databricks.

Aufgaben

• Support, migrate, automate and monitor existing data pipelines.
• Design, develop, test and deploy Big Data Analytics solutions on AWS and Databricks.
• Collaborate with stakeholders to translate business requirements into technical solutions.
• Analyze complex TV and Digital Ad viewing data for campaign performance measurement.
• Integrate data from multiple sources for reporting and notifications.

Kenntnisse

Software development experience

Big Data technologies

Hadoop ecosystem

Scala

PySpark

Python

AWS services knowledge

Tools

Databricks

Jobbeschreibung

Project Description

To integrate complex real‑world Customer TV and Digital Ad viewing data to perform pre‑campaign planning and post‑campaign performance measurements using a Big Data Platform (Databricks, Glue, EMR, Step‑functions, Lambda, PySpark and other AWS services). The solution will support existing workloads, automate and monitor processes, and be elastic, scalable, high‑performance, and cost‑effective in collaboration with cross‑functional teams.

Key Goals / Responsibilities

• Support, migrate, automate and monitor existing data pipelines, and design, develop, test and deploy Big Data Analytics solutions on AWS and Databricks.
• Collaborate with stakeholders to translate business requirements into technical solutions.
• Analyze large, noisy, complex real‑world customer TV and Digital Ad viewing data to perform pre‑campaign planning and post‑campaign performance measurement.
• Integrate data from multiple sources (on‑premise and cloud) to create aggregated datasets for reporting and notifications.

Qualifications

• 8+ years of software development experience.
• Experience with Big Data technologies, Hadoop ecosystem, and programming in Scala, PySpark, and Python.
• Experience with requirement gathering, design, support, migration, automation, and monitoring of data pipelines.
• Strong knowledge of AWS services and Databricks.

Location

Preferred locations: NJ, NY, MA, CT, NC, PA.