Hybrid Data Pipeline Engineer — Big Data

TransUnion LLC; New Jersey; Hybrid; USD 72,000 - 105,000; Full time

Benefits offered by this job

Medical, dental & vision coverage

HSA/FSA options

Company-paid life & AD&D

Disability insurance

Parental leave

401(k) with employer match

Employee Stock Purchase Plan (ESPP)

Tuition reimbursement

Commuter benefits

Paid holidays & volunteer time off

Job summary

TransUnion LLC is seeking a Data Development Consultant to support Marketing Services data pipelines and backend systems. You will fix code issues, analyze data-related problems, and develop data pipelines while coordinating with Architecture, Consulting, Product, and Engineering teams.

The role is hybrid, requiring in-person presence at an office location for at least two days per week and regular virtual work. Strong SQL, Hadoop, and Python/Java skills are essential.

Qualifications

• Bachelor's Degree with 5+ years IT experience in Big Data.
• Excellent SQL skills and in-depth understanding of relational databases.
• Experience on distributed systems like Hadoop with hands-on experience in HDFS, MapReduce, Google Cloud Platform.

Responsibilities

• Manages the day-to-day activities to facilitate and deliver team projects.
• Play a key role in end-to-end data onboarding and creating a data pipeline for the end application.
• In-depth analysis of source data for mapping and business rules setup.
• Develop, code & implement the data pipeline.
• Ensure data onboarding at client level is successful.
• Collaborate across Product Managers, Solution Architects, Data Modelers, Consultancy Services to align goals.
• Develop knowledge of in-house tools to suggest improvements.

Skills

SQL

UNIX environments

Python

Java

Hadoop

MapReduce

Google Cloud Platform

HDFS

Hive

OLAP/OLTP/ETL

Education

Bachelor's Degree in IT/related field

Tools

Big Data frameworks (Hadoop)

BigQuery

Hive

Job description

TransUnion LLC is seeking a Data Development Consultant to support Marketing Services data pipelines and backend systems. You will fix code issues, analyze data-related problems, and develop data pipelines while coordinating with Architecture, Consulting, Product, and Engineering teams.

The role is hybrid, requiring in-person presence at an office location for at least two days per week and regular virtual work. Strong SQL, Hadoop, and Python/Java skills are essential.