Lead Data Engineer - Hybrid (Spark & Cloud)

Target; Brooklyn Park (MN); Hybrid; USD 132,000 - 238,000; Full time

Benefits offered by this job

Health benefits

401(k)

Employee discount

Disability insurance

Paid time off

Job summary

Target is seeking a Lead Data Engineer in Finance Technology Solutions to design and deliver scalable data pipelines and services. You will lead a team, shape data architecture, and implement real-time and batch processing on cloud platforms using Hadoop, Spark, Scala/Java, and REST/GraphQL/gRPC APIs.

You will mentor engineers, collaborate with product and business stakeholders, and continuously promote best practices in data governance, security, and scalable analytics.

Qualifications

• BS or MS in Computer Science or related technical field preferred.
• 7+ years of data engineering, software development, or distributed systems experience.
• Expertise in Hadoop, Spark and distributed processing frameworks.
• Strong programming skills in PySpark, Scala, and/or Java.
• Experience with cloud data services (AWS, GCP, Azure) and APIs (REST/GraphQL/gRPC).
• Experience with real-time streaming architectures (Kafka, Flink, Kinesis).
• Data modeling, ETL design and performance optimization.
• Knowledge of data governance, security, and compliance in large scale environments.

Responsibilities

• Architect and build scalable data pipelines and distributed processing solutions using Spark and cloud platforms (AWS, GCP, Azure).
• Design real-time and batch data processing for analytical and operational use.
• Develop APIs and data services for low-latency data access.
• Optimize data models, workflows, and processing for performance and cost.

Skills

Big Data technologies

PySpark

Scala/Java

Cloud platforms (AWS, GCP, Azure)

API development (REST/GraphQL/gRPC)

Streaming data (Kafka/Flink/Kinesis)

Data modeling and ETL

Problem solving & collaboration

Leadership & mentoring

Strong communication

Education

BS or MS in Computer Science / related field

7+ years data engineering or distributed systems

Tools

Hadoop

Spark

Databricks

EMR

S3 / BigQuery / Snowflake

Job description

Target is seeking a Lead Data Engineer in Finance Technology Solutions to design and deliver scalable data pipelines and services. You will lead a team, shape data architecture, and implement real-time and batch processing on cloud platforms using Hadoop, Spark, Scala/Java, and REST/GraphQL/gRPC APIs.

You will mentor engineers, collaborate with product and business stakeholders, and continuously promote best practices in data governance, security, and scalable analytics.