Lead Data Engineer – Hybrid Real-Time Data & Cloud

Target; Brooklyn Park (MN); Hybrid; USD 132,000 - 238,000; Full time

Job summary

Target is seeking a Lead Data Engineer in Finance Technology Solutions to design and scale data platforms powering enterprise reporting and analytics. You will guide data architecture, build real-time and batch pipelines, and lead engineers delivering high-performance data services.

You will work across cloud platforms (AWS/GCP/Azure), implement governance and security, and mentor teammates in a hybrid work environment based in Minnesota.

Qualifications

• BS or MS in Computer Science, Machine Learning, AI, Applied Mathematics or related field
• 7+ years of experience in data engineering or distributed systems
• Expertise in Big Data technologies such as Hadoop and Spark
• Strong programming skills in PySpark, Scala, and/or Java
• Experience with cloud platforms (AWS, GCP, Azure) and data services (S3, BigQuery, Databricks, EMR, Snowflake)
• Proficiency in API development for real-time and batch data access
• Experience with real-time streaming architectures (Kafka, Flink, Kinesis)
• Knowledge of data modeling, ETL design, and data governance

Responsibilities

• Architect and build scalable data pipelines using Spark and cloud platforms
• Design real-time and batch data processing solutions for analytics and operations
• Develop APIs and data services with low latency and high throughput
• Optimize data models and processing frameworks for performance and cost
• Drive data governance, security, and compliance best practices
• Collaborate with product and business teams to deliver data-driven solutions
• Lead design, implementation, and lifecycle of data services and platforms
• Stay current with emerging technologies and promote best practices in big data engineering

Skills

PySpark

Scala

Java

APIs REST/GraphQL/gRPC

Distributed systems

Education

BS/MS in Computer Science or related

Tools

Hadoop

Spark

Databricks

EMR

Snowflake

BigQuery

Kinesis

Kafka

Job description

Target is seeking a Lead Data Engineer in Finance Technology Solutions to design and scale data platforms powering enterprise reporting and analytics. You will guide data architecture, build real-time and batch pipelines, and lead engineers delivering high-performance data services.

You will work across cloud platforms (AWS/GCP/Azure), implement governance and security, and mentor teammates in a hybrid work environment based in Minnesota.