Lead Data Engineer, Finance Tech - Real-Time Pipelines

Roundel

Brooklyn Park (MN)

Hybrid

USD 132,000 - 238,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Health benefits

401(k) matching

Paid time off

Job summary

Target in Brooklyn Park, MN seeks a Lead Data Engineer for Finance Technology Solutions to design scalable data pipelines using Hadoop, Spark, PySpark, Scala/Java and cloud services. Hybrid work from Brooklyn Park, MN is available.

You will lead architecture, delivery of real-time and batch processing, and data services across the enterprise. You will mentor engineers, drive data governance and security, collaborate with finance stakeholders, and stay current with trends to enable near real-time

Qualifications

Experience architecting scalable data pipelines using Hadoop, Spark, and cloud platforms.
Strong programming in PySpark, Scala, and Java for data processing.
Experience with real-time and batch data processing and APIs.
Knowledge of data governance, security, and compliance best practices.
Excellent communication and collaboration across cross-functional teams.

Responsibilities

Architect and build scalable, high-performance data pipelines using Spark, Scala/Java and cloud platforms.
Design real-time and batch data processing solutions for analytical and operational use.
Develop APIs and data services for low-latency data access.
Optimize data models, workflows, and processing frameworks for cost and performance.
Drive data governance, security, and compliance; mentor engineers and lead teams.
Collaborate with product and business stakeholders to deliver data-driven solutions.
Lead design, implementation, and lifecycle management of data services and platforms.
Stay current with emerging big data and cloud technologies and promote best practices.