Lead Engineer - Big Data Platform/Infra (Hadoop, Spark Streaming, Druid)

Dev; Brooklyn Park (MN); On-site; USD 109,000 - 196,200; Full time

Benefits offered by this job

Comprehensive health benefits

401(k)

Employee discount

Paid vacation

Job summary

A Fortune 50 company seeks a Lead Engineer for their Big Data Platform team in Brooklyn Park, Minnesota. This role encompasses designing scalable APIs, collaborating with cross-functional teams, and solving challenging technical problems. Candidates should have a BS/MA in Computer Science and 5+ years of experience in software development, particularly with Java and Hadoop. The position offers a hybrid work arrangement, combining onsite and remote work as needed, along with competitive compensation and a comprehensive benefits package.

Qualifications

• 5+ years of experience in developing software applications.
• Experience with modern CI/CD technologies.
• Proven track record in writing clean, maintainable code.

Responsibilities

• Lead designing the Target platform API.
• Collaborate with technical staff and Enterprise Architecture teams.
• Understand Target's business and assist teams in complex challenges.

Skills

Java

Hadoop

Spark

Distributed Systems

Education

BS/MA degree in Computer Science

Tools

Git

Docker

Drone

Artifactory

Job description

• Full-time

Company Description

Jobs for Humanity is partnering with Target to build an inclusive and just employment ecosystem. Therefore, we prioritize individuals coming from the following communities: Refugee, Neurodivergent, Single Parent, Blind or Low Vision, Deaf or Hard of Hearing, Black, Hispanic, Asian, Military Veterans, the Elderly, the LGBTQ, and Justice Impacted individuals. This position is open to candidates who reside in and have the legal right to work in the country where the job is located.

Company Name: Target

Job Description

Location: 7000 Target Pkwy N, Brooklyn Park, Minnesota, United States, 55445

The pay range is $109,000.00 - $196,200.00. Pay is based on several factors which vary based on position. These include labor markets and in some instances may include education, work experience and certifications. In addition to your pay, Target cares about and invests in you as a team member, so that you can take care of yourself and your family. Target offers eligible team members and their dependents comprehensive health benefits and programs, which may include medical, vision, dental, life insurance and more, to help you and your family take care of your whole selves. Other benefits for eligible team members include 401(k), employee discount, short term disability, long term disability, paid sick leave, paid national holidays, and paid vacation. Find competitive benefits from financial and education to well-being and beyond at https://corporate.target.com/careers/benefits.

JOIN US AS A LEAD ENGINEER – BIG DATA PLATFORM

About us

As a Fortune 50 company with more than 350,000 team members worldwide, Target is an iconic brand and one of America's leading retailers. Working at Target means the opportunity to help all families discover the joy of everyday life. Caring for our communities is woven into who we are, and we invest in the places we collectively live, work and play. We prioritize relationships, fuel and develop talent by creating growth opportunities, and succeed as one Target team. At our core, our purpose is ingrained in who we are, what we value, and how we work. It’s how we care, grow, and win together.

The Target High Performance Distributed Computing team creates the platforms and tools to enable our business partners to make data-based decisions at Target. This team helps to manage hardware and software for large scale distributed computing, frequently angling towards data analytics and Artificial Intelligence/Machine Learning type applications. We help develop the technology that personalizes the guest experience, from product recommendations to relevant ad content. We’re also the source of the data and analytics behind Target's Supply Chain optimization, fraud detection, demand forecasting (DFE) and metrics to support our stores. We play a key role in identifying the test-and-measure or A/B test opportunities that continuously help Target improve the guest experience, whether they love to shop in stores or Target.com.

As a Lead Engineer, you serve as the technical anchor for the engineering team that supports a product. You create, own and are responsible for the application and platform architecture that best serves the product in its functional and non-functional needs. You'll bring innovative ideas and help set the strategy for the future of our platform. You love keeping abreast of the latest industry trends and use them to help you innovate. You have leadership qualities, good judgment, and clear communication skills. If you’re excited to work on a fast-moving, tightly knit team and build solutions to unsolved problems, we want to meet you.

As a Lead Engineer, you’ll take the lead as you…

• Understand Target's business and technical environments and assist teams in resolving complex business challenges via current technical solutions by assessing viability/applicability/cost implication through POCs and prototypes.
• Collaborate with technical staff and Enterprise Architecture teams in setting technical direction across platform and drive technology lifecycle management and communication of standards/decisions to the engineering team.
• Participate in procurement specifications, installation, and maintenance of Target systems.
• Lead designing and building the Target platform API with deep focus on non-functional requirements including scalability, availability, performance, etc. while being a strong advocate of extreme agile and DevOps practices across engineers.

About You

• BS/MA degree in Computer Science or relevant experience
• 5+ years of experience in developing software applications
• Detailed knowledge of GNU/Linux OS experience w/ administration of production grade services running on Linux servers
• Proven track record in writing code that is correct, maintainable, testable, expressive, easy to change, efficient and fault-tolerant
• Demonstrated proficiency in Java
• Demonstrated knowledge of some of the following concepts:
  • Operating system architecture, memory management, process scheduling, I/O scheduling
  • Networking, technologies, latency, bandwidth
  • Benchmarking, performance debugging, performance monitoring
  • Limiting-resource identification
• Have familiarity and experience with some of the following:
  • Hadoop (multi-node fully distributed Hadoop clusters)
  • Spark
  • HDFS
  • Hive
  • ZooKeeper
  • Ozone
  • Trino/PrestoSQL
• Possess a strong understanding of high-performance, large-scale system architecture design and implementation
• Experience with distributed and parallel processing, computer architecture, operating systems, synchronization, communication
• Experience with modern CI/CD technologies such as Git, Drone, Docker, Artifactory
• Understand business fundamentals and how technologies can support business goals along with how to translate business vision into a technical strategy and financial implications
• Strong team player who understands concepts of teamwork and team effectiveness.
• Have excellent verbal, written, and presentation communication skills to convey complex technical solutions clearly to an organization
• Have excellent planning and organizational skills

This position will operate as a Hybrid/Flex for Your Day work arrangement based on Target’s needs. A Hybrid/Flex for Your Day work arrangement means the team member’s core role will need to be performed both onsite at the Target HQ MN location the role is assigned to and virtually, depending upon what your role, team and tasks require for that day. Work duties cannot be performed outside of the country of the primary work location, unless otherwise prescribed by Target. Click here if you are curious to learn more about Minnesota.

Americans with Disabilities Act (ADA)

Target will provide reasonable accommodations with the application process upon your request as required to comply with applicable laws. If you have a disability and require assistance in this application process, please visit your nearest Target store or Supply Chain Facility or reach out to Guest Services at 1-800-440-0680 for additional information.