Mgr - Software Eng

Ally; Detroit (MI); Hybrid; USD 110,000 - 180,000; Full time

Benefits offered by this job

Bonuses

Equity

Relocation assistance

401K matching

Job summary

Ally is seeking an experienced GenAI Tech Lead to drive end-to-end development of enterprise‑grade AI solutions. You will architect robust systems, lead engineers, and translate complex business challenges into scalable AI products in a hybrid Detroit-based role.

Requirements include 8+ years in software, 5+ years ML, a Bachelor's degree, strong Python and cloud skills, and experience with LangChain/LangGraph.

Qualifications

• 8+ years of Software Engineering experience with 5+ years in machine learning engineering.
• Experience building GenAI/LLM enterprise applications and strong Python/cloud skills.

Skills

GenAI Engineering

ML Engineering

Technical Leadership

Architectural Design

Cross-functional Collaboration

Mentoring

Python

Cloud-native Dev

Education

Bachelor's Degree in relevant field

Tools

LangChain

LangGraph

AutoGen

LlamaIndex

Docker

Kubernetes

API microservices

Job description

Hybrid

Detroit, MI

Charlotte, NC

Full time

R2600878

Ally and Your Career

Ally Financial only succeeds when its people do - and that’s more than some cliché people put on job postings. We love this stuff! We see our people as, well, people - with interests, families, friends, dreams, and causes that are all important to them. Our focus is on the health and safety of our teammates as well as work-life balance and diversity and inclusion. From generous benefits to a variety of employee resource groups, we strive to build paths that encourage employees to stretch themselves professionally. We want to help you grow, develop, and learn new things. You’re constantly evolving, so shouldn’t your opportunities be, too?

Work Schedule:

Ally designates roles as (1) fully on-site, (2) hybrid, or (3) fully remote. Hybrid roles are generally expected to be in the office a number of days per week as indicated by your manager. Your hiring manager will discuss this role’s specific work requirements with you during the hiring process. All work requirements are subject to change at any time based on leader discretion and/or business need.

The Opportunity

We are seeking an experienced and hands‑on GenAI Tech Lead to drive the end‑to‑end development of enterprise‑grade generative and agentic AI solutions. You will bridge the gap between high‑level strategy and hands‑on execution—architecting robust systems, leading a talented team of engineers, and transforming complex business challenges into scalable AI products.

The Work Itself

Key Responsibilities

Minimum Qualifications:

• 7+ years of relevant experience or equivalent combination of education and experience
• Bachelor’s Degree in relevant field or equivalent

Preferred Qualifications:

• Architecture & Design: Design scalable, secure, and production‑ready GenAI applications utilizing Large Language Models (LLMs), fine‑tune and deploy open‑source models that meets business needs, Retrieval‑Augmented Generation (RAG) pipelines, and vector databases.
• Agentic Workflows: Build and orchestrate multi‑agent AI systems and tool‑calling frameworks (e.g., LangChain, LangGraph, AutoGen).
• Technical Leadership: Lead code reviews, establish engineering best practices, enforce coding standards, and mentor junior‑to‑mid‑level software engineers.
• Prototyping & R&D: Rapidly build Proof of Concepts (PoCs) and Minimum Viable Products (MVPs) to test emerging AI models and frameworks
• LLMOps & Monitoring: Implement monitoring, caching, prompt versioning, cost tracking, and evaluation guardrails for models running in production
• Cross‑Functional Collaboration: Partner with product managers, data scientists, security teams, and business stakeholders to align technical deliverables with organizational goals
• Experience: 8+ of Software Engineering experience with 5+ years in machine learning engineering, with at least 2+ years hands‑on focus building and deploying GenAI/LLM enterprise applications.
• Core Technologies: Advanced proficiency in Python and cloud‑native development (AWS, Azure, or Google Cloud).
• AI Frameworks: Deep practical knowledge of RAG architectures, vector search, prompt engineering, and orchestration libraries (LangChain, LlamaIndex, LangGraph).
• Infrastructure: Familiarity with CI/CD pipelines, containerization (Docker, Kubernetes), and API microservices.
• Soft Skills: Proven track record of technical leadership, mentoring, and translating complex technical concepts into clear business value. Strong analytical, communication (written and oral), and interpersonal skills. Ability to prioritize workload and balance multiple initiatives and efforts. Ability to respond quickly to a changing environment.
• Experience fine‑tuning open‑weight foundation models.
• Background in highly regulated industries (bank/finance) navigating strict security protocols.
• Active curiosity about emerging AI tooling, Model Context Protocol (MCP), and automated evaluation loops.

How We’ll Have Your Back

Ally's compensation program offers market‑competitive base pay and pay‑for‑performance incentives (bonuses) based on achieving personal and company goals. Our Total Rewards program includes industry‑leading compensation and benefits plus additional incentives that are designed to meet your needs and those of your family so you can get the most out of your career and your life, including:

Time Away: Program starts at 20 paid time off days in addition to 11 paid holidays and 8 hours of volunteer time off yearly (time off days are prorated based on start date and program varies based on full or part‑time status and management level).

Planning for the Future: plan for the near and long term with an industry‑leading 401K retirement savings plan with matching and company contributions, student loan pay downs and 529 educational save up assistance programs, tuition reimbursement, employee stock purchase plan, and financial learning center and financial coach access.

Supporting your Health & Well‑being: flexible health and insurance options including medical, dental and vision, employee, spouse and child life insurance, short‑and‑long‑term disability, pre‑tax Health Savings Account with employer contributions, Healthcare FSA, critical illness, accident & hospital indemnity insurance, and a total well‑being program that helps you and your family stay on track physically, socially, emotionally, and financially.

Building a Family: adoption, surrogacy and fertility assistance as well as paid parental and caregiver leave, Dependent Day Care FSA back‑up child and adult/elder care days and childcare discounts.

Work‑Life Integration: other benefits including Mentally Fit Employee Assistance Program, subsidized and discounted Weight Watchers program and other employee discount programs.

Other Compensations: depending on the role for which you are considered, you may be eligible for travel allowances, relocation assistance, a signing bonus and/or equity.

To view more detailed information about Ally’s Total Rewards, please visit this link: https://www.ally.com/content/dam/pdf/corporate/ally-total-rewards-snapshot.pdf

Ally is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to age, race, color, sex, religion, national origin, disability, sexual orientation, gender identity or expression, pregnancy status, marital status, military or veteran status, genetic disposition or any other reason protected by law.

In accordance with the Americans with Disabilities Act, if after review of the position expectations, you believe that you may need a medical accommodation to fulfill the duties of this role, please email [e-mail] with details of your accommodation request.

Base Pay Range

$110,000.00 - $180,000.00

An individual's position in the range is determined by the specific role, the scope and responsibilities of the role, work experience, education, certification(s), training, and additional qualifications. We review internal pay, the competitive market, and business environment prior to extending an offer.

Incentive Compensation:

This position is eligible to participate in our annual incentive plan.

We all work better as allies. Join a team that thrives on doing it right — whether we're helping people live their best financial lives or helping each other grow in our careers.

Share your resume with our recruiters so we can reach out to chat about roles that match your background and skillset.

We're a leading financial services company serving over 11M customers through banking, auto financing, insurance and investment services. Our team's approach of celebrating differences and lifting each other up is consistently recognized on Fortune's 100 Best Companies to Work For list. Here, you'll find people who care about doing work that matters and making an impact in the communities we serve. Good enough is never enough for us — we're always looking for ways to be better, together.

CCPA Notice (https://www.ally.com/content/dam/pdf/corporate/ally_careers_ccpa_disclosures_ca_residents.pdf)