Corporate Sector - Lead Data Engineer

JPMorgan Chase; Houston (TX); On-site; USD 160,000 - 210,000; Full time

Job summary

JPMorgan Chase in Houston seeks a Lead data Engineer to architect and build secure, scalable data platforms for backup, recovery, and analytics. You will own observability dashboards and runbooks, and drive reliability with SRE practices.

Responsibilities cover data modeling, platform automation, cloud-native AWS tooling, and governance across relational and NoSQL estates, delivering SLIs/SLOs and compliant recovery readiness.

Qualifications

• Typically 8+ years of engineering experience leading production systems.
• ],
• job_responsibilities_description [

Responsibilities

• Design, build, and maintain observability dashboards across data platforms and backup/recovery services using Grafana, Dynatrace, and Tableau.
• Define dashboard standards, ownership, and lifecycle management for consistent adoption.
• Ensure end-to-end instrumentation and actionable signals for platform KPIs (availability, latency, backlog, data freshness).
• Establish SLIs/SLOs and publish dashboards for executives and governance.
• Own data architecture and modeling for lakehouse/warehouse patterns and data contracts.
• Drive automation-first platform engineering with AWS, IaC, CI/CD practices.
• Embed SRE by tracking reliability metrics, incident learning, and runbooks.

Skills

Python

Java

Go

C#

Observability & monitoring

AWS cloud

CI/CD

Tools

Grafana

Dynatrace

Tableau

Jenkins

GitLab/GitHub Actions

Job description

Join a team that builds secure, scalable data pipelines and platforms for collection, access and analytics.

As a Lead data Engineer, within the Corporate Sector you will lead architecture and engineering for scalable backup, recovery, immutable-data protection, and recovery-assurance services across data platforms and storage tiers and deliver data collection, storage, access, and analytics platform solutions in a secure, stable, scalable way, with clear SLOs/SLAs and operational readiness gates.

Job Responsibilities

Observability (Dashboards: Grafana, Dynatrace, Tableau)

• Design, build, and maintain role-based observability dashboards for data platforms and backup/recovery services using Grafana, Dynatrace, and Tableau , providing real-time and historical visibility into platform health, performance, and risk posture.
• Define and govern dashboard standards and operating model (golden dashboards, drill-down paths, naming/tagging conventions, ownership, and lifecycle management) to drive consistent adoption across Engineering, SRE, Operations, and Risk.
• Ensure end-to-end instrumentation and telemetry quality so dashboards surface actionable signals (availability, latency, throughput, error rates, saturation) and platform KPIs (job success/failure, lag/backlog, data freshness, restore success, retention coverage).
• Establish and publish SLIs/SLOs and operational health KPIs; translate these into Grafana/Dynatrace visualizations and Tableau reporting for executive and governance stakeholders.

Data Architecture, Modeling, and Governance

• Generate and govern data models using firmwide tooling; apply linear algebra, statistical, and geometric algorithms where relevant for modeling and optimization.
• Own and continuously improve the strategy for database backup, recovery, archiving, retention, and restore testing across relational and NoSQL estates.

Platform Engineering & Automation

• Drive an automation-first, API-led, self-service approach that reduces operational toil and improves resilience and customer experience.
• Build cloud-native capabilities using AWS services , infrastructure as code , CI/CD , and modern software engineering practices.

Reliability Engineering (SRE) & Operational Excellence

• Embed SRE principles by defining and tracking reliability metrics ( SLIs/SLOs ), implementing observability standards, leading incident learning, and maintaining runbooks and recovery playbooks .
• Participate in an on-call and incident leadership rotation , acting as an escalation point for complex platform and data reliability issues.

Security, Controls, and Recovery Assurance

• Assess and report on access control effectiveness and data asset security posture ; partner with security/risk to remediate gaps.
• Design preventive/detective controls, policy guardrails, automated validation, and audit-ready evidence for platform controls and recovery readiness.
• Deliver telemetry, reporting, and operational intelligence for backup health, compliance, and recovery assurance (coverage, success rates, RPO/RTO attainment).

Technical Leadership & Delivery Management

• Set engineering standards, perform high-quality code reviews, mentor engineers, and influence stakeholders across product, architecture, security, and SRE.
• Coordinate cross-team delivery with explicit dependencies, milestones, and measurable outcomes; manage technical debt and balance reliability/security work alongside feature delivery.

Core Engineering Scope (Hands-on)

• Data architecture & modeling (lakehouse/warehouse patterns, dimensional modeling, data contracts)
• Advanced SQL (performance tuning, warehousing design)
• Pipeline engineering & orchestration (reliable batch workflows, backfills, SLAs)
• Distributed processing (e.g., Spark; partitioning, joins/shuffles, file formats)
• Data quality & testing (automated checks: schema/freshness/volume/business rules)

Required Qualifications, Capabilities, and Skills

• Typically 8+ years of applied engineering experience (software engineering or related discipline), including leading production-critical systems ; experience with both relational and NoSQL databases.
• Proficient across the data lifecycle (ingestion, modeling, storage, serving, governance, operations) with demonstrated experience building distributed systems , platform services , APIs , and automation frameworks.
• Strong knowledge of enterprise data protection , backup/recovery, cyber resilience, immutable storage, retention, and recovery testing.
• Advanced AWS experience spanning backup/data protection services, IAM/security , networking fundamentals, observability, and infrastructure automation.
• Hands-on experience with observability/monitoring platforms such as Dynatrace and Grafana .
• Proficiency in Python and at least one additional language (e.g., Java, Go, C# ).
• Experience with CI/CD platforms (e.g., Jenkins, GitLab, GitHub Actions ) and implementing database backup/recovery/archiving strategies with measurable RPO/RTO targets.
• Profici