Senior Lead Data Engineer – HR Data Platforms

Fairygodboss; New York (NY); On-site; USD 150,000 - 190,000; Full time

Job summary

JPMorgan Chase is seeking a Senior Lead Software Engineer to drive data engineering initiatives across HR and Employee Experience data products. You will lead architecture, pipelines, and governance while guiding teams through SDLC, security, and cost-of-ownership considerations.

You will partner with Product and Architecture to shape data strategy, improve TDQ/BDQ, and push for scalable, reusable data production frameworks across the enterprise.

Qualifications

• Formal training or certification on software engineering concepts and 5+ years applied experience anticipate and solve complex technical items within your domain of expertise.
• Hands-on Data Engineering development, coding, AI-code tools and techniques, testing, automation
• Key Technical Skills: Databricks, DBX, PySpark, Spark, Terraform, Kafka, Python/Scala, Glue/EMR
• Experience with AI Developer Automation Tools and the use of BI Consumption tools such as: Sigma, Genie, Tableau
• Experience with Governance using Unity Catalogue and Data Access Governance with Immuta
• Experience in working in cross-functional teams of technologists.
• Experience dealing with internet scale volume and size of data.
• Experience in Big Data technologies handling complex data processing requirements.
• Experience building data pipelines and platforms in cloud (AWS S3, Databricks, GCP, Azure)

Responsibilities

• Provide hands on delivery of data pipeline and architecture solutions that can be leveraged across multiple businesses that are easily augmented, exchanged, rotated, etc.
• Be proficient in all aspects of the data production pipeline are driven by x-as-Code (extraction, transformation, reconciliation, data quality (business, technical), security).
• Bring trends in both test-driven and data-driven development building modular designs that can be auto-repeatable as frameworks to build a data production factory, minimizing ad hoc data generation.
• Transform traditional HR/EX into modern data product offerings that scales for business needs.
• Perform as a key member of data engineering scrum teams to achieve functional technology objectives. while influencing peer leaders and senior stakeholders across the business, product, and data technology teams.
• Partner with Product and Architecture to make strategic decisions that influence teams' resources, budget, tactical operations, and the implementation of processes and procedures.
• Be accountable for SDLC, design patterns and upskilling engineers
• Uplift and modernize data platforms driving Stability, Timeliness, Completeness, Quality (TDQ/BDQ), Security, FinOps, Operational Excellence and Ease of consumption.
• Carry governance accountability for coding decisions, control obligations, and measures of success such as cost of ownership, maintainability, and portfolio operations.
• Advance and support the firm's culture of diversity, opportunity, inclusion, and respect

Skills

Data Engineering

Python/Scala

Spark

Databricks

Terraform

Kafka

Cloud data platforms

AI automation tools

BI tools

Cross-functional collaboration

Tools

Databricks

DBX

PySpark

Spark

Terraform

Kafka

Python/Scala

Glue/EMR

Tableau

Sigma

Genie

Job description

JPMorgan Chase is seeking a Senior Lead Software Engineer to drive data engineering initiatives across HR and Employee Experience data products. You will lead architecture, pipelines, and governance while guiding teams through SDLC, security, and cost-of-ownership considerations.

You will partner with Product and Architecture to shape data strategy, improve TDQ/BDQ, and push for scalable, reusable data production frameworks across the enterprise.