Senior Data Engineer

InRhythm; Dallas (TX); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Medical/Dental/Vision plans

401(k) Matching

Scalable PTO

Udemy learning subscriptions

Birthday experiences reimbursement

Media streaming, books, fitness

Job summary

InRhythm is seeking a senior data engineering consultant to lead high-velocity data projects for Fortune 50 clients. You will optimize Spark workloads, design scalable data pipelines, and partner with business stakeholders to translate requirements into reliable data solutions.

The role emphasizes ownership over data quality, production-readiness, and the ability to deliver impactful outcomes with minimal supervision.

Qualifications

• Must have in-depth PySpark optimization experience and ability to write complex logic.
• Hands-on AWS EMR and AWS Glue production experience with Spark workloads.
• Snowflake data modeling and loading in production environments.

Responsibilities

• Design and implement robust data processing pipelines and data models.
• Collaborate with stakeholders to define data requirements and ensure data quality.
• Lead data integration initiatives and optimize end-to-end data flows.

Skills

PySpark optimization

AWS EMR/Glue

Snowflake

Airflow

REST APIs

Observability

Job description

InRhythm is a leading modern product consultancy and digital innovation firm with a mission to make a dent in the digital economy. Founded in 2002, InRhythm is currently engaged by Fortune 50 enterprises to bring their next generation of digital products and platforms to market. InRhythm has helped hundreds of teams launch mission-critical products that have created a positive impact worth billions of dollars. The projects we work on literally change the world.

InRhythm’s unique capabilities of Product Innovation and Platform Modernization services are the most sought-after. The InRhythm team of A+ thought leaders don’t just “get a job,” they join the company to do what they love. It’s that passion that has helped us grow rapidly and consistently deliver on our commitment to helping clients develop better, faster, and in rhythm.

What We Do At InRhythm?

We bring enterprises' most urgent, important products to market with high-velocity, high-quality and 10x impact. We enable innovative high-velocity cultures by coaching teams with the right mix and maturity of modern tools, methods, and thought leadership.

This is a unique opportunity to get in on the ground floor of an evolving team. InRhythm has a “who’s who” clients list and has barely scratched the surface in terms of providing those clients the digital solutions they need to compete. InRhythm clients include a broad range of highly visible and recognizable customers, including, but not limited to:

• Fidelity
• American Express

From greenfield to tier-one builds, our clients look to us to deliver their mission-critical projects in the fields of product strategy, design, cloud native applications, as well as mobile and web development. The projects we work on literally change the world. They change the way we live, work, and think in a positive way.

Critical Skills (Must-Have)

• Advanced PySpark Optimization: Beyond simple transformations, the candidate must be able to write complex business logic and optimize Spark jobs that are currently hitting performance ceilings.
• AWS Data Ecosystem (EMR & Glue): Practical, production experience running Spark workloads on Amazon EMR and AWS Glue.
• Snowflake Architecture: Experience not just querying, but modeling and loading data into Snowflake (specifically their internal mTw instance).
• Workflow Orchestration (Airflow): Proficiency in managing complex dependency chains and DAGs within Airflow.
• REST API Integration: Strong capability in designing patterns for extracting data from various REST API sources reliably.
• Error Handling & Observability: The ability to design "proper error handling" frameworks to catch failures early and manage production incidents autonomously.

Preferred Skills (Nice-to-Have)

• Java Proficiency: While Python is the primary language, the underlying stack is standard Java-based. The ability to read/debug Java is a differentiator.
• Streaming Patterns (Kafka): While the core need appears to be batch/micro-batch, familiarity with Kafka is considered "table stakes" for a modern engineer in this environment.
• Consultative Mandate: The client was emphatic about the "profile" of the consultant. We are not looking for task-executors; we are looking for owners.
• High-Level Ownership: The consultant must demonstrate the ability to take a vague outcome (e.g., "improve data consistency") and drive it to completion without needing micro-management.
• Business Partner Communication: This role requires direct interaction with business stakeholders to define logic for the Case Authorization project. The consultant must speak "business" as well as "code."
• Production Maturity: The ideal candidate understands the gravity of production systems. They do not just write code that passes a unit test; they write code that survives production volumes and edge cases.
• Outcome Over Tenure: The client explicitly stated they value capability over years of experience. A brilliant engineer with 4 years of experience is preferred over a passive engineer with 10 years.

Why Work At InRhythm?

We’ve been named an Inc. 5000 Hall of Fame Fastest Growing Company for 9 years, Deloitte Fast 500 company for 5 years, and Consulting Magazine Fastest Growing Company winner several years in a row. If you’re looking forward to working with awesome colleagues in a high- growth environment and tight-knit community, we’re looking forward to hearing from you.

At InRhythm we believe in building a better workplace. When you join our team, you can expect a number of work/life benefits:

Comprehensive and customizable Medical, Dental, and Vision Plans

• 401(k) + Matching
• Scalable PTO
• Udemy subscription for continuous learning
• Reimbursements for personalized birthday experiences
• Media Streaming, Book, and Fitness Allowances