Senior Data Engineer: Scalable Pipelines & Identity

Ryz Labs; United States; Remote; USD 150,000 - 190,000; Full time

Job summary

Ryz Labs is seeking a Senior Data Engineer to own and scale data pipelines across a large data ecosystem. You will optimize ingestion, transformation, and publishing from multiple sources, focusing on accuracy, reliability, and downstream power for analytics and products.

Responsibilities include building batch and event-driven workflows with Python and AWS, solving identity resolution and deduplication challenges, and implementing data quality and observability frameworks.

Qualifications

• At least 5+ years building and operating production data pipelines and infra.
• Strong experience with batch and event-driven architectures.
• Proficient in Python and SQL for data processing and analysis.
• Experience with identity resolution, entity matching and deduplication.
• Knowledge of durable identifiers and mapping strategies over time.
• Experience with event schemas and protobuf/schema-registry contracts; schema evolution awareness.
• Strong incident response and production troubleshooting skills.
• Ability to read/debug functional/concurrent code (e.g., Elixir).

Responsibilities

• Own and evolve data ingestion pipelines from multiple sources into the platform.
• Design and maintain scalable batch and event-driven data workflows with Python and AWS.
• Address identity resolution, entity matching, and deduplication challenges.
• Develop data quality frameworks: freshness, null-rate, and schema-drift checks.
• Monitor ingestion boundaries and troubleshoot issues before downstream impact.
• Collaborate with infra and downstream identity teams to trace data end-to-end.
• Work with Product/Analytics teams to align pipelines with requirements.
• Leverage Glue, Athena, S3, DynamoDB to build reliable data infrastructure.
• Automate infra and pipeline changes via Terraform or AWS CDK.
• Participate in production incident response and remediation efforts.
• Improve reliability, observability, and maintainability of data pipelines.

Skills

Data pipelines

Batch processing

Event-driven architectures

Python

SQL

Identity resolution

Entity matching

Data quality

Observability

Terraform

AWS CDK

AWS Glue

Athena

S3

DynamoDB

Protobuf/schema-registry

Elixir (basic)

Tools

AWS Glue

Athena

S3

DynamoDB

Terraform

AWS CDK

Protobuf

Job description

Ryz Labs is seeking a Senior Data Engineer to own and scale data pipelines across a large data ecosystem. You will optimize ingestion, transformation, and publishing from multiple sources, focusing on accuracy, reliability, and downstream power for analytics and products.

Responsibilities include building batch and event-driven workflows with Python and AWS, solving identity resolution and deduplication challenges, and implementing data quality and observability frameworks.