Senior Data Engineer — AI-Driven Data Pipelines

Recurring Decimal Inc.; Dallas (TX); Sur place; USD 130 000 - 190 000; Plein temps

Résumé du poste

Recurring Decimal Inc. seeks a Senior Data Engineer to design and scale data pipelines across ingestion, transformation, and delivery. You’ll own end-to-end data workflows, collaborate with backend, BI, and ML teams, and actively integrate AI tooling to accelerate development.

You will optimize ETL/ELT processes, implement event-driven pipelines, manage schemas, and ensure reliability with CI/CD practices. Strong Python/SQL skills are essential for this role.

Qualifications

• 5+ years of data engineering experience
• Strong command of Python and SQL
• Experience with large-scale data pipelines and ETL/ELT
• Hands-on with AI tooling and modern data tooling
• Proficient in streaming and event-driven architectures

Responsabilités

• Design, build, and maintain scalable ingestion and processing pipelines
• Optimize ETL/ELT workflows and resolve production bottlenecks
• Integrate multiple data sources including structured and unstructured data
• Develop event-driven pipelines using event buses (Kafka, AWS EventBridge)
• Build real-time data flows and manage schema/versioning across consumers
• Maintain CI/CD pipelines for data workflows (Git, Jenkins, GitHub Actions)
• Ensure data quality, monitoring, and end-to-end testing
• Collaborate with backend and BI teams for API and data integration
• Contribute to data architecture and provisioning of new sources
• Write clean, reliable Python and shell scripts across SDLC

Connaissances

Python

SQL

PySpark/Scala

Unix scripting

APIs

Data quality

NoSQL/GraphQL

AI tooling

Agile/Scrum

Outils

Airflow

SnapLogic

DBT

Kafka

AWS EventBridge

SNS/SQS

Kinesis

Snowflake

Delta Lake

Redshift

BigQuery

Git

Jenkins

GitHub Actions

Docker

Description du poste

Recurring Decimal Inc. seeks a Senior Data Engineer to design and scale data pipelines across ingestion, transformation, and delivery. You’ll own end-to-end data workflows, collaborate with backend, BI, and ML teams, and actively integrate AI tooling to accelerate development.

You will optimize ETL/ELT processes, implement event-driven pipelines, manage schemas, and ensure reliability with CI/CD practices. Strong Python/SQL skills are essential for this role.