Senior Data Engineer AI-Driven Pipelines & Real-Time Data

Robotic Technologies Automation; Dallas (TX); On-site; USD 140,000 - 200,000; Full time

Job summary

Robotic Technologies Automation in Dallas is seeking a Senior Data Engineer to design and operate scalable data infrastructure across ingestion, transformation, and delivery. You’ll partner with backend, BI, and ML teams to integrate AI tooling into data workflows.

The role requires deep Python/SQL, Spark/Scala, and experience with event-driven architectures, CI/CD, and data quality. On-site position, competitive compensation, and strong ownership mindset.

Qualifications

• Strong Python and SQL abilities with experience in PySpark or Scala.
• Experience building scalable data ingestion and processing pipelines.
• Hands-on with ETL/ELT workflows and event-driven architectures.
• Familiarity with AI tooling is a plus.

Responsibilities

• Design, build, and maintain scalable data ingestion and processing pipelines.
• Optimize ETL/ELT workflows and resolve bottlenecks in production.
• Integrate multiple data sources from internal and external systems.
• Implement event-driven pipelines using Kafka, AWS EventBridge, SNS/SQS, or similar.
• Build real-time data flows and manage event schemas.
• Ensure CI/CD for data workflows using Git/Jenkins/GitHub Actions.
• Monitor pipelines with logging and testing; participate in on-call.
• Collaborate with backend/BI for API and data integration.
• Design schema definitions; support data warehouse/mart integration.
• Provide scalable provisioning for new data sources.
• Write clean Python and Shell code across lifecycle.
• Work in Agile/Scrum; align team priorities.
• Leverage AI-assisted dev tools to accelerate delivery.

Skills

Python

Advanced SQL

PySpark

Scala

Unix scripting

Airflow

SnapLogic

DBT

CI/CD tooling

APIs data exchange

Data quality

NoSQL/Neo4j/GraphQL

Tools

Snowflake

Delta Lake

Redshift

BigQuery

Kafka

AWS EventBridge

SQS

Docker

Git

Jenkins

GitHub Actions

Spark

Job description

Robotic Technologies Automation in Dallas is seeking a Senior Data Engineer to design and operate scalable data infrastructure across ingestion, transformation, and delivery. You’ll partner with backend, BI, and ML teams to integrate AI tooling into data workflows.

The role requires deep Python/SQL, Spark/Scala, and experience with event-driven architectures, CI/CD, and data quality. On-site position, competitive compensation, and strong ownership mindset.