Data Engineer: Real-Time Pipelines on Databricks, Spark & Kafka

IBOTIX US Inc.; Richardson (TX); Híbrido; USD 83.000 - 124.000; Jornada completa

Descripción de la vacante

IBOTIX US Inc. is hiring a Data Engineer to design, develop, and maintain scalable data processing and streaming solutions across hybrid work locations including Richardson, TX and other cities.

The role requires strong Databricks, Scala, Spark, and Kafka skills, with experience building batch and real-time pipelines and data governance knowledge. This long term contract offers collaboration with cross-functional teams and performance-focused delivery.

Formación

• Strong hands-on experience with Databricks.
• Excellent programming skills in Scala.
• Strong experience with Apache Spark.
• Hands-on experience with Kafka and real-time data streaming.
• Experience designing and developing scalable data pipelines.
• Strong understanding of data processing, transformation, and integration concepts.

Responsabilidades

• Develop and maintain scalable batch and real-time data pipelines using Databricks, Spark, Scala, and Kafka.
• Build data ingestion and transformation frameworks for large-scale datasets.
• Implement and support CDC-based data pipelines where required.
• Optimize Spark jobs and Databricks workloads for performance and scalability.
• Work with Unity Catalog for data governance and access management.
• Develop complex SQL queries for data transformation and validation.
• Collaborate with data architects, developers, and business teams to deliver reliable data solutions.
• Troubleshoot production issues and ensure data pipelines meet performance and reliability requirements.

Conocimientos

Databricks

Scala

Apache Spark

Kafka

Data pipelines

Data processing

Troubleshooting

Herramientas

Unity Catalog

SQL

CDC

Descripción del empleo

IBOTIX US Inc. is hiring a Data Engineer to design, develop, and maintain scalable data processing and streaming solutions across hybrid work locations including Richardson, TX and other cities.

The role requires strong Databricks, Scala, Spark, and Kafka skills, with experience building batch and real-time pipelines and data governance knowledge. This long term contract offers collaboration with cross-functional teams and performance-focused delivery.