Cloud Data Engineer – Real-Time Pipelines & ML

Redolent Infotech Pvt. Ltd.; Irving (TX); On-site; USD 120,000 - 160,000; Full time

Job summary

Redolent Infotech Pvt. Ltd. in Irving, TX is seeking a Data Engineer specializing in automation controls to build data pipelines, transform models, and support ML platforms. The role emphasizes production-ready, scalable solutions and cloud deployment.

You will work with Product Owners and customers in an agile environment, developing data products, APIs, and data delivery services for critical operations and analytics. Strong Java/Scala/Python and Spark experience are required.

Qualifications

• BS degree in Computer Science, Data Engineering or similar.
• 5+ years of experience designing and developing Data Pipelines for Data Ingestion or Transformation using Java, Scala or Python.
• At least 4 years of experience with Big Data frameworks and file formats (Parquet, AVRO, ORC) and distributed processing.
• 5+ years applying monitoring, build tools, version control, unit testing, TDD and change management to DevOps workflows.
• At least 2 years of SQL and Shell scripting experience.

Responsibilities

• Design and develop data pipeline frameworks to automate high-volume and real-time data delivery for Spark and streaming data hub.
• Transform analytical models into scalable, production-ready solutions.
• Support and enhance an advanced anomaly detection ML platform.
• Continuously integrate and ship code into cloud production environments.
• Develop cloud-based applications using a modern technology stack.

Skills

Data Pipelines

Java

Scala

Python

Big Data

DevOps

SQL

Shell Scripting

Spark

Hadoop

Education

BS in Computer Science / Data Engineering

Tools

Parquet/AVRO/ORC

Hadoop Stack

Spark

HBase

Kafka

NiFi

Oozie

Airflow

Cognos/Tableau

Job description

Redolent Infotech Pvt. Ltd. in Irving, TX is seeking a Data Engineer specializing in automation controls to build data pipelines, transform models, and support ML platforms. The role emphasizes production-ready, scalable solutions and cloud deployment.

You will work with Product Owners and customers in an agile environment, developing data products, APIs, and data delivery services for critical operations and analytics. Strong Java/Scala/Python and Spark experience are required.