Senior Data Engineer: Real-Time Pipelines at Enterprise Scale

Tiger Analytics; Dallas (TX); Hybrid; USD 120,000 - 170,000; Full time

Job summary

Tiger Analytics is looking for an experienced Data Engineer to design, build, and operate large-scale batch and real-time data pipelines powering enterprise data and analytics platforms. You will work closely with Agile engineering, architecture, and product teams to build reliable, scalable data solutions spanning ingestion, transformation, orchestration, event streaming, and downstream data delivery.

The ideal candidate has 4+ years of experience with data pipelines, Java, Python, and SQL, and

Qualifications

• 4+ years of experience building or operating enterprise-scale data pipelines and orchestration systems.
• 4+ years of data or application engineering with Java, Python, and SQL.
• 4+ years of experience with Kafka, Spark, EMR, Hadoop, or equivalent.
• 2+ years of experience with Airflow, Control-M, Autosys, Step Functions, or equivalent.
• Experience with cloud data warehouses/data platforms at scale.

Responsibilities

• Design and develop high-volume batch and real-time data pipelines for enterprise applications and analytics platforms.
• Build end-to-end data solutions covering ingestion, transformation, orchestration, streaming, and downstream delivery.
• Develop event-driven and real-time data processing solutions using technologies such as Kafka and Spark.
• Build scalable data processing solutions using distributed computing frameworks such as Spark, EMR, Hadoop, or equivalent.
• Develop applications and data solutions using Java, Python, and SQL.
• Implement and manage workflow orchestration and scheduling for complex data pipelines.
• Work with cloud data warehouse and cloud-native data platforms to support enterprise-scale workloads.
• Design solutions with a strong focus on reliability, scalability, performance, security, and low latency.
• Implement secure approaches for secrets management, credentials, and service-to-service authentication in production environments.

Skills

Java

Python

SQL

Kafka

Spark

Airflow

Cloud platforms

Tools

Airflow

Control-M

Autosys

Step Functions

Job description

Tiger Analytics is looking for an experienced Data Engineer to design, build, and operate large-scale batch and real-time data pipelines powering enterprise data and analytics platforms. You will work closely with Agile engineering, architecture, and product teams to build reliable, scalable data solutions spanning ingestion, transformation, orchestration, event streaming, and downstream data delivery.

The ideal candidate has 4+ years of experience with data pipelines, Java, Python, and SQL, and