Senior Data Engineer: Real-Time, Scalable Pipelines

Tiger Analytics Inc.; Dallas (TX); On-site; USD 110,000 - 190,000; Full time

Job summary

Tiger Analytics Inc. is seeking an experienced Data Engineer to design, build, and operate large-scale batch and real-time data pipelines powering enterprise data and analytics platforms.

You will work with Agile engineering, architecture, and product teams to build reliable, scalable data solutions spanning ingestion, transformation, orchestration, event streaming, and downstream data delivery. The ideal candidate has 4+ years in data engineering and distributed systems, with cloud experience

Qualifications

• 4+ years of experience building or operating enterprise-scale data pipelines.
• 4+ years of data engineering with Java, Python, and SQL.
• 4+ years of experience with real-time or event-driven data systems.
• 4+ years of experience with distributed data and computing technologies such as Kafka, Spark, EMR, Hadoop.
• 4+ years of experience with cloud data warehouses/data platforms at scale.
• 4+ years of experience with AWS, Azure, or GCP.
• 3+ years with workflow orchestration tools like Airflow, Control-M, Autosys, Step Functions.
• 2+ years implementing secure secrets management in production.
• 2+ years working in Agile engineering teams.
• Strong understanding of distributed systems and data architectures.

Responsibilities

• Design and develop high-volume batch and real-time data pipelines for enterprise applications.
• Build end-to-end data solutions covering ingestion, transformation, orchestration, streaming, and downstream delivery.
• Develop event-driven and real-time data processing with Kafka and Spark.
• Build scalable data processing using Spark, EMR, Hadoop, or equivalents.
• Develop applications using Java, Python, and SQL.
• Implement and manage workflow orchestration and scheduling for complex pipelines.
• Work with cloud data warehouses and cloud-native data platforms for scale.
• Design solutions prioritizing reliability, scalability, performance, security, and low latency.
• Implement secure secrets management and service-to-service authentication in production.

Skills

Strong problem-solving

Communication

Collaboration

Analytical mindset

Data quality awareness

Tools

Kafka

Spark

EMR

Hadoop

Airflow

Step Functions

Autosys

Control-M

Job description

Tiger Analytics Inc. is seeking an experienced Data Engineer to design, build, and operate large-scale batch and real-time data pipelines powering enterprise data and analytics platforms.

You will work with Agile engineering, architecture, and product teams to build reliable, scalable data solutions spanning ingestion, transformation, orchestration, event streaming, and downstream data delivery. The ideal candidate has 4+ years in data engineering and distributed systems, with cloud experience