Senior Data Engineer - Databricks & Spark Expert

Tiger Analytics; Dallas, Northern (TX, KY); Hybrid; USD 130,000 - 180,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

Retirement accounts

Long and short term disability

Life Insurance

HSA/FSA accounts

Discretionary time-off

Job summary

Tiger Analytics is seeking a Senior Data Engineer to join our AI and advanced analytics team. You will design, build, and maintain scalable data pipelines, processing large datasets and managing scheduled data workflows to support enterprise data engineering initiatives.

Ideal candidates have 8+ years in data engineering, hands-on Databricks, Spark, Python, Scala, Hadoop, and Control-M experience, plus strong SQL and collaboration skills.

Qualifications

• 8+ years of Data Engineering experience.
• Proficiency with Databricks and Apache Spark.
• Python and Scala for data processing and development.
• Hands-on with Hadoop and big data tech.
• Experience with Control-M for batch scheduling and orchestration.
• Strong ETL/ELT expertise and data transformations.
• Production support, debugging, and performance tuning.
• Strong SQL and data management fundamentals.
• Excellent analytical and collaboration skills.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks, Spark, Python, and Scala.
• Develop and optimize ETL/ELT processes across diverse data sources.
• Work with Hadoop ecosystems to manage large data volumes.
• Optimize Spark applications for performance and reliability.
• Use Control-M to schedule and monitor batch jobs and workflows.
• Troubleshoot pipeline failures and ensure timely processing.
• Implement data validation and quality checks.

Skills

Data pipeline design

Performance tuning

Production support

Collaborative skills

Analytical thinking

Tools

Databricks

Apache Spark

Python

Scala

Hadoop

Control-M

SQL

Job description

Tiger Analytics is seeking a Senior Data Engineer to join our AI and advanced analytics team. You will design, build, and maintain scalable data pipelines, processing large datasets and managing scheduled data workflows to support enterprise data engineering initiatives.

Ideal candidates have 8+ years in data engineering, hands-on Databricks, Spark, Python, Scala, Hadoop, and Control-M experience, plus strong SQL and collaboration skills.