Senior Data Engineer — Spark, Python & Scala

LTM; Irving (TX); On-site; USD 100,000 - 130,000; Full time

Benefits offered by this job

Comprehensive Medical Plan Covering Medical, Dental, Vision

Short Term and Long-Term Disability Coverage

401(k) Plan with Company match

Life Insurance

Paid Paternity and Maternity Leave

Job summary

LTM in Irving, Texas is seeking a Senior Data Engineer with 3 to 5 years of experience to design and optimize big scalable data processing solutions. The ideal candidate will have expertise in Python, Scala, and Spark SQL, and will collaborate with cross-functional teams to integrate solutions into existing systems.

This role includes responsibilities such as developing scalable data pipelines, optimizing Spark jobs, and mentoring junior team members. Comprehensive benefits include medical coverage, 401(k) plan, and paid leave.

Qualifications

• 3 to 5 years of experience in Python, Scala, and Spark SQL.
• Expertise in designing scalable data processing solutions within the Databricks ecosystem.
• Ability to troubleshoot and resolve performance bottlenecks in Spark jobs.

Responsibilities

• Design and deploy complex data processing workflows leveraging Apache Spark, Scala, Python, and SparkSQL.
• Collaborate with data engineers and stakeholders to translate business requirements into technical solutions.
• Participate in architectural discussions to evolve big data platforms.

Skills

Python

Scala

Spark SQL

Job description

LTM in Irving, Texas is seeking a Senior Data Engineer with 3 to 5 years of experience to design and optimize big scalable data processing solutions. The ideal candidate will have expertise in Python, Scala, and Spark SQL, and will collaborate with cross-functional teams to integrate solutions into existing systems.

This role includes responsibilities such as developing scalable data pipelines, optimizing Spark jobs, and mentoring junior team members. Comprehensive benefits include medical coverage, 401(k) plan, and paid leave.