Big Data Developer- Pyspark, SQL, Scala

LTM; Irving (TX); On-site; USD 100,000 - 130,000; Full time

Benefits offered by this job

Comprehensive Medical Plan Covering Medical, Dental, Vision

Short Term and Long-Term Disability Coverage

401(k) Plan with Company match

Life Insurance

Paid Paternity and Maternity Leave

Job summary

LTM is seeking a Senior Big Data Engineer located in Irving, Texas, with 5 to 10 years of experience to design and implement scalable data processing solutions. Candidates should be proficient in Apache Spark and Python while collaborating with cross-functional teams to deliver high-quality data solutions.

The role includes mentoring junior members and optimizing data workflows. Comprehensive medical plans, 401(k) with company match, and paid parental leave are among the perks offered.

Qualifications

• 5 to 10 years of experience in Big Data Engineering.
• Proficient in Apache Spark and Python.
• Experience in developing data pipelines and ensuring data quality.

Responsibilities

• Design and develop high-performance data processing applications.
• Analyze complex datasets to extract actionable insights.
• Mentor junior team members and promote knowledge sharing.

Skills

Apache Spark

Python

Scala

PL/SQL

Job description

Work Location: Irving, Texas

Job Description

• Seeking a Senior Big Data Engineer with 5 to 10 years of experience proficient in Apache Spark and Python to design and implement scalable data processing solutions within the Python Data domain
• Scala, PL/SQL
• Develop and maintain robust and scalable data pipelines using Apache Spark and Python. Collaborate with data scientists and analysts to optimize data workflows and enhance data quality. Ensure data integrity and consistency across large and complex datasets. Implement efficient data transformations and aggregations to support analytics and reporting needs. Work closely with cross-functional teams to integrate data solutions seamlessly into existing systems. Monitor and troubleshoot data processing jobs to maintain high reliability and performance. Stay updated with emerging trends, technologies and best practices in big data and Python development

Roles and Responsibilities

• Design, develop and optimize high performance data processing applications leveraging Apache Spark. Write clean, reusable and efficient Python code to support various data engineering initiatives.
• Analyze complex datasets to extract actionable insights and identify data trends.
• Collaborate with stakeholders to gather requirements and deliver tailored data solutions that meet business objectives.
• Mentor junior team members and promote knowledge sharing within the team.
• Participate actively in code reviews to ensure adherence to coding standards and best practices.
• Manage deployment of data pipelines and continuously monitor their health and performance in production environments.

Benefits and Perks

• Comprehensive Medical Plan Covering Medical, Dental, Vision
• Short Term and Long-Term Disability Coverage
• 401(k) Plan with Company match
• Life Insurance
• Paid Paternity and Maternity Leave

The range displayed on each job posting reflects the minimum and maximum salary target for the position across all Canada locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.

LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, colour, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family‑care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.