Specialist - Data Engineering

LTM; Tampa (FL); On-site; USD 110,000 - 140,000; Full time

Benefits offered by this job

Medical plan

Disability coverage

401(k) with company match

Life insurance

Parental leave

Paid vacation and holidays

Job summary

LTIMindtree in Tampa, FL is seeking a PySpark Developer to design, build and optimize large-scale data pipelines using PySpark and Spark SQL. You will work with Azure Databricks, ADF, Synapse and Hadoop ecosystems, integrate with DataOps practices, and collaborate with data engineers, analysts and DevOps in an Agile environment.

Strong SQL, Linux, ETL fundamentals and Python scripting are required, plus a banking analytics background is a plus.

Qualifications

• Hands-on PySpark and Apache Spark experience.
• Strong SQL and relational database knowledge.
• Experience in Linux/Unix environments.
• ETL and large-scale data processing.
• Exposure to Azure Databricks, ADF, Synapse or similar.
• Hadoop ecosystem (Hive, HDFS).
• Airflow orchestration knowledge.
• Python scripting beyond Spark usage.
• Agile and DevOps delivery practices.
• Banking/BFSI analytics exposure is a plus.
• Strong problem-solving and ownership mindset.
• Cross-functional collaboration and communication skills.

Responsibilities

• Design, develop and optimize data pipelines using PySpark for large-scale processing.
• Transform, validate and aggregate data with Spark SQL and DataFrames.
• Write and optimize SQL queries for data extraction and reporting.
• Perform data quality checks and profiling.
• Troubleshoot production pipelines and perform root-cause analysis.
• Collaborate with data engineers, analysts, QA and DevOps in Agile teams.
• Enhance Spark job performance for scalability and efficiency.
• Maintain documentation, runbooks and technical workflows.
• Adhere to enterprise coding, deployment and change-management standards.
• Self-direct learning of new big-data technologies and cloud platforms.

Skills

PySpark

SQL

Linux/Unix

ETL

Airflow

Python scripting

Agile/DevOps

Spark SQL

Data processing

Banking analytics (BFSI)

Tools

Azure Databricks

ADF

Synapse

Hadoop/Hive/HDFS

Airflow

Job description

Job Summary

Pyspark Developer – Tampa, Florida

Responsibilities

• Design, develop and maintain data pipelines using PySpark for large‑scale data processing
• Perform data transformations, aggregations and validations using Spark SQL and DataFrames
• Write and optimize SQL queries for data extraction, reconciliation and reporting
• Perform data quality checks, profiling and consistency validations
• Support existing data pipelines by troubleshooting failures and performing root‑cause analysis
• Work closely with data engineers, analysts, QA and DevOps teams in Agile delivery models
• Optimize performance of Spark jobs for efficiency and scalability
• Maintain technical documentation, workflows and runbooks
• Follow enterprise standards for coding, deployment and change management
• Self‑directed learning of new big‑data technologies and cloud data platforms

Qualifications

• Strong hands‑on experience with PySpark and Apache Spark
• Solid understanding of SQL and relational database concepts
• Experience working in Linux/Unix environments
• Understanding of ETL concepts and large‑scale data processing
• Strong analytical and debugging skills
• Experience supporting production data pipelines and exposure to Azure Databricks, ADF, Synapse or similar cloud data platforms
• Experience with Hadoop ecosystem (Hive, HDFS)
• Knowledge of orchestration tools such as Airflow
• Python scripting beyond Spark use cases
• Familiarity with Agile and DevOps delivery practices
• Domain exposure to Banking/BFSI analytics is an advantage
• Strong problem‑solving and ownership mindset
• Ability to work collaboratively in cross‑functional teams
• Excellent communication and documentation skills
• Ability to adapt quickly to dynamic project environments

Benefits and Perks

• Comprehensive medical plan covering medical, dental, and vision
• Short‑Term and Long‑Term Disability Coverage
• 401(k) plan with company match
• Life insurance
• Paid maternity and paternity leave
• Vacation time, sick leave, and paid holidays

Actual compensation within the range will be dependent upon the individual's skills, experience, performance, and internal equity. The range displayed on each job posting reflects the minimum and maximum salary target for the position across all US locations. Other forms of compensation may be provided as part of overall compensation, such as an annual performance‑based bonus, sales incentive pay, and other variable compensation.

LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth, or related medical conditions), gender identity or expression, national origin, ancestry, age, family‑care status, veteran status, marital status, civil union status, domestic partnership status, military service, disability or history of disability, genetic information, union affiliation, sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.