Associate Principal - Data Sciences

LTM; Tampa (FL); Sur place; USD 120 000 - 180 000; Plein temps

Avantages offerts par ce poste

Comprehensive Medical Plan

401(k) Plan with Company match

Life Insurance

Vacation Time, Sick Leave, Paid Holidá

Résumé du poste

LTIMindtree is seeking a Data Architect with strong PySpark skills to design, develop and optimize large-scale data processing solutions for analytics and data engineering initiatives. You will build scalable data pipelines, ETL/ELT processes, and collaborate with data scientists, analysts and other engineers while leveraging AWS, Azure, or GCP and Databricks platforms.

The role requires Databricks certification and hands-on experience with Spark, SQL, Hadoop, and modern data warehousing

Qualifications

• Strong experience in Python and PySpark development.
• Hands-on experience with Apache Spark, Spark SQL, DataFrames, and Spark Streaming.
• Strong knowledge of SQL and relational databases.
• Experience with ETL development and data warehousing concepts.
• Familiarity with Hadoop ecosystem technologies (HDFS, Hive, Yarn).
• Experience with version control systems such as Git.
• Understanding of distributed computing concepts and performance tuning.
• Knowledge of workflow orchestration tools such as Airflow, Oozie, or Azure Data Factory.
• Strong analytical and problem-solving skills.

Responsabilités

• Design, develop, and maintain scalable data pipelines using PySpark.
• Build and optimize ETL/ELT processes for structured and unstructured data.
• Process large datasets using Apache Spark in distributed environments.
• Collaborate with analysts and data scientists to understand data requirements.
• Integrate data from databases, APIs, and cloud storage.
• Develop data quality checks and monitoring mechanisms.
• Work with cloud platforms such as AWS, Azure, or GCP for data engineering.
• Participate in code reviews and adhere to development standards.

Connaissances

Python

PySpark

Spark SQL

DataFrames

Spark Streaming

SQL

ETL

Data Warehousing

Hadoop

Git

Airflow

Azure Data Factory

Databricks

AWS

GCP

Delta Lake

Hive

Formation

Bachelor's or Master’s in Computer Science/IT/Engineering

Outils

Databricks

Azure Data Factory

Azure Synapse

AWS Glue

Kafka

Airflow

Oozie

Hadoop

Hive

Git

Description du poste

Role Description

Job Title : Data Architect

Certification Required Databricks Certified Associate Developer for Apache Spark

Job Summary

We are seeking a skilled PySpark Developer to design develop and optimize largescale data processing solutions using Apache Spark and Python The ideal candidate will have experience building ETL pipelines handling big data workloads and working with cloudbased data platforms to support analytics reporting and data engineering initiatives

Key Responsibilities

• Design develop and maintain scalable data pipelines using PySpark
• Build and optimize ETLELT processes for structured and unstructured data
• Process large datasets using Apache Spark in distributed environments
• Collaborate with business analysts data architects and data scientists to understand data requirements
• Integrate data from multiple sources including databases APIs and cloud storage
• Perform data cleansing transformation and validation activities
• Optimize Spark jobs for performance scalability and resource utilization
• Develop data quality checks and monitoring mechanisms
• Troubleshoot production issues and provide timely resolutions
• Implement best practices for coding testing deployment and documentation
• Work with cloud platforms such as AWS Azure or GCP for data engineering solutions
• Participate in code reviews and ensure adherence to development standards

Required Skills

• Strong experience in Python and PySpark development
• Handson experience with Apache Spark Spark SQL DataFrames and Spark Streaming
• Strong knowledge of SQL and relational databases
• Experience with ETL development and data warehousing concepts
• Familiarity with Hadoop ecosystem technologies HDFS Hive Yarn
• Experience with version control systems such as Git
• Understanding of distributed computing concepts and performance tuning
• Knowledge of workflow orchestration tools such as Airflow Oozie or Azure Data Factory
• Strong analytical and problemsolving skills

Preferred Skills

• Experience with cloud platforms AWS EMR Azure Databricks Azure Synapse GCP Dataproc
• Exposure to Delta Lake Iceberg or Lakehouse architectures

Experience With Kafka Or Other Realtime Streaming Solutions

• Knowledge of CICD pipelines and DevOps practices
• Understanding of data governance security and compliance requirements

Qualifications

• Bachelors or Masters degree in Computer Science Information Technology Engineering or a related field
• 58 years of experience in Data Engineering or Big Data development
• Relevant certifications in Spark Databricks Azure AWS or GCP are an added advantage

NicetoHave Technologies

• Databricks
• Azure Data Factory ADF
• Azure Synapse Analytics
• AWS Glue
• Kafka
• Delta Lake
• Hive
• Airflow
• Snowflake

Sample Experience Requirement

• 11 years of experience in Data Engineering
• 11 years of handson experience with PySpark development
• Experience designing and supporting enterprisescale data platforms
• Proven ability to optimize Spark applications for highvolume data processing

Key Competencies

• Communication and stakeholder management
• Problemsolving and analytical thinking
• Team collaboration
• Attention to detail
• Ownership and accountability

Other Details

Variable Compensation: This position includes a bonus or variable payout component based on individual and organizational performance. Actual compensation within the range will be dependent upon the individual's skills, experience, performance and internal equity.

Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree (“LTIM”):

Benefits And Perks

• Comprehensive Medical Plan Covering Medical, Dental, Vision
• Short Term and Long-Term Disability Coverage
• 401(k) Plan with Company match
• Life Insurance
• Vacation Time, Sick Leave, Paid Holidays
• Paid Paternity and Maternity Leave

The range displayed on each job posting reflects the minimum and maximum salary target for the position across all US locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.

Disclaimer: The compensation and benefits information provided herein is accurate as of the date of this posting.

LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.