Sr Hadoop with Flink and Iceberg

LTM; Tampa (FL); On-site; USD 90,000 - 120,000; Full time

Benefits offered by this job

Comprehensive Medical Plan covering Medical, Dental, Vision

Short‑Term and Long‑Term Disability Coverage

401(k) Plan with Company match

Life Insurance

Paid Paternity and Maternity Leave

Job summary

A global technology consulting company is seeking a highly skilled Data Engineer in Tampa, Florida. The role involves designing, building, and maintaining data infrastructure and pipelines using Apache Spark, Java, and other big data technologies. Ideal candidates should possess at least a Bachelor's degree in Computer Science or a related field, alongside strong programming skills. The position offers comprehensive medical benefits, a 401(k) plan, and paid family leave.

Qualifications

• Proven experience as a Data Engineer building and optimizing big-data pipelines.
• Strong experience with Apache Spark including Spark SQL and DataFrames.
• Hands-on experience with Apache Flink for real-time stream processing.

Responsibilities

• Design and maintain scalable data pipelines using Apache Spark and Java.
• Implement data storage solutions leveraging HDFS.
• Collaborate with data scientists and analysts to integrate new data sources.

Skills

Apache Spark

Java

Python

SparkSQL

Apache Flink

Education

Bachelor's or Master’s degree in Computer Science, Engineering or a related field

Tools

Apache Hadoop

Hadoop Distributed File System (HDFS)

Apache Iceberg

Job description

LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 750 clients, LTIMindtree brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world. Powered by nearly 90,000 talented and entrepreneurial professionals across more than 30 countries, LTIMindtree — a Larsen & Toubro Group company — combines the industry‑acclaimed strengths of erstwhile Larsen and Toubro Infotech and Mindtree in solving the most complex business challenges and delivering transformation at scale. For more information, please visit www.ltimindtree.com

Work Location : Tampa, Florida

Duration: Full time

Job Description

About the Role We are seeking a highly skilled and experienced Data Engineer to join our growing data team. This role will be instrumental in designing, building, optimizing, and maintaining our robust data infrastructure and pipelines. The candidate will work with cutting‑edge big data technologies to ingest, process, store, and transform large datasets, enabling advanced analytics and machine‑learning initiatives across the organization. The ideal candidate will have a deep understanding of data warehousing, ETL/E‑L‑T processes, and a passion for building scalable and reliable data solutions.

Key Responsibilities

• Design, develop and maintain scalable and efficient data pipelines using Apache Spark, Java, Sparkpy, and Apache Flink for real‑time and batch processing of large datasets
• Implement and manage data storage solutions leveraging Hadoop Distributed File System (HDFS) and data lake table formats such as Apache Iceberg
• Build and optimize data models and schema definitions for various data sources and targets, ensuring data quality, consistency, and accessibility
• Work with stakeholders to understand data requirements, translate them into technical specifications, and deliver robust data solutions
• Monitor, troubleshoot, and optimize existing data pipelines and infrastructure for performance, reliability, and cost efficiency
• Develop and implement data governance, security, and compliance best practices within the data ecosystem
• Collaborate with data scientists, analysts and other engineering teams to support their data needs and integrate new data sources
• Evaluate and recommend new technologies and methodologies to enhance our data platform capabilities
• Ensure proper documentation of data architectures, pipelines, and processes

Required Skills & Experience

• Bachelor's or Master’s degree in Computer Science, Engineering or a related quantitative field
• Proven experience as a Data Engineer or in a similar role building and optimizing big‑data pipelines, architectures and data sets
• Strong proficiency in programming languages such as Python (extensive pySpark experience), Java or Scala
• Expertise in Apache Spark for data processing, including Spark SQL, DataFrames and RDDs
• Hands‑on experience with the Apache Hadoop ecosystem, especially HDFS
• Experience with real‑time stream processing using Apache Flink
• Familiarity with data lake table formats, specifically Apache Iceberg for managing large evolving datasets
• Experience with relational SQL and NoSQL databases
• Solid understanding of ETL/E‑L‑T processes, data warehousing concepts and data modeling techniques
• Good to have experience with cloud platforms (AWS, Azure, GCP) and their data services
• Excellent problem‑solving, analytical and communication skills

Skills

Mandatory Skills : Apache Spark, Java, SparkSQL

Benefits / Perks

• Comprehensive Medical Plan covering Medical, Dental, Vision
• Short‑Term and Long‑Term Disability Coverage
• 401(k) Plan with Company match
• Life Insurance
• Paid Paternity and Maternity Leave

LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, colour, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family‑care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectionate or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.