Data Engineer (DB2, Hive, and Spark)

TALENT Software Services; Jacksonville (FL); On-site; USD 100,000 - 130,000; Part time

Job summary

TALENT Software Services seeks a Data Engineer for a 6-month engagement in Jacksonville, FL, focusing on DB2, Hive, and Spark. You will design and optimize large-scale batch data pipelines, write complex SQL and stored procedures, and ensure data quality across the Hadoop ecosystem.

The ideal candidate has 8–10 years of experience with DB2 in heavy data environments, strong SQL, and hands-on Spark experience. Nice to have Informatica or DataStage exposure and cloud platform familiarity.

Qualifications

• Strong SQL and stored procedures knowledge (DB2 required).
• Experience with DB2 in large-scale data environments.
• Working knowledge of Hive and the Hadoop ecosystem.

Responsibilities

• Develop, optimize, and maintain complex SQL queries and stored procedures (DB2 focus).
• Perform data cleanup, transformation, and validation on large datasets.
• Work extensively with DB2 and Hive for data processing.
• Design and implement batch data processing pipelines.
• Use Apache Spark for scalable data processing and performance optimization.
• Analyze data issues and ensure data quality, integrity, and consistency.
• Collaborate with cross-functional teams for data requirements and delivery.
• Troubleshoot performance issues and optimize ETL/data workflows.

Skills

SQL & Stored Procedures

DB2 expertise

Hive

Spark (Py/Scala)

Batch processing

Data cleansing

Performance tuning

Tools

Informatica

DataStage

Hadoop

Job description

Location: Jacksonville, FL

Title: Data Engineer (DB2, Hive, and Spark)

Duration: 6 months

We are looking for a strong Data Engineer with hands-on experience in DB2, Hive, and Spark. The ideal candidate should have deep expertise in SQL (especially stored procedures), data cleanup, and handling large-scale batch data processing.

Key Responsibilities

• Develop, optimize, and maintain complex SQL queries and stored procedures (DB2 focus)
• Perform data cleanup, transformation, and validation on large datasets
• Work extensively with DB2 (heavy data environments) and Hive
• Design and implement batch data processing pipelines
• Use Apache Spark for scalable data processing and performance optimization
• Analyze data issues and ensure data quality, consistency, and integrity
• Collaborate with cross-functional teams for data requirements and delivery
• Troubleshoot performance issues and optimize ETL/data workflows

Required Skills

• Strong expertise in SQL and Stored Procedures (DB2 mandatory)
• Hands-on experience with DB2 (large-scale data handling)
• Working knowledge of Hive and Hadoop ecosystem

Experience With Apache Spark (PySpark/Scala Preferred)

• Solid understanding of batch processing frameworks
• Experience in data cleansing, transformation, and validation
• Good problem-solving and performance tuning skills

Nice to Have

• Experience with ETL tools (Informatica, DataStage, etc.)
• Exposure to cloud platforms (AWS/Azure/GCP)
• Knowledge of data warehousing concepts

Experience Required: 8-10