Lead Data Engineer — Spark Streaming & Pipelines

慨正橡扯; Tampa (FL); On-site; USD 100,000 - 130,000; Full time

Benefits offered by this job

Comprehensive health care coverage

Retirement savings plan

Tuition reimbursement

Mental health support

Job summary

慨正橡扯 is seeking a Lead Data Engineer in Tampa, Florida. This role involves collaborating with all lines of business to deliver data solutions while designing efficient data processing pipelines.

The ideal candidate will have over 5 years of experience in Data Engineering, expertise in AWS, and skills in Python and Spark. Benefits include comprehensive healthcare coverage and a competitive salary based on experience.

Qualifications

• 5+ years applied experience in Data Engineering concepts.
• Experienced in validating AI-assisted outputs.
• Strong knowledge of both relational and NoSQL databases.

Responsibilities

• Collaborate across business lines to deliver software solutions.
• Design scalable and reliable data processing pipelines.
• Develop and productionize efficient data pipelines.

Skills

Python

PySpark

AWS Glue

Spark

Kafka

Flink

Databricks

Kubernetes

Docker

ETL

Education

Formal training or certification on Data Engineering

Tools

AWS

EMR

Flask

Job description

慨正橡扯 is seeking a Lead Data Engineer in Tampa, Florida. This role involves collaborating with all lines of business to deliver data solutions while designing efficient data processing pipelines.

The ideal candidate will have over 5 years of experience in Data Engineering, expertise in AWS, and skills in Python and Spark. Benefits include comprehensive healthcare coverage and a competitive salary based on experience.