Senior ETL Developer & Spark Architect

Citi; Tampa (FL); On-site; USD 97,000 - 145,000; Full time

Benefits offered by this job

Medical, dental & vision coverage

401(k) retirement plan

Paid time off

Job summary

Citi in Tampa, FL is seeking a Senior ETL Developer to design, implement, and optimize distributed data processing jobs in Hadoop/Spark using Python. You will collaborate with data engineers, analysts, and stakeholders to transform data and drive data-driven decisions.

Responsibilities include building Spark applications, developing PySpark ETL pipelines, and optimizing performance across the Hadoop ecosystem. A Bachelor's degree and 5–8 years of software development experience are expected.

Qualifications

• 5-8 years of software development experience.
• Experience in systems analysis and programming of software applications.
• Experience in managing and implementing successful projects.
• Knowledge of consulting/project management methods.
• Ability to work under pressure and meet deadlines.

Responsibilities

• Design and implement Spark applications to process large datasets in HDFS.
• Develop ETL pipelines in Spark using Python for ingestion, cleaning, aggregation, and transformations.
• Optimize Spark jobs for efficiency and resource usage.
• Tune memory management, caching, and partitioning for performance.
• Load data into HDFS and integrate Spark with Hive/Sqoop; test and debug Spark jobs.

Skills

Software Development

Data Engineering

Spark

Python

Education

Bachelor's degree

Tools

Spark

Hadoop

Hive

Sqoop

Python

Job description

Citi in Tampa, FL is seeking a Senior ETL Developer to design, implement, and optimize distributed data processing jobs in Hadoop/Spark using Python. You will collaborate with data engineers, analysts, and stakeholders to transform data and drive data-driven decisions.

Responsibilities include building Spark applications, developing PySpark ETL pipelines, and optimizing performance across the Hadoop ecosystem. A Bachelor's degree and 5–8 years of software development experience are expected.