Senior Data Engineer — Lakehouse & Spark on Databricks

Citigroup Inc.; Irving (TX); On-site; USD 107,000 - 161,000; Full time

Job summary

Citi in Irving, Texas seeks an Applications Development Senior Programmer Analyst to contribute to data engineering and analytics initiatives. The role focuses on building scalable ETL/ELT pipelines using PySpark, Spark SQL, and Databricks, across AWS/Azure/GCP, with emphasis on Lakehouse architecture and data governance.

You will collaborate with data scientists and ML teams to enable AI/ML pipelines, participate in Agile processes, and ensure data security with RBAC across enterprise data

Qualifications

• 4–7 years of experience in Data Engineering or related roles.
• Strong hands-on experience with Python, PySpark, and Spark SQL.
• Experience with Databricks (Delta Lake, performance tuning).
• Knowledge of Starburst/Trino and data federation concepts.
• Exposure to Apache Iceberg or similar open table formats.
• Hands-on experience with at least one cloud platform (AWS/Azure/GCP).
• Understanding of data governance frameworks and security principles.
• Experience supporting data pipelines for analytics and ML workloads.

Responsibilities

• Develop and maintain scalable ETL/ELT pipelines using PySpark and Delta Lake on Databricks.
• Support data platforms across AWS, Azure, or GCP.
• Work with big data tech to process large datasets (Databricks, Snowflake, Iceberg).
• Optimize Spark workloads through performance tuning and partitioning.
• Contribute to Lakehouse architecture ensuring data quality and reliability.
• Assist in data federation solutions across multiple data sources.
• Support data governance, quality checks, lineage, and cataloging.
• Ensure data security with access controls (RBAC) and auditability.
• Troubleshoot and optimize data pipelines and queries.
• Model data for analytics, reporting, and downstream consumption.
• Collaborate with data scientists for AI/ML and RAG-based use cases.
• Participate in Agile processes and gather stakeholder requirements.

Skills

Python

PySpark

Spark SQL

Databricks

Snowflake

Starburst/Trino

Apache Iceberg

Cloud platforms (AWS/Azure/GCP)

Data governance

RBAC & security

Education

Bachelor's degree in Computer Science, Engineering, IT

Master's degree is a plus

Tools

Databricks

Delta Lake

Snowflake

Trino/Starburst

Apache Iceberg

AWS

Azure

GCP

Job description

Citi in Irving, Texas seeks an Applications Development Senior Programmer Analyst to contribute to data engineering and analytics initiatives. The role focuses on building scalable ETL/ELT pipelines using PySpark, Spark SQL, and Databricks, across AWS/Azure/GCP, with emphasis on Lakehouse architecture and data governance.

You will collaborate with data scientists and ML teams to enable AI/ML pipelines, participate in Agile processes, and ensure data security with RBAC across enterprise data