Senior Data Engineer - Spark, Databricks & Lakehouse

Citigroup Inc.; Irving (TX); Hybrid; USD 107,000 - 161,000; Full time

Benefits offered by this job

Medical insurance

401(k)

Paid time off

Job summary

Citigroup Inc. in Irving, TX, is seeking an Applications Development Senior Programmer Analyst (Assistant Vice President) to join our technology team.

You will participate in designing, developing, and implementing scalable data pipelines and analytics platforms. The role focuses on PySpark, Databricks, Snowflake, and cloud data services across AWS/Azure/GCP, with emphasis on data governance, security, and collaboration with data scientists.

Qualifications

• 4–7 years of experience in Data Engineering or related roles.
• Strong hands-on experience with Python, PySpark, and Spark SQL.
• Experience with Databricks (Delta Lake, performance tuning).
• Working knowledge of Ab Initio (GDE, Co>Operating System, Conduct>It).
• Experience with Snowflake for data warehousing and analytics.
• Familiarity with Starburst/Trino and data federation concepts.
• Exposure to Apache Iceberg or similar open table formats.
• Hands-on experience with at least one cloud platform (AWS, Azure, or GCP).
• Understanding of data governance frameworks, including data quality, lineage, cataloging, and security principles.
• Experience supporting data pipelines for analytics and machine learning workloads.
• Familiarity with Agile/Scrum methodologies.

Responsibilities

• Develop and maintain scalable ETL/ELT pipelines using PySpark, Spark SQL, and Delta Lake on Databricks.
• Support implementation and management of data platforms across AWS, Azure, or GCP.
• Work with big data technologies such as Databricks, Snowflake, and Apache Iceberg to process large datasets.
• Optimize Spark workloads through performance tuning, partitioning strategies, and cost-efficient processing.
• Contribute to Lakehouse architecture implementation, ensuring data quality, consistency, and reliability.
• Assist in implementing data federation solutions using Starburst/Trino across multiple data sources.
• Support data governance initiatives, including data quality checks, lineage tracking, metadata management, and adherence to enterprise standards.
• Ensure compliance with data security and governance policies, including access controls (RBAC) and auditability.
• Perform troubleshooting and performance optimization for data pipelines and queries.
• Support data modeling for analytics, reporting, and downstream consumption.
• Collaborate with data scientists and ML teams to enable pipelines for AI/ML and RAG-based use cases.

Skills

Python

PySpark

Spark SQL

Data engineering

Agile/Scrum

Collaboration

Problem-solving

Communication

Education

Bachelor’s degree in Computer Science/Engineering/IT

Master’s degree (plus)

Tools

Databricks

Delta Lake

Snowflake

Starburst/Trino

Apache Iceberg

AWS

Azure

GCP

Ab Initio

Job description

Citigroup Inc. in Irving, TX, is seeking an Applications Development Senior Programmer Analyst (Assistant Vice President) to join our technology team.

You will participate in designing, developing, and implementing scalable data pipelines and analytics platforms. The role focuses on PySpark, Databricks, Snowflake, and cloud data services across AWS/Azure/GCP, with emphasis on data governance, security, and collaboration with data scientists.