Senior Data Engineer - Assistant Vice President

Citigroup Inc.; Mississauga; On-site; CAD 129,000 - 195,000; Full time

Job summary

A leading financial services firm in Mississauga seeks a Senior Data Engineer to design and manage data pipelines. The role requires advanced skills in Spark, Scala/Java, and Hive, along with a bachelor's or master's degree. Candidates should have strong ownership of projects and experience with data platforms. Competitive salary between $94,300 and $141,500.

Qualifications

• Proven hands-on development expertise with Apache Spark.
• Strong programming proficiency in Scala and/or Java.
• In-depth knowledge and practical experience with Hive, including query optimization and data analysis.

Responsibilities

• Design, implement, and optimize highly performant data pipelines.
• Take complete ownership of complex data engineering projects.
• Develop robust and efficient Hive queries for extensive data analysis.
• Champion best practices for data flows ensuring they are robust and maintainable.

Skills

Apache Spark

Scala

Java

Hive

Education

Bachelor’s / Master’s degree or equivalent experience

Tools

Cloudera Data Platform (CDP)

Job description

Overview

Senior Data Engineer proficient in Spark, Scala/Java, and Hive, with extensive hands-on development experience in the Big Data ecosystem.

Responsibilities

• Design, implement, and optimize highly performant data pipelines using Spark, Scala/Java, and Hive on platforms like Cloudera Data Platform (CDP) or other Hadoop ecosystems.
• Take complete ownership of complex data engineering projects within the big data ecosystem, covering the entire lifecycle from initial design and development to deployment and ongoing maintenance.
• Develop robust and efficient Hive queries for extensive data analysis and reporting.
• Champion and enforce best practices and coding standards for new and existing data flows to ensure they are robust, scalable, secure, and maintainable using Spark, Scala/Java, and Hive within the big data ecosystem.
• Diagnose, troubleshoot, and resolve complex issues related to Spark, Scala/Java, and Hive applications and YARN resource management, implementing performance optimization solutions.
• Proactively collaborate with stakeholders, working closely to develop solutions with full commitment and accountability.

Technical Skills & Experience

• Proven hands-on development expertise with Apache Spark
• Strong programming proficiency in Scala and/or Java
• In-depth knowledge and practical experience with Hive, including query optimization and data analysis
• Experience with data platforms such as Cloudera Data Platform (CDP) is highly desirable

Education

• Bachelor’s / Master’s degree or equivalent experience

Time Type: Full time

Primary Location Salary Range: $94,300.00 - $141,500.00

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi. View Citi’s EEO Policy Statement and the Know Your Rights poster.