Big Data Senior Software Engineer

Citi; Mississauga; On-site; CAD 90,000 - 120,000; Full time

Job summary

A global financial services firm in Mississauga is seeking a Big Data Senior Software Engineer. You will design big data pipelines using Spark with a focus on real-time processing and agile methodologies. Ideal candidates have over 5 years of experience in data engineering and a strong grasp of modern data processing technologies. This involves collaborating with technology teams and mentoring junior analysts. The role is full-time and offers competitive benefits.

Qualifications

• 5+ years of relevant experience in Data Engineering.
• Hands-on experience in design and development of big data platforms.
• Deep understanding of streaming data architectures.

Responsibilities

• Design, development, and maintenance of big data pipelines.
• Monitor and control all phases of the development process.
• Analyze complex problems/issues related to applications.

Skills

Data Engineering

Big Data Platform Design

Scala

Spark

NoSQL

CI/CD

Agile Practices

Data Processing Technologies

Education

Bachelor's degree or equivalent experience

Tools

Apache Hadoop

HBase

TeamCity

UDeploy

Teradata

Job description

The Big Data Senior Software Engineer (Applications Development Senior Programmer Analyst - C12) is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.

Responsibilities:

• Design, development, and maintenance of big data pipelines using Spark framework in Scala
• Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
• Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
• Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
• Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
• Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
• Ensure essential procedures are followed and help define operating standards and processes
• Serve as advisor or coach to new or lower-level analysts
• Has the ability to operate with a limited level of direct supervision.
• Can exercise independence of judgement and autonomy.
• Acts as SME to senior stakeholders and /or other team members.
• Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.

Qualifications:

• 5+ years of relevant experience Data Engineering.
• Hands-on experience in design and development of big data platform.
• Deep understanding of modern data processing technology stacks: Spark, HBase, Sqoop and other Hadoop ecosystem technologies and development using Scala.
• Deep understanding of streaming data architectures and technologies for real-time and low-latency data processing.
• Understanding of CI/CD process and experience using TeamCity and UDeploy.
• Experience with agile development methods including core values, guiding principles, and key agile practices.
• Understanding of the theory and application of Continuous Integration/Delivery
  Experience with NoSQL technologies including column family, graph, document, and key-value data storage technologies is a plus.
  Passion for software craftsmanship.
• Knowledge of Wealth domain is an advantage.
• Exposure to relational databases (Teradata) is an advantage.
• Experience in systems analysis and programming of software applications.
• Experience in managing and implementing successful projects.
• Working knowledge of consulting/project management techniques/methods.
• Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements.

Education:

• Bachelor’s degree/University degree or equivalent experience

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

------------------------------------------------------

Job Family Group:

Technology

------------------------------------------------------

Job Family:

Applications Development

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Most Relevant Skills

Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills

Apache Hadoop, CI/CD, HBase, NoSQL, Relational Database, Scala (Programming Language), Spark SQL, Sqoop.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi .

View Citi’s EEO Policy Statement and the Know Your Rights poster.