Sr. SW Engineer (Data Engineering - Java, Hadoop, Spark, Python, 3-7 years Exp)

Visa; Singapore; On-site; SGD 70,000 - 100,000; Full time

Job summary

A leading company in the industry seeks a Sr. Data Engineer to drive innovation in data engineering. In this role, you will lead development efforts in a fast-paced environment, utilizing advanced technologies such as Hadoop and Spark. If you have a proactive mindset and are excited about consumer authentication and identity, we invite you to apply!

Qualifications

• 3 - 7 years of work experience.
• Proven experience developing data pipelines.
• Experience with Hadoop, Spark, and other big data technologies.
• Knowledge of CI/CD tools and graph processing technologies is a plus.

Responsibilities

• Design, code, test, and implement new applications.
• Lead junior engineers and collaborate on software development.
• Participate in design and code review sessions.

Skills

Data pipeline development

Problem-solving

Collaboration

Automation scripting

Communication

Education

Bachelor's or Advanced Degree

Tools

Hadoop

Spark

Hive

NoSQL

RDBMS

CI/CD tools

Git

Job description

Sr. SW Engineer (Data Engineering - Java, Hadoop, Spark, Python, 3-7 years Exp)

Company Description: Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description: Authentication is an exciting and rapidly developing field, teeming with fresh and innovative ideas. With a strong demand for new solutions, this space promises to be a hotbed of innovation for the next 5 to 10 years. If you're eager to immerse yourself in the dynamic world of identity, risk measurement, and consumer authentication, learn quickly, and make significant impacts, then the Risk and Identity team at VISA is the ideal place for you!

As a Sr Data Engineer, you'd be functioning as a design/development expert in a scrum team of 8-10 members. You'd have end-to-end ownership of your stories and deliveries. You'd be reporting to a Director of Authentication.

Essential Functions:

• Demonstrates relevant technical working knowledge to understand requirements.
• Works with Product owners, architects, and other relevant stakeholders to gather and refine requirements for one or more products, considering existing tools and solutions across departments.
• Translates functional requirements into system designs for one or more components and communicates how the components will interact.
• Demonstrates understanding of non-functional requirements (NFR) and their impact on the system.
• Leads junior engineers in understanding requirements.
• Designs, codes, tests, documents, and implements new applications and existing programs.
• Develops code that complies with design specifications and meets security and coding best practices.
• Works independently and provides guidance to junior developers.
• Collaborates with team members on technical software development issues, problem analysis, and resolution.
• Participates in design and code review sessions to ensure quality.
• Writes automation scripts for functional testing.
• Adopts new technologies, like generative AI, to improve developer productivity.
• Engages with product engineering teams during code/design reviews, meetings, on-call rotations, and incident responses.
• Leverages advanced knowledge of systems or platforms and telemetry analyses to propose improvements in code, processes, and designs.

Qualifications:

• 3 - 7 years of work experience with a Bachelor's or Advanced Degree.
• Proven experience in developing data pipelines.
• Experience with data-driven business solutions using Hadoop, Hive, Spark, Cassandra, NoSQL, and traditional RDBMS like DB2.
• Skills in Big Data technologies such as Hadoop, Spark, Hive, Presto, and MapReduce.
• Proficiency in programming languages like Python, Java, or Scala.
• Experience with large-scale, enterprise distributed pipelines requiring high availability, low latency, and strong data consistency.
• Knowledge of CI/CD tools such as Jenkins, Artifactory, Git, Bitbucket.
• Experience with graph processing technologies and databases like GraphX and Neo4j is a plus.
• Excellent written and verbal communication skills.
• Proactive and collaborative problem-solving mindset.
• Knowledge of Machine Learning, Predictive AI, and Generative AI is a plus.

Sign-in & see how your skills match this job

Find Your perfect Job

Sign-in & Get noticed by top recruiters and get hired fast