Sr. SW Engineer (Data Engineering - Java, Hadoop, Spark, Python, 3-7 years Exp)
Company Description: Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.
Job Description: Authentication is an exciting and rapidly developing field, teeming with fresh and innovative ideas. With a strong demand for new solutions, this space promises to be a hotbed of innovation for the next 5 to 10 years. If you're eager to immerse yourself in the dynamic world of identity, risk measurement, and consumer authentication, learn quickly, and make significant impacts, then the Risk and Identity team at VISA is the ideal place for you!
As a Sr Data Engineer, you'd be functioning as a design/development expert in a scrum team of 8-10 members. You'd have end-to-end ownership of your stories and deliveries. You'd be reporting to a Director of Authentication.
Essential Functions:
- Demonstrates relevant technical working knowledge to understand requirements.
- Works with Product owners, architects, and other relevant stakeholders to gather and refine requirements for one or more products, considering existing tools and solutions across departments.
- Translates functional requirements into system designs for one or more components and communicates how the components will interact.
- Demonstrates understanding of non-functional requirements (NFR) and their impact on the system.
- Leads junior engineers in understanding requirements.
- Designs, codes, tests, documents, and implements new applications and existing programs.
- Develops code that complies with design specifications and meets security and coding best practices.
- Works independently and provides guidance to junior developers.
- Collaborates with team members on technical software development issues, problem analysis, and resolution.
- Participates in design and code review sessions to ensure quality.
- Writes automation scripts for functional testing.
- Adopts new technologies, like generative AI, to improve developer productivity.
- Engages with product engineering teams during code/design reviews, meetings, on-call rotations, and incident responses.
- Leverages advanced knowledge of systems or platforms and telemetry analyses to propose improvements in code, processes, and designs.
Qualifications:
- 3 - 7 years of work experience with a Bachelor's or Advanced Degree.
- Proven experience in developing data pipelines.
- Experience with data-driven business solutions using Hadoop, Hive, Spark, Cassandra, NoSQL, and traditional RDBMS like DB2.
- Skills in Big Data technologies such as Hadoop, Spark, Hive, Presto, and MapReduce.
- Proficiency in programming languages like Python, Java, or Scala.
- Experience with large-scale, enterprise distributed pipelines requiring high availability, low latency, and strong data consistency.
- Knowledge of CI/CD tools such as Jenkins, Artifactory, Git, Bitbucket.
- Experience with graph processing technologies and databases like GraphX and Neo4j is a plus.
- Excellent written and verbal communication skills.
- Proactive and collaborative problem-solving mindset.
- Knowledge of Machine Learning, Predictive AI, and Generative AI is a plus.
Sign-in & see how your skills match this job
Find Your perfect Job
Sign-in & Get noticed by top recruiters and get hired fast