Senior PySpark Architect | AI-Driven Data Platforms

Infosys; Jersey City (NJ); On-site; USD 96,021 - 124,827; Full time

Benefits offered by this job

Medical/Dental/Vision/Life Insurance

401(k) plan and contributions

Job summary

Infosys in Jersey City, NJ is seeking an Architecture Consultant 2 to drive scalable, secure architectures for financial services projects. You will gather requirements from customers, suggest architectural solutions, and guide framework development across data, integration, and deployment domains.

You will collaborate with engineering teams to resolve complex issues, assess technologies, and document architectural artifacts while ensuring quality and knowledge transfer.

Qualifications

• Experience in technology consulting, enterprise and solutions architecture and architectural frameworks.
• Experience in Cloudera Hadoop ecosystem, i.e. Hadoop, Hive, Scala, SPARK, Sqoop, Flume, Kafka, Python, NoSQL database technologies
• Understanding and knowledge of Hadoop architecture and various components such as high availability architecture, experience in workload management, scalability and distributed platform architecture
• Experience with design and implementation of ETL/ELT framework for complex warehouses/marts. Knowledge of large data sets and experience with performance tuning and troubleshooting
• Background in all aspects of software engineering with strong skills in parallel data processing, data flows, REST APIs, JSON, XML, and micro service architecture

Responsibilities

• Participate in customer discussions to gather and analyze system requirements for performance, security and scalability.
• Provide suggestions on solution architecture, contribute to tech framework development, support enterprise architecture definition, and drive design creation
• Identify suitable technologies and tools available in the market, and perform a comparative analysis in line with client's business requirement, thereby identifying optimal architectural solution options
• Participate in developing integration strategies based on validation of proof of concept of proposed architectural solutions
• Facilitate a smooth transition by ensuring knowledge transfer and adherence to quality standards, while contributing to the build and deployment automation strategy
• Collaborate with development teams to resolve complex technical issues using solution deployment and roll out methods, during build, deployment and support phases
• Analyze system performance basis architectural solutions implemented and support in identifying potential risks in the system landscape
• Create artifacts of architectural frameworks and technical solutions, thereby enriching team's knowledge repository

Skills

Tech consulting

Enterprise architecture

Architectural frameworks

Hadoop ecosystem

ETL/ELT design

REST APIs / JSON / XML

Microservices

Education

Bachelor's degree

Tools

AWS

Azure

GCP

Databricks

Snowflake

Job description

Infosys in Jersey City, NJ is seeking an Architecture Consultant 2 to drive scalable, secure architectures for financial services projects. You will gather requirements from customers, suggest architectural solutions, and guide framework development across data, integration, and deployment domains.

You will collaborate with engineering teams to resolve complex issues, assess technologies, and document architectural artifacts while ensuring quality and knowledge transfer.