Tech Lead (Spark and Python expertise)

Infinity Outsourcing; McLean (VA); Hybrid; USD 125,000 - 130,000; Full time

Job summary

A technology outsourcing firm is looking for a Tech Lead specializing in Spark and Python. This role requires advanced experience in cloud-based solutions using AWS and extensive knowledge of big data technologies. The ideal candidate will have over 10 years of experience in software development and must demonstrate strong problem-solving skills. Working onsite in McLean, VA, the job allows for some remote days and offers competitive pay rates.

Qualifications

• 10+ years of experience in application design and development.
• Solid experience with cloud-based solutions in AWS.
• Strong programming skills in Java, Python, or Scala.

Responsibilities

• Develop, program, and maintain applications using Apache Spark.
• Work with Spark SQL, DataFrames, and streaming.
• Implement cloud-based solutions using various AWS services.

Skills

Java

Python

Spark

AWS Services

DevOps tools

Tools

Apache Spark

Hadoop

NoSQL (MongoDB)

Jenkins

Elasticsearch

Job description

About the job Tech Lead (Spark and Python expertise)

Position: Tech Lead (Spark and Python expertise)

Location: McLean, VA. (Day-1 Onsite| 3 days Onsite & 2 Days remote)

Duration: long term

Pay rate: $67-$70/hr on C2C and $125,000-$130,000/annum

Client: Hexaware

Job Description:

Mandatory:

• 10+ years of experience in solution, design and development of applications using Java 8+/J2EE, Spring, Spring-Boot, Micro Services, RESTful Services and with experience in Big Data and with experience working in heavy data background needed.
• Develop, program, and maintain applications using the Apache Spark open-source framework.
• Work with different aspects of the Spark ecosystem, including Spark SQL, DataFrames, Datasets, and streaming.
• Spark Developer must have strong programming skills in Java, Scala, or Python.
• Familiar with big data processing tools and techniques.
• Experience with the Hadoop ecosystem.
• Good understanding of distributed systems.
• Experience with streaming data platforms.
• Must be strong in Cloud AWS event-based architecture, Kubernetes, ELK (Elasticsearch, Logstash & Kibana).
• Must have excellent experience in designing and implementing cloud-based solutions in various AWS Services (S3, Lambda, Step Function, AMQ, SNS, SQS, CloudWatch Events, etc.).
• Must be well experienced in design and development of Microservice using Spring-Boot and REST API and with GraphQL.
• Must have solid knowledge and experience in NoSQL (MongoDB).
• Good knowledge and experience in any Queue based implementations.
• Strong knowledge/experience in ORM Framework - JPA / Hibernate.
• Good knowledge in technical concepts Security, Transaction, Monitoring, Performance.
• Should be well versed with TDD/ATDD.
• Should have experience on Java, Python and Spark.
• 2+ years of experience in designing and implementing cloud-based solutions in various AWS Services.
• Strong experience in DevOps tool chain (Jenkins, Artifactory, Ansible/Chef/Puppet/Spinnaker, Maven/Gradle, Atlassian Tool suite).
• Very good knowledge and experience in Non-Functional (Technical) Requirements like Security, Transaction, Performance, etc.
• Excellent analytical and problem-solving skills.

Nice to have:

• Experience with OAuth implementation using Ping Identity.
• Experience in API Management (Apigee) or Service Mesh (Istio).
• Good knowledge and experience in Queue/Topic (Active-MQ) based implementations.
• Good knowledge and experience in Scheduler and Batch Jobs.
• Experience with scripting languages using Unix.