Roles and Responsibilities
Develop and maintain applications using Apache Spark and Java
Job Description
Roles and Responsibilities
- Develop and maintain applications using Apache Spark and Java
- Work with different aspects of spark echo system including Datasets, Spark SQL and Scalability support
- Work with business analysts and lead engineers to understand requirements and designs for implementing software solutions
- Work on performance improvement activities to support spark applications to process millions of data elements everyday
- Production support and troubleshooting activities to uncover the issues in the spark applications
- Contributes to software engineering communities of practice and events that explore new and emerging technologies
- Adds to team culture of diversity, equity, inclusion, and respect
Required Qualifications, Capabilities, And Skills
- Formal training or certification on software engineering concepts and 3+ years applied experience
- Work experience on Data Engineering domain
- Hands-on practical experience in system design (simple), application development, testing, and operational stability
- Proficient in coding in one or more languages including Java
- Experience in developing, debugging, and maintaining code in a corporate environment with Java, Spark Framework and Database querying languages (any SQL usage experience)
- Overall knowledge of the Software Development Life Cycle
- Experience working in an Agile Software Development Environment
Preferred Qualifications, Capabilities, And Skills
- Exposure to cloud technologies such as AWS, Kubernetes and Kafka.
Must Have Skills
- Java, Spring Boot, AWS Glue
NICE To Have Skills
- Kubernetes
- CI/CD pipeline
- Python
- Kafka
- Lambdas, API
Looking for curious, AWS certified, Java, ETL Engineer.