Senior Data Engineer with AWS

Valiant Technologies LLC; Atlanta (GA); On-site; USD 120,000 - 180,000; Full time

Job summary

Valiant Technologies LLC is seeking a hands-on Senior Java & Data Engineer to support a large-scale application modernization and cloud migration on AWS. You will focus on Java/Spring Boot REST APIs and Python-based ETL pipelines in Databricks, delivering scalable, cloud-native solutions.

You will collaborate across architects, data engineers, DevOps, and frontend teams, implement microservices, CI/CD, Docker/Kubernetes, and ensure code quality, security, and performance while advancing

Qualifications

• Proficiency in Java with Spring Boot and REST API design.
• Strong Python and ETL development capabilities.
• Experience with microservices and API-driven architectures.
• Familiarity with Docker and Kubernetes containerization.
• Experience with unit/integration/API testing.
• Experience with Bitbucket and CI/CD pipelines.
• Strong debugging and software engineering fundamentals.

Responsibilities

• Design, develop, and maintain scalable REST APIs and backend services using Java and Spring Boot.
• Develop modular, reusable services following microservices and API-first architecture principles.
• Build and maintain Python-based ETL and data-processing pipelines in Databricks.
• Implement data ingestion, transformation, validation, reconciliation, and error-handling processes.
• Integrate backend services with Databricks, AWS services, and other enterprise systems/data sources.
• Containerize applications using Docker and deploy/manage workloads using Kubernetes.
• Develop unit and integration tests and ensure high standards for code quality, security, performance, and maintainability.
• Participate in solution design, code reviews, troubleshooting, performance optimization, and technical documentation.
• Collaborate with architects, frontend developers, data engineers, DevOps teams, and other stakeholders throughout the development lifecycle.
• Support CI/CD, automated deployments, monitoring, logging, and production readiness for cloud-native components.
• Contribute to modernization by translating legacy capabilities into scalable API-driven and cloud-native solutions.
• Leverage modern AI-assisted development approaches where applicable to improve engineering productivity and automation.

Skills

Java

Spring Boot

REST APIs

Python ETL

Microservices

APIs

Unit Testing

Integration Testing

CI/CD

Debugging

Tools

Databricks

AWS

Docker

Kubernetes

CI/CD

Job description

We are looking for a hands-on Senior Java & Data Engineer to support a large-scale application modernization and cloud migration initiative. The role will focus primarily on developing Java/Spring Boot REST APIs and Python-based ETL/data pipelines using Databricks, deployed on AWS.

The ideal candidate will have strong backend engineering and data-processing experience, with a solid understanding of cloud-native development, containerization, microservices, and modern engineering practices.

• Design, develop, and maintain scalable REST APIs and backend services using Java and Spring Boot.
• Develop modular, reusable services following microservices and API-first architecture principles.
• Build and maintain Python-based ETL and data-processing pipelines in Databricks.
• Implement data ingestion, transformation, validation, reconciliation, and error-handling processes.
• Integrate backend services with Databricks, AWS services, and other enterprise systems/data sources.
• Containerize applications using Docker and deploy/manage workloads using Kubernetes.
• Develop unit and integration tests and ensure high standards for code quality, security, performance, and maintainability.
• Participate in solution design, code reviews, troubleshooting, performance optimization, and technical documentation.
• Collaborate with architects, frontend developers, data engineers, DevOps teams, and other stakeholders throughout the development lifecycle.
• Support CI/CD, automated deployments, monitoring, logging, and production readiness for cloud-native components.
• Contribute to modernization by translating legacy capabilities into scalable API-driven and cloud-native solutions.
• Leverage modern AI-assisted development approaches where applicable to improve engineering productivity and automation.

Skills:

• Java, Spring Boot, REST APIs
• Strong Python and ETL development
• Strong understanding of microservices and API-driven architectures
• Docker and Kubernetes
• Unit Testing, Integration Testing and API Testing
• Bitbucket and CI/CD
• Strong debugging, problem-solving, and software engineering fundamentals

Secondary / Preferred:

• AWS and cloud-native application development
• Databricks
• AWS services used for compute, containers, storage, security, integration, monitoring, and data processing
• Data integration and distributed data-processing concepts
• Secure API development and authentication/authorization patterns

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.