Senior Data Engineer with AWS

Quantum Technologies. LLC; Atlanta (GA); On-site; USD 120,000 - 170,000; Full time

Job summary

Quantum Technologies. LLC is seeking a hands-on Senior Java & Data Engineer to drive a large-scale modernization and cloud migration. You will develop Java/Spring Boot REST APIs and Python-based ETL pipelines on Databricks in AWS.

The role focuses on scalable microservices, containerization with Docker, and Kubernetes deployments, plus robust testing, CI/CD automation, and collaboration with data engineers and DevOps to deliver secure, maintainable cloud-native solutions.

Qualifications

• Proficient in Java and Spring Boot backend development.
• Experience with RESTful API design and API-first architecture.
• Strong Python development and ETL/data pipeline work.
• Familiarity with microservices and cloud-native patterns.
• Experience with Docker and Kubernetes for containerized deployments.
• Knowledge of CI/CD pipelines and automated testing.

Responsibilities

• Design, develop, and maintain scalable REST APIs and backend services in Java/Spring Boot.
• Build modular services following microservices and API-first principles.
• Develop Python-based ETL pipelines on Databricks.
• Implement data ingestion, transformation, validation, and error handling.

Skills

Java

Spring Boot

REST APIs

Python

ETL

CI/CD

Unit Testing

Integration Testing

API Testing

Debugging

Tools

Docker

Kubernetes

Databricks

AWS

Job description

We are looking for a hands-on Senior Java & Data Engineer to support a large-scale application modernization and cloud migration initiative. The role will focus primarily on developing Java/Spring Boot REST APIs and Python-based ETL/data pipelines using Databricks, deployed on AWS.

The ideal candidate will have strong backend engineering and data-processing experience, with a solid understanding of cloud-native development, containerization, microservices, and modern engineering practices.

• Design, develop, and maintain scalable REST APIs and backend services using Java and Spring Boot.
• Develop modular, reusable services following microservices and API-first architecture principles.
• Build and maintain Python-based ETL and data-processing pipelines in Databricks.
• Implement data ingestion, transformation, validation, reconciliation, and error-handling processes.
• Integrate backend services with Databricks, AWS services, and other enterprise systems/data sources.
• Containerize applications using Docker and deploy/manage workloads using Kubernetes.
• Develop unit and integration tests and ensure high standards for code quality, security, performance, and maintainability.
• Participate in solution design, code reviews, troubleshooting, performance optimization, and technical documentation.
• Collaborate with architects, frontend developers, data engineers, DevOps teams, and other stakeholders throughout the development lifecycle.
• Support CI/CD, automated deployments, monitoring, logging, and production readiness for cloud-native components.
• Contribute to modernization by translating legacy capabilities into scalable API-driven and cloud-native solutions.
• Leverage modern AI-assisted development approaches where applicable to improve engineering productivity and automation.

Skills:

• Java, Spring Boot, REST APIs
• Strong Python and ETL development
• Strong understanding of microservices and API-driven architectures
• Docker and Kubernetes
• Unit Testing, Integration Testing and API Testing
• Bitbucket and CI/CD
• Strong debugging, problem-solving, and software engineering fundamentals

Secondary / Preferred:

• AWS and cloud-native application development
• Databricks
• AWS services used for compute, containers, storage, security, integration, monitoring, and data processing
• Data integration and distributed data-processing concepts
• Secure API development and authentication/authorization patterns

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.