Senior Java Data Engineer — AI‑Driven Data Pipelines (AWS)

Surge Technology Solutions Inc; Chicago (IL); On-site; USD 120,000 - 160,000; Full time

Job summary

Surge Technology Solutions Inc. is seeking an experienced Java Data Engineer with AI expertise to design, build, and maintain scalable data pipelines and curated datasets.

The role emphasizes Java, Spring Boot, Python, SQL, and AWS cloud‑native data services, with Spark, Kafka, and DynamoDB to support high‑volume processing. The position involves developing cloud‑native data solutions, implementing data quality and observability, and leveraging AI‑assisted development tools to improve

Qualifications

• Strong Java and Spring Boot hands‑on experience.
• Proficient in Python and SQL.
• Hands‑on with DynamoDB, EMR, EC2; scalable data pipelines and transformations.
• Experience with deployment, troubleshooting, and automated testing.
• Knowledge of data quality, monitoring, and observability; Agile/Scrum environment.
• Experience using Claude or other AI‑assisted development tools.

Responsibilities

• Design, develop, and maintain scalable data pipelines and curated datasets.
• Build data‑intensive applications using Java, Spring Boot, Python, and SQL.
• Develop cloud‑native data solutions using AWS services.
• Work with DynamoDB, EMR, EC2, Spark, and Kafka for high‑volume processing.
• Develop batch and real‑time data pipelines for analytics and operations.
• Implement data integration, transformations, validation, and processing frameworks.
• Deploy, troubleshoot, optimize performance, and provide production support.
• Establish data quality, monitoring, and observability; automate testing.

Skills

Java

Spring Boot

Python

SQL

AWS

Spark

Kafka

DynamoDB

Data Pipelines

Data Quality

Observability

Automated Testing

Claude

Spec-Driven

BMAD

Capital One Experience

Tools

EMR

EC2

Job description

Surge Technology Solutions Inc. is seeking an experienced Java Data Engineer with AI expertise to design, build, and maintain scalable data pipelines and curated datasets.

The role emphasizes Java, Spring Boot, Python, SQL, and AWS cloud‑native data services, with Spark, Kafka, and DynamoDB to support high‑volume processing. The position involves developing cloud‑native data solutions, implementing data quality and observability, and leveraging AI‑assisted development tools to improve