Remote Senior Data Engineer: AWS & Kafka

Remote Jobs; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Remote Jobs in the United States seeks a Senior Data Engineer to architect scalable data pipelines on AWS and optimize real-time streaming with Confluent for AI projects. This fully remote role offers flexible scheduling and cross-team collaboration.

You will work with AWS services (S3, Glue, EMR, Redshift, Kinesis, Lambda, MSK), Airflow, and ML tooling (SageMaker) to deliver data-driven insights and production-ready solutions.

Qualifications

• Bachelor's or master's degree in computer science, software engineering, or a related quantitative field.
• 3 to 5 years of experience in data engineering with a focus on cloud-based solutions.
• Strong expertise in AWS data services (S3, Glue, EMR, Redshift, Kinesis, Lambda).
• Extensive hands-on experience with Confluent Platform/Apache Kafka for real-time data streams.
• Proficiency in Python, PySpark, Scala, or Java.
• SQL and database systems (relational and NoSQL).
• Understanding of data warehousing, data lakes, and data modeling (star/snowflake).
• Experience with CI/CD pipelines and DevOps (Git, Terraform, Jenkins, Azure DevOps).
• AWS Certifications (e.g., Data Analytics, Specialty).

Responsibilities

• Architect and design scalable data pipelines on AWS for batch and real-time processing.
• Design, implement, and optimize data streaming solutions using Confluent Kafka.
• Develop data solutions leveraging AWS services (S3, Glue, EMR, Redshift, Kinesis, Lambda, MSK).
• Orchestrate data workflows with AWS Step Functions and Airflow (MWAA).
• Enable analytics & ML workflows with Athena, QuickSight, and SageMaker integration.
• Collaborate with cross-functional teams to ensure secure, scalable data architectures.

Skills

AWS data services

Confluent Kafka

Programming: Python/PySpark/Scala/Java

SQL & databases

Data warehousing & data lakes

CI/CD & DevOps

Terraform & Git

Education

Bachelor's or Master's in CS/SE or related field

Tools

Airflow

Jenkins

Git

AWS MWAA

Job description

Remote Jobs in the United States seeks a Senior Data Engineer to architect scalable data pipelines on AWS and optimize real-time streaming with Confluent for AI projects. This fully remote role offers flexible scheduling and cross-team collaboration.

You will work with AWS services (S3, Glue, EMR, Redshift, Kinesis, Lambda, MSK), Airflow, and ML tooling (SageMaker) to deliver data-driven insights and production-ready solutions.