Remote Senior Integration Engineer - AWS Data Pipelines

Sonata Software (SonataOne); Irving (TX); Remote; USD 96,000 - 165,000; Full time

Job summary

Sonata Software is seeking a Senior Integration Engineer with 7-10 years of experience to design and implement scalable data ingestion, transformation, and integration pipelines in AWS. You will work on cloud-native data solutions, database migrations, and production-grade data platforms across cross-functional teams.

The role emphasizes Databricks migrations, Apache Airflow orchestration, containerized deployments with Docker and Kubernetes, and robust CI/CD and testing practices to ensure

Qualifications

• 7-15 years of hands-on experience in Data Engineering, Cloud Engineering, or Integration Engineering roles.
• Experience designing and supporting enterprise-scale data platforms and integrations.

Responsibilities

• Design, develop, and maintain scalable data ingestion, transformation, and integration pipelines using Python and SQL.
• Build and manage cloud-native data solutions in AWS (S3, EC2, IAM) and other services.
• Develop database migration frameworks using Alembic for seamless schema evolution.
• Orchestrate, monitor, and optimize data workflows with Apache Airflow and Astronomer.
• Collaborate with product owners, data engineers, analysts, and stakeholders to deliver production-grade solutions.
• Lead migration initiatives to Databricks to improve performance and analytics.
• Create automated validation and testing using Python and AI-assisted tools (e.g., Grok).
• Identify gaps, design improvements, and enhance system reliability and efficiency.
• Implement containerized apps with Docker and deploy workloads on Kubernetes for scalability.
• Drive CI/CD, code quality standards, release management, and infrastructure automation.
• Monitor performance, troubleshoot production issues, and optimize cloud resources for cost.
• Ensure security, governance, and best practices for cloud/data platforms.

Skills

AWS

Docker

Python

SQL

Databricks

Airflow

Alembic

Kubernetes

Git

Grok

CI/CD

REST API

PySpark

Education

Bachelor's or Master's degree in Computer Science/IT/Engineering

Tools

AWS

Terraform

Snowflake

Kafka

Airflow

Docker

Kubernetes

Alembic

Job description

Sonata Software is seeking a Senior Integration Engineer with 7-10 years of experience to design and implement scalable data ingestion, transformation, and integration pipelines in AWS. You will work on cloud-native data solutions, database migrations, and production-grade data platforms across cross-functional teams.

The role emphasizes Databricks migrations, Apache Airflow orchestration, containerized deployments with Docker and Kubernetes, and robust CI/CD and testing practices to ensure