Data Engineering Lead - AWS Data Pipelines & Real-Time

Cloud Analytics Technologies, LLC; Irving (TX); In loco; USD 84.000 - 120.000; Tempo pieno

Descrizione del lavoro

Cloud Analytics Technologies, LLC is seeking a senior Data Engineer to architect and optimize large-scale data pipelines and microservices in Python. You will drive cloud-native ingestion and streaming solutions using AWS services like Kinesis, S3, DynamoDB, and EventBridge.

You will lead teams to deploy production-grade data platforms, ensure data integrity, and collaborate with business and engineering stakeholders to translate complex requirements into scalable designs.

Competenze

• Bachelor’s degree in Computer Science, Computer Engineering, or related field.
• 8+ years of experience in data engineering or related disciplines with increasing responsibility.
• Extensive experience with AWS data services (Kinesis, S3, DynamoDB, EventBridge) at scale.
• Strong Python development and production deployment experience.
• Experience leading teams to build high-throughput, scalable data pipelines.
• Strong SQL skills with data quality and validation practices.

Mansioni

• Define solution architecture with Principal Engineers and Data Architects.
• Lead design and optimization of scalable data pipelines and microservices in Python.
• Develop cloud-native data ingestion and streaming solutions on AWS.
• Own data integration frameworks and source data pipelines supporting CI Autonomy initiatives.
• Collaborate with business, product, and engineering stakeholders to translate requirements into scalable architectures.
• Establish automated testing, data quality controls, and validation across distributed data ecosystems.
• Lead monitoring and performance tuning usingCloudWatch for high availability and reliability.

Conoscenze

Python

AWS

SQL

Data pipelines

Formazione

Bachelor’s degree

Strumenti

Kinesis

S3

DynamoDB

EventBridge

CI/CD

Jira

Jenkins

Descrizione del lavoro

Cloud Analytics Technologies, LLC is seeking a senior Data Engineer to architect and optimize large-scale data pipelines and microservices in Python. You will drive cloud-native ingestion and streaming solutions using AWS services like Kinesis, S3, DynamoDB, and EventBridge.

You will lead teams to deploy production-grade data platforms, ensure data integrity, and collaborate with business and engineering stakeholders to translate complex requirements into scalable designs.