JOB SUMMARY
We are seeking an experienced Cloud Data Engineer with strong hands-on expertise in Snowflake and AWS data services, particularly AWS Glue and AWS Lambda. The ideal candidate will design, develop, and optimize scalable data pipelines and cloud-based data solutions while ensuring reliable data processing, integration, and availability.
The role requires strong experience building ETL/ELT pipelines, Snowflake data models, AWS-based data workflows, and serverless data processing solutions.
KEY RESPONSIBILITIES
- Design and develop scalable data pipelines using Snowflake, AWS Glue, and AWS Lambda.
- Build and maintain ETL/ELT workflows for ingesting and transforming data from multiple sources.
- Develop optimized Snowflake tables, views, schemas, stored procedures, and data models.
- Create AWS Glue jobs and workflows for large-scale data processing and transformation.
- Develop AWS Lambda functions for event-driven data processing and automation.
- Integrate Snowflake with AWS services and enterprise data sources.
- Implement data validation, error handling, monitoring, and pipeline recovery processes.
- Optimize Snowflake queries, workloads, storage, and compute performance.
- Develop reusable data engineering frameworks and automation processes.
- Work with structured and semi-structured data including JSON, CSV, and Parquet.
- Implement data quality and reconciliation checks across ingestion and transformation processes.
- Troubleshoot pipeline failures, data issues, and performance bottlenecks.
- Collaborate with analysts, architects, developers, and business stakeholders to deliver reliable data solutions.
- Maintain technical documentation for data pipelines, integrations, and cloud architecture.
REQUIRED QUALIFICATIONS
- 5+ years of professional experience in Data Engineering.
- Strong hands‑on experience with Snowflake.
- Strong experience developing AWS Glue jobs, crawlers, workflows, and ETL processes.
- Strong experience with AWS Lambda and serverless data processing.
- Experience designing and implementing ETL/ELT pipelines.
- Strong SQL skills and experience with Snowflake query optimization.
- Experience with AWS data services and cloud-based data architectures.
- Experience working with S3 and integrating data across AWS services.
- Strong understanding of data modeling, data warehousing, and dimensional modeling.
- Experience working with APIs and multiple data sources.
- Proficiency in Python for data engineering and automation.
- Experience with data quality, validation, monitoring, and troubleshooting.
- Strong analytical and problem-solving skills.
PREFERRED QUALIFICATIONS
- Experience with AWS Step Functions, EventBridge, CloudWatch, or Kinesis.
- Experience implementing CI/CD for data pipelines.
- Experience with Infrastructure as Code such as Terraform or CloudFormation.
- AWS certification is a plus.
- Experience working with large-scale enterprise data platforms.