Job Description: Data Engineer (AWS & Snowflake)
Role Overview
We are seeking an experienced Data Engineer to design, develop, and support scalable cloud-based data platforms and integration solutions. The ideal candidate will have strong expertise in AWS serverless technologies, Snowflake, Terraform, Python, and DevOps practices, with experience building end-to-end data pipelines, API integrations, and cloud-native data platforms.
The role involves working closely with business stakeholders, solution architects, and analytics teams to deliver robust, secure, and scalable data solutions.
Key Responsibilities
Data Engineering & Integration
- Design, develop, and maintain scalable data pipelines and ingestion frameworks.
- Build end-to-end integrations from external APIs into AWS and Snowflake.
- Develop and optimize ELT/ETL processes for structured and semi-structured data (JSON, CSV, XML).
- Implement data quality, validation, monitoring, and reconciliation processes.
- Design and maintain data models for reporting, analytics, and customer data platforms.
AWS Cloud Development
- Develop serverless solutions using AWS Lambda.
- Build and maintain API integrations using AWS API Gateway.
- Design event-driven architectures using AWS EventBridge.
- Develop containerized workloads using AWS Fargate/ECS where appropriate.
- Manage data landing zones and storage solutions using Amazon S3.
- Configure and maintain secure cloud networking and IAM permissions.
Snowflake Development
- Build and maintain Snowflake databases, schemas, stages, tasks, and streams.
- Design scalable data architectures and dimensional models.
- Develop and optimize Snowflake SQL transformations and data pipelines.
- Monitor and optimize Snowflake performance and cost efficiency.
Infrastructure as Code & DevOps
- Develop and maintain infrastructure using Terraform.
- Create reusable Terraform modules for AWS and Snowflake resources.
- Build CI/CD pipelines and deployment automation.
Automation & Monitoring
- Develop operational monitoring, alerting, and dashboard solutions.
- Automate administrative and support activities where possible.
- Troubleshoot production incidents and perform root cause analysis.
- Support business-critical BAU processes and operational data platforms.
Required Skills & Experience
Cloud & AWS
- AWS Lambda
- AWS API Gateway
- AWS EventBridge
- AWS Fargate / ECS
- Amazon S3
- AWS IAM
- CloudWatchSNS/SQS
- AWS DevOps services
Programming & Automation
Infrastructure & DevOps
- Terraform
- Git/GitHub
- CI/CD Pipelines
- Infrastructure as Code (IaC)
Experience Required
- 3+ years of Data Engineering experience.
- 3+ years working with AWS cloud services. Role & responsibilities