AWS Data Engineer

Lvtlabs; Atlanta (GA); On-site; USD 100,000 - 120,000; Full time

Job summary

Lvtlabs is looking for an experienced Data Engineer to design and implement data pipelines using AWS services, including S3, Lambda, and Glue. The ideal candidate has over 8 years of experience in data engineering, proficient in SQL and Python, and knowledgeable in CI/CD integration. Strong communication skills required for collaboration with teams. Locations include Atlanta, GA, Toronto, and remote options.

Qualifications

• 8+ years of experience in Data Engineering with AWS services.
• Hands-on ETL developer proficient in Python and SQL.
• Experience designing and implementing data pipelines.

Responsibilities

• Design and implement data pipelines using AWS services.
• Work with large data volumes and perform data cleansing.
• Integrate CI/CD pipelines to deploy changes.

Skills

AWS Data services

Strong SQL knowledge

AWS CDK

Python

Git

ETL Development

Data cleansing

Data validation

CI/CD Pipeline Integration

Airflow

Education

Bachelor's Degree

Job description

Must Have: AWS Data service experience (S3, GLUE, Lambda, Redshift, KMS etc.), Strong SQL knowledge and Aws CDK knowledge.

8+ years of experience in Data Engineer with AWS services like Simple Storage Service(S3), Lambda, Glue ETL, Redshift, SQL, Python, Git.

1. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred).
2. Must be able to work with large volumes of data coming from various sources. Perform data cleansing, data validation etc.
3. Hands on ETL developer who is good at python, SQL. AWS services like glue, glue crawlers, lambda, red shift, athena, s3, EC2, IAM, Monitoring and Logging mechanisms- AWS cloudwatch, setting up alerts.
4. Deployment knowledge on cloud. Integrate CI/CD pipeline to build artifacts and deploy changed to higher Environments.
5. Scheduling frame works Airflow, AWS Step functions.
6. Excellent Communication skills, should be able to work collaboratively with other teams.

Requirements

• Bachelor's Degree (preferred)

Locations: Toronto ON, Atlanta GA and Remote.