Aws Data Engineer

SAPPHIREINFOTECH; Mumbai; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

SAPPHIREINFOTECH in Mumbai is seeking an AWS Data Engineer with 2 to 5 years of experience. The role focuses on designing robust data infrastructure, building pipelines, data warehouses, and data lakes to support analytics and reporting.

You will implement ETL processes using S3, Glue, EMR, Redshift and Lambda, ensure data quality and security, collaborate with data scientists and analysts, and optimize cloud resources with CloudWatch.

Qualifications

• Degree in CS/IT or related field is required.
• Strong experience with AWS data services and data architectures.
• Proficiency in Python and SQL for data manipulation.
• Experience with data modeling and data warehousing concepts.

Responsibilities

• Design and build data infrastructure including pipelines, warehouses and data lakes.
• Develop ETL workflows to ingest data into AWS data stores.
• Leverage S3, Glue, EMR, Redshift and Lambda for data processing.
• Ensure data quality, governance, and security across platforms.
• Collaborate with data scientists and analysts to meet business needs.
• Monitor performance and optimize costs with CloudWatch.

Skills

AWS

Python

SQL

Data modeling

Data warehousing

ETL

Spark

Data governance

Education

Bachelor's degree in Computer Science / IT or related field

Tools

S3

Glue

EMR

Redshift

Lambda

Job description

JD For AWS data Engineer

Exp 2 to 5 years

Location: Mumbai Goregaon

AWS Data Engineer / Sr Data Engineer

Core Responsibilities

• Design and Build Data Infrastructure:

Create and maintain robust data architecture, including data pipelines, data warehouses, and data lakes.

• Develop Data Pipelines:

Implement ETL (Extract, Transform, Load) processes and workflows to extract, transform, and load data from various sources into AWS data stores.

• Utilize AWS Services:

Work with key AWS services such as S3 (for storage), Glue (for ETL), EMR (for processing), Redshift (for data warehousing), and Lambda (for serverless functions).

• Ensure Data Quality and Security:

Implement data governance policies, data security measures, and data integrity checks to maintain data reliability and security.

• Collaborate with Stakeholders:

Partner with data scientists, business analysts, and other teams to understand data needs and build solutions that align with business goals.

• Monitor and Optimize:

Use tools like CloudWatch to monitor system performance and optimize AWS resource usage for cost-efficiency.

Key Skills and Qualifications

Technical Skills

1. AWS: Deep understanding of AWS services, especially S3, Glue, EMR, Redshift, and Lambda.
2. Programming Languages: Proficiency in Python and SQL for data manipulation and scripting.
3. Data Technologies: Experience with data modeling, data warehousing, ETL tools, and big data technologies like Spark.
4. Data Governance: Knowledge of data governance, compliance, and data privacy best practices.

Soft Skills

1. Problem-Solving: Ability to troubleshoot and resolve data-related issues.
2. Collaboration: Strong teamwork skills to work effectively with cross-functional teams.
3. Communication: Ability to clearly document solutions and effectively communicate technical details to different audiences.

Educational Background

• A bachelor's degree in Computer Science, Information Technology, or a related field is often a requirement.