AWS DATA ENGINEER

NITYO; Bengaluru; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

NITYO is seeking a talented AWS Data Engineer for a Full-Time role in Bengaluru, Karnataka. The candidate will develop and manage scalable ETL/ELT pipelines using Apache Spark on AWS Glue/Databricks.

The role requires strong collaboration with business analysts, ensuring data quality and integrity. Candidates should have significant experience with AWS services, SQL, and data wrangling techniques. Relevant education includes BA, B.Tech, MBA, or equivalent.

Qualifications

• Strong experience with Databricks, including notebooks, Delta Lake, and DBFS.
• Strong experience with AWS Glue and services like S3, IAM, RDS.
• Proficiency in SQL, PySpark, and data wrangling techniques.
• Hands-on experience with CI/CD pipelines using Pulumi/Terraform.
• Strong experience in Power BI.

Responsibilities

• Develop and manage scalable ETL/ELT pipelines using AWS Glue/Databricks.
• Collaborate to understand data requirements.
• Integrate and process data from structured and unstructured sources.
• Implement data governance best practices.
• Participate in code reviews and documentation.
• Ensure data quality across systems and reports.

Skills

Databricks

Apache Spark

SQL

PySpark

Power BI

CI/CD pipelines

Education

BA, BCS, B.COM, MBA, BE, B.TECH, BSC, M.COM, MCA, MCS

Job description

AWS Data Engineer

We are seeking a talented and experienced AWS Data Engineer to join our team. The ideal candidate will develop and manage scalable ETL/ELT pipelines using Apache Spark on AWS Glue/Databricks. You will collaborate closely with business analysts and stakeholders to understand data requirements and ensure data quality, integrity, and consistency across all systems and reports.

Key Responsibilities

• Develop and manage scalable ETL/ELT pipelines using Apache Spark on AWS Glue/Databricks.
• Collaborate with business analysts and stakeholders to understand data requirements.
• Integrate and process data from various structured and unstructured sources (e.g., Azure Data Lake, APIs, SQL databases).
• Implement data governance best practices including lineage, versioning, and metadata management.
• Participate in code reviews, documentation, and adherence to development standards.
• Ensure data quality, integrity, and consistency across all systems and reports.

Requirements

• Strong experience with Databricks (or Apache Spark), including notebooks, Delta Lake, and DBFS.
• Strong experience with AWS Glue including AWS services like S3, IAM, RDS, etc.
• Proficiency in SQL, PySpark, and data wrangling techniques.
• Hands-on experience with CI/CD pipelines using Pulumi/Terraform.
• Strong experience in Power BI.
• Education: BA, BCS, B.COM, MBA, BE, B.TECH, BSC, M.COM, MCA, MCS.

Work Arrangements

• Type: Full-Time
• Location: Bengaluru, Karnataka, India