AWS Data Engineer

Facctum; Bengaluru Urban; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Facctum IT Solutions India Private Limited is seeking an experienced AWS Data Engineer to lead a large migration from MatillionETL to a modern AWS-native data platform. The role requires expertise in Apache Airflow, AWS Glue, Snowflake, and data warehouse modernization, with collaboration across stakeholders and engineering teams.

The ideal candidate will design scalable data pipelines, optimize cloud data processing, and establish best practices for cloud-native data engineering.

Qualifications

• 2+ years of intensive hands-on experience with AWS data services.
• Experience migrating ETL platforms such as Matillion to AWS-native architectures.
• Strong experience developing workflows in Apache Airflow.
• Extensive experience building and optimizing AWS Glue jobs.
• Hands-on experience with Snowflake stored procedures and performance tuning.

Responsibilities

• Develop modules/code for migration of existing Matillion jobs to AWS-native solutions.
• Participate in Requirements Analysis of existing data processing jobs.
• Design, develop, and promote scalable data pipelines using AWS Glue and Apache Airflow.
• Build robust data ingestion, transformation, and orchestration frameworks on AWS.
• Create reusable and modular ETL/ELT components for enterprise data platforms.

Skills

Apache Airflow

AWS Glue

Snowflake

AWS Lambda

AKS? no

Tools

MatillionETL

SnowSQL

Git

Job description

Facctum IT Solutions India Private Limited | Full time

Bangalore North, India

Job Description

We are seeking an experienced AWS Data Engineer to lead and execute a large-scale migration from MatillionETL to a modern AWS-native data platform. The ideal candidate will possessdeep expertise in Apache Airflow, AWS Glue, AWS Lambda and Snowflake ,with a strong background in designing scalable data pipelines, cloud-based dataintegration, workflow orchestration, and data warehouse modernization.

The candidate will work closelywith business stakeholders, data architects, and engineering teams to migrateexisting ETL workloads, optimize data processing frameworks, and establish bestpractices for cloud-native data engineering.

Requirements

Key Responsibilities

• Develop modules/code for migration of existing Matillion jobs to AWS-native solutions.


• Participatein Requirements Analysis of existing data processing jobs.


• Design,develop, and promote scalable data pipelines using AWS Glue and ApacheAirflow (and other basic AWS Services) - must have.


• Buildrobust data ingestion, transformation, and orchestration frameworks onAWS.


• Createreusable and modular ETL/ELT components for enterprise data platforms.


• Datamodeling and warehousing concepts – must have


• Datamigration and modernization projects – good to have


• Implementdata quality, monitoring, alerting, security, governance, and compliancestandards.


• Collaboratewith data architects and business teams to understand migrationrequirements and translate them into technical solutions.


• Optimizedata processing performance, cost, and scalability across AWS services.


• Participatein CI/CD best practices and DevOps processes for data engineeringworkflows.
  

Mandatory Skills

Core Technologies

• Apache Airflow (DAG development, workflow orchestration, scheduling,monitoring)


• AWS Glue (ETL jobs, Glue Studio, Crawlers, Data Catalog, Spark-basedtransformations)


• Snowflake (Data Warehousing, SnowSQL, Snowpipe, Streams & Tasks, PerformanceTuning)


• AWS Lambdaand Step Functions (preferred)


• Gitexperience (must-have)

Programming languages: Python,SQL, Spark (any 1 is must)

PySpark, Matillion, Shellscripting (good to have)

Experience Requirements

• 2+years of intensive hands-on experience with AWS data services.


• Provenexperience migrating ETL platforms such as Matillion (or other ETL tools like DataStage) to AWS-native architectures (Good to have).


• Strongexperience developing workflows in Apache Airflow.


• Extensiveexperience building and optimizing AWS Glue jobs.


• Hands-onexperience with Snowflake stored procedures (must-have), performance tuning (good-to-have).


• Strongunderstanding of cloud architecture, scalability, deployments.