Data Engineer

HypTechie; Bengaluru; Remote; INR 900,000 - 1,500,000; Full time

Benefits offered by this job

Remote work options

Flexible hours

Career growth

Job summary

HypTechie is seeking an experienced Data Engineer in Bengaluru, with hands-on experience building scalable data pipelines and delivering at least one Generative AI project. You will work across AWS/Azure/GCP, leveraging Snowflake, BigQuery, Redshift, and data lake/warehousing ecosystems to design secure, cost-efficient, and scalable solutions.

You will design pipelines, implement cloud-native services, and apply DevOps practices (IaC, CI/CD) while ensuring compliance with security and networking

Qualifications

• Proven experience as a Data Engineer with at least one Generative AI project delivered.
• Strong expertise in cloud data engineering across AWS, Azure or GCP.
• Hands-on experience with data lakes, data warehousing, and ETL tools.
• Proficiency in Python programming.
• Knowledge of DevOps practices, CI/CD, and automation on cloud.
• Strong understanding of cloud networking, security, and design best practices.

Responsibilities

• Design and implement data pipelines across AWS, Azure, or GCP.
• Work with cloud storage, databases, data warehouses, and data lakes (e.g., Snowflake, BigQuery, AWS Redshift, ADLS, S3).
• Leverage cloud compute services and load balancing for scalable architecture.
• Implement cloud identity management, authentication, and authorization.
• Utilize cloud-native services such as AWS Lambda, Step Functions, Cloud Run, Cloud Functions, and Azure Functions.
• Integrate and process structured, semi-structured, and unstructured data using tools like Azure Databricks, Data Factory, Synapse Analytics, AWS Glue, EMR, Dataflow, and Dataproc.
• Apply infra capacity sizing and cost optimization to ensure performance and scalability.
• Contribute to solution architecture decisions using various cloud methodologies.
• Build solutions using Python for data engineering and automation tasks.
• Implement DevOps best practices such as IaC, CI/CD, and automated deployments.
• Ensure compliance with networking, security, and cloud design principles.

Skills

Data engineering

Python

Cloud data engineering

DevOps

CI/CD

Security

Tools

Snowflake

BigQuery

AWS Redshift

ADLS

S3

Azure Databricks

Data Factory

Synapse Analytics

AWS Glue

EMR

Dataflow

Dataproc

Job description

We are looking for an experienced Data Engineer who has hands-on expertise in building scalable data pipelines and has worked on at least one Generative AI project. The ideal candidate will have strong experience across cloud platforms, modern data warehousing, and big data ecosystems, with the ability to design optimized, secure, and cost-effective solutions.

Key Responsibilities

• Design and implement data pipelines across AWS, Azure, or GCP.
• Work with cloud storage, databases, data warehouses, and data lakes (e.g., Snowflake, BigQuery, AWS Redshift, ADLS, S3).
• Leverage cloud compute services and load balancing for scalable architecture.
• Implement cloud identity management, authentication, and authorization.
• Utilize cloud-native services such as AWS Lambda, Step Functions, Cloud Run, Cloud Functions, and Azure Functions.
• Integrate and process structured, semi-structured, and unstructured data using tools like Azure Databricks, Data Factory, Synapse Analytics, AWS Glue, EMR, Dataflow, and Dataproc.
• Apply infra capacity sizing and cost optimization to ensure performance and scalability.
• Contribute to solution architecture decisions using various cloud methodologies.
• Build solutions using Python for data engineering and automation tasks.
• Implement DevOps best practices such as IaC, CI/CD, and automated deployments.
• Ensure compliance with networking, security, and cloud design principles.

Required Skills & Experience

• Proven experience as a Data Engineer, with at least 1 Generative AI project delivered.
• Strong expertise in cloud data engineering (AWS, Azure, or GCP).
• Hands-on experience with data lakes, data warehousing, and ETL tools.
• Proficiency in Python programming.
• Knowledge of DevOps practices, CI/CD, and automation on cloud.
• Strong understanding of cloud networking, security, and design best practices.

What You’ll Love About Working Here

Flexibility that supports you – remote work options and flexible hours to maintain work-life balance.

Career growth at the core – access to diverse projects, mentorship, and advancement opportunities.

Upskilling opportunities – certifications and learning in cutting-edge technologies like Generative AI.