Data Engineer

BPMLinks; Hyderabad; On-site; INR 1,000,000 - 1,800,000; Full time

Job summary

BPMLinks is seeking a skilled Data Engineer in Hyderabad to design, build, and maintain scalable data pipelines and infrastructure. The role focuses on data integrity, security, and efficiency using Snowflake, DBT, Kafka, and AWS services.

You will develop ETL/ELT workflows, real-time streaming solutions, and governance practices while collaborating with analysts and stakeholders to ensure data accessibility for analytics and decision-making.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
• Strong expertise in Snowflake, DBT, and Kafka for data processing and analytics.
• Experience with AWS services including Glue, Lambda, S3, and IAM.
• Proficiency in Python for data manipulation, automation, and pipeline development.
• Experience with SQL and performance optimization techniques.
• Familiarity with CI/CD pipelines and version control (Git).
• Strong understanding of data warehousing, modeling, and governance best practices.

Responsibilities

• Design, develop, and maintain data pipelines using DBT, Snowflake, and AWS Glue.
• Build and optimize ETL/ELT workflows for efficient data processing.
• Develop and maintain real-time data streaming solutions using Kafka.
• Work with AWS services such as Lambda, S3, Glue, and IAM for cloud-based data integration.
• Implement data governance, security, and best practices to ensure compliance and efficiency.
• Write efficient, scalable, and maintainable Python code for data transformations and automation.
• Optimize Snowflake performance, including warehouse sizing, query tuning, and cost management.
• Collaborate with data analysts, scientists, and stakeholders to ensure data accessibility and usability.

Skills

Snowflake

DBT

Kafka

Python

SQL

CI/CD

Git

Data Warehousing

Data Governance

Education

Bachelor’s/Master’s degree in Computer Science, Data Engineering, or a related field

Tools

Snowflake

DBT

Kafka

AWS Glue

Lambda

S3

IAM

Airflow

Terraform / CloudFormation

Job description

We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will have experience working with modern data tools and cloud platforms, ensuring data integrity, efficiency, and security.

Key Responsibilities:

• Design, develop, and maintain data pipelines using DBT, Snowflake, and AWS Glue.
• Build and optimize ETL/ELT workflows for efficient data processing.
• Develop and maintain real-time data streaming solutions using Kafka.
• Work with AWS services such as Lambda, S3, Glue, and Redshift for cloud-based data integration.
• Implement data governance, security, and best practices to ensure compliance and efficiency.
• Write efficient, scalable, and maintainable Python code for data transformations and automation.
• Optimize Snowflake performance, including warehouse sizing, query tuning, and cost management.
• Collaborate with data analysts, scientists, and stakeholders to ensure data accessibility and usability.

Required Qualifications:

• Bachelor’s/Master’s degree in Computer Science, Data Engineering, or a related field.
• Strong expertise in Snowflake, DBT, and Kafka for data processing and analytics.
• Experience with AWS services including Glue, Lambda, S3, and IAM.
• Proficiency in Python for data manipulation, automation, and pipeline development.
• Experience with SQL and performance optimization techniques.
• Familiarity with CI/CD pipelines and version control (Git).
• Strong understanding of data warehousing, modeling, and governance best practices.

Preferred Qualifications:

• AWS certifications such as AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect/ SnowPro Certification
• Experience with orchestration tools like Apache Airflow.
• Exposure to Terraform or CloudFormation for infrastructure automation.