Sr. Data Engineer

BigThinkCode; Chennai District; On-site; INR 800,000 - 1,200,000; Full time

Job summary

BigThinkCode in Chennai is seeking a skilled Data Engineer to design, build, and maintain robust data pipelines. You will be responsible for optimizing data flow and ensuring seamless access to structured/unstructured data.

The ideal candidate should have over 4 years of experience in Data Engineering with strong SQL proficiency, programming skills in Python or R, and familiarity with data warehouse solutions. The role emphasizes collaboration across stakeholders to drive technical solutions, enhancing data governance and quality.

Qualifications

• 4+ years of experience in Data Engineering.
• Hands-on experience creating data pipelines.
• Expertise in writing optimized SQL scripts.

Responsibilities

• Design and maintain scalable data pipelines.
• Optimize SQL queries for large-scale datasets.
• Ensure data quality and security.

Skills

SQL proficiency

Data modeling expertise

Python or R

Data warehouse solutions

Apache Kafka or AWS Kinesis

Data quality and governance

CI/CD practices

Tools

Google BigQuery

Apache Airflow

AWS

GCP

Azure

Git

Job description

We are seeking a skilled Data Engineer to design, build, and maintain robust data pipelines and infrastructure. You will play a pivotal role in optimizing data flow, ensuring scalability, and enabling seamless access to structured/unstructured data across the organization. The ideal candidate will design, build, and optimize scalable data pipelines with strong SQL proficiency and data modeling expertise.

Responsibilities

• Design, develop, and maintain scalable pipelines to process structured and unstructured data.
• Optimize and manage SQL queries for performance and efficiency in large-scale datasets.
• Experience working with data warehouse solutions (e.g., Redshift, BigQuery, Snowflake) for analytics and reporting.
• Collaborate with data scientists, analysts, and business stakeholders to translate requirements into technical solutions.
• Experience implementing solutions for streaming data (e.g., Apache Kafka, AWS Kinesis) is preferred but not mandatory.
• Ensure data quality, governance, and security across pipelines and storage systems.
• Document architectures, processes, and workflows for clarity and reproducibility.

Requirements

• 4 or more years of experience in Data Engineering.
• Expertise in SQL (complex queries, optimization, and database design).
• Write optimized and production-grade SQL scripts for transformations and data validation.
• Solid understanding and hands‑on experience in creating data pipelines and patterns.
• Proficiency in programming languages such as Python or R for scripting, automation, and pipeline development.
• Hands‑on experience with Google BigQuery and Apache Airflow.
• Experience working on cloud-based platforms like AWS, GCP, or Azure.
• Experience working with structured data (RDBMS) and unstructured data (JSON, Parquet, Avro).
• Familiarity with cloud-based data warehouses (Redshift, BigQuery, Snowflake).
• Knowledge of version control systems (e.g., Git) and CI/CD practices.