Senior Data Engineer

Tech SMCSquared GCC; Bengaluru; Hybrid; INR 1,200,000 - 1,500,000; Full time

Job summary

Tech SMCSquared GCC in Bengaluru is looking for a Senior Data Analytics Engineer to design and maintain a robust analytics stack. The individual will collaborate with teams to build data pipelines and implement best practices in software engineering.

The ideal candidate should have a Bachelor's degree in computer science and over 5 years of experience in analytics engineering or related fields, with strong skills in Python and SQL. The position offers opportunities for innovation and process improvement within data engineering.

Qualifications

• Minimum of 5 years experience in analytics engineering or related roles.
• Proficiency in Python and SQL is essential.
• Knowledge of data warehouse and ETL migrations preferred.

Responsibilities

• Develop and maintain data pipelines using Apache Airflow.
• Collaborate with teams on data requirements and technical solutions.
• Optimize data workflows while ensuring quality and security.

Skills

Cloud computing platforms

Python

Google BigQuery

SQL

Dataflow

ETL processes

Apache Airflow

Ansible

Tableau APIs

Jenkins

Education

Bachelor’s degree in computer science

Job description

Job Title: Senior Data Analytics Engineer

Location: Bangalore

Experience: 5+ years

Job Summary

The Senior Data Analytics Engineer will develop strategies for and help design, build, and maintain the entire data layer for the analytics stack from top to bottom. This role involves close collaboration with various teams across data engineering, analytics, and visualization to deliver robust Business Intelligence solutions. The engineer will define and apply software engineering best practices such as version control, automated testing, documentation, code review, and continuous integration. Responsibilities include building data pipelines, creating data visualizations, and leading projects related to data ingestion, modeling, and warehouse design.

Roles & Responsibilities

• Provide support and guidance to other Data Engineers.
• Manage the analytics data warehouse, implementing analytical database design principles and business process best practices.
• Design, develop, and maintain scalable data pipelines using Apache Airflow.
• Integrate and manage data within Google BigQuery to meet analytics and reporting needs.
• Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions.
• Implement ETL processes to ensure efficient data extraction, transformation, and loading from multiple sources.
• Optimize data workflows while ensuring data quality, consistency, and security.
• Monitor and troubleshoot performance and reliability of data pipelines.
• Stay current with trends and new technologies in data engineering and cloud platforms.
• Identify, design, and implement internal process improvements such as automation, data delivery optimization, and infrastructure redesign for greater scalability.
• Support analytical requests cross-functionally for internal and external stakeholders.

Years of Experience

• Minimum of 5 years experience working as an analytics engineer, data scientist, data engineer, or related role.

Educational Qualification & Certifications

• Bachelor’s degree in computer science, Information Systems, or related field.

Skill Set Required

Must have:

• Experience developing solutions on cloud computing platforms, with GCP experience preferred.
• 5+ years hands‑on development experience with frameworks such as Python, Java, or Scala.
• Proficiency in Python; Google BigQuery, Google Storage, Cloud Composer, Dataflow; Google PubSub; SQL; Ansible; Tableau APIs; Jenkins; and Shell scripting.

Nice to have:

• Experience with Data Warehouse and ETL migrations.
• Advanced SQL knowledge and experience authoring complex queries in relational databases.
• Experience with Scala, Python, PySpark, Java, REST API, Microservices, etc.
• Prior experience implementing real-time streaming data solutions into an Enterprise Data Warehouse.
• Experience in restaurant or retail operations preferred but not mandatory.