Data Engineer

7dxperts; Bengaluru; On-site; INR 1,200,000 - 2,400,000; Full time

Benefits offered by this job

Hands-on AWS, Azure, and GCP

Certification support

Leadership skills development

Medical Insurance coverage for self &/

Provident Fund

Job summary

7dxperts in Bengaluru is seeking a Data Engineer to design, develop, and maintain scalable data pipelines using Databricks, BigQuery, and SQL. You will build batch and streaming data flows supporting analytics and BI use cases, collaborating with stakeholders to deliver robust data solutions.

Ideal candidates have 3–6 years of experience, strong Python/Scala, and hands-on cloud experience across GCP, AWS, or Azure. Hybrid or remote work options are available.

Qualifications

• 3–6 years of experience as a Data Engineer, Analytics Engineer, or ETL Developer.
• Strong SQL proficiency with complex queries and optimization.
• Hands-on experience with BigQuery and Databricks.
• Experience in Python and/or Scala for data processing.
• Experience with cloud platforms (GCP, Azure, AWS).
• Familiarity with ETL/ELT, data warehousing, and dimensional modeling.

Responsibilities

• Design and maintain scalable data pipelines and ETL/ELT workflows.
• Build batch and streaming pipelines to support analytics and BI use cases.
• Collaborate with stakeholders to gather requirements and deliver data solutions.
• Develop data models, schemas, and transformations with data quality in mind.
• Optimize SQL queries, partitioning, clustering, and indexing for cost/performance.
• Support BI tools by providing clean, analytics-ready datasets.
• Implement data quality checks and error handling across pipelines.
• Troubleshoot pipeline issues across dev, test, and prod environments.
• Ensure data governance, security, IAM, and privacy standards.
• Engage with clients and external stakeholders to manage expectations.

Skills

SQL

Google BigQuery

Databricks

Python

Scala

Airflow

Cloud platforms (GCP/AWS/AZURE)

Data modeling

Data governance

Stakeholder collaboration

Tools

Databricks Workflows

Airflow

Job description

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT workflows using Databricks, Google BigQuery, SQL, and cloud-native tools.
• Build and optimize batch and streaming data pipelines to support analytics, reporting, and business intelligence use cases.
• Collaborate with business stakeholders, product teams, analytics engineers, and data analysts to gather requirements and deliver data solutions.
• Develop and manage data models, schemas, and transformations ensuring data quality, integrity, and consistency.
• Optimize SQL queries, partitioning, clustering, and indexing for performance and cost efficiency.
• Support BI tools and dashboards by providing clean, reliable, and analytics-ready datasets.
• Implement and monitor data quality checks, validation rules, and error handling across pipelines.
• Troubleshoot and resolve data pipeline failures, performance issues, and data inconsistencies across environments (dev, test, prod).
• Ensure compliance with data governance, data security, access controls, and privacy standards.
• Work directly with clients and external stakeholders to gather requirements, present deliverables, and manage expectations.

Requirements and skills

• 3-6 years of experience as a Data Engineer, Analytics Engineer, or ETL Developer.
• Advanced proficiency in SQL (complex queries, window functions, optimization, performance tuning).
• Strong hands‑on experience with Google BigQuery (partitioning, clustering, cost optimization).
• Experience building data pipelines using Databricks (Apache Spark, Delta Lake).
• Solid understanding of ETL/ELT architecture, data warehousing, dimensional modeling, and star/snowflake schemas.
• Experience with Python and/or Scala for data processing and automation.
• Familiarity with cloud platforms such as Google Cloud Platform (GCP), Azure, or AWS.
• Experience with pipeline orchestration tools (Airflow, Databricks Workflows, or similar) preferred.
• Knowledge of data governance, security, IAM, and compliance frameworks is a plus.
• Strong client-facing, communication, and problem-solving skills.
• Ability to work independently in a hybrid or remote work environment.

What you can expect from us

We appreciate that individual growth is important as well and we support you on every aspect of personal development.

• Hands‑on AWS, Azure, and GCP.
• Support you on any certification.
• Build leadership skills.
• Medical Insurance coverage for self and family.
• Provident Fund.