Data Architect

Tredence

Kolkata, Bengaluru

Hybrid

INR 1,800,000 - 3,200,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Tredence is seeking a Senior Data Engineer to design and deliver modern data warehouse solutions using Databricks and Azure Stack. You will work closely with DW/BI leads to translate ETL requirements into scalable pipelines and data models for reporting.

Ideal candidates have 12-16 years of experience in data engineering, strong SQL, Python, Spark (PySpark), and domain expertise in Databricks, Delta Lake, and Azure data services.

Qualifications

  • Bachelor's/Master's in CS or equivalent experience.
  • 12-16 years of relevant experience in data engineering/analytics.
  • Databricks Data & AI platform understanding; Delta Lake architecture.

Responsibilities

  • Develop Modern Data Warehouse solutions using Databricks and Azure Stack.
  • Collaborate with DW/BI leads on ETL pipeline development requirements.
  • Triage issues to identify gaps and fix issues in pipelines.
  • Model data to fulfill reporting needs and support business reporting.

Skills

SQL
Python
Spark (PySpark)
Databricks
Airflow
Unix Shell Scripting
Data Modeling
Communication

Education

Bachelors/Masters in CS

Tools

Azure Databricks
Azure Data Factory
Azure Data Lake

Job description

Role Description:


  • Developing Modern Data Warehouse solutions using Databricks and Azure Stack

  • Ability to provide solutions that are forward-thinking in data engineering and analytics space

  • Collaborate with DW/BI leads to understand new ETL pipeline development requirements.

  • Triage issues to find gaps in existing pipelines and fix the issues

  • Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs

  • Drive technical discussion with client architect and team members

  • Orchestrate the data pipelines in scheduler via Airflow Skills and Qualifications:

  • Bachelor's and/or masters degree in computer science or equivalent experience.

  • Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture

  • Should have hands-on experience in SQL, Python and Spark (PySpark)

  • Experience in building ETL / data warehouse transformation processes

  • Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot

  • Databricks Certified Data Engineer Associate/Professional Certification (Desirable).

  • Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects

  • Should have experience working in Agile methodology

  • Strong verbal and written communication skills.

  • Strong analytical and problem-solving skills with a high attention to detail.


Mandatory Skills:

Azure Databricks, Pyspark, Azure Data Factory, Azure Data Lake.


Job Location - Bangalore, Chennai, Gurgaon, Pune, Kolkata

Experience Level - 12-16 years

Expected Joining Time - 30-60 Days Notice
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Databricks (Remote)
Databricks (Remote)

PradeepIt Global Consulting Pvt Ltd. • Bengaluru

Remote
INR 1,200,000 - 1,800,000
Data Engineer
Data Engineer

Cnx • Bengaluru

On-site
INR 1,200,000 - 1,500,000
Senior Data Architect (Databricks, Azure, AWS)
Senior Data Architect (Databricks, Azure, AWS)

Happiest Minds Technologies • Bengaluru

On-site
INR 4,500,000 - 7,000,000
Databricks Data Architect - R01573925
Databricks Data Architect - R01573925

Brillio • Bengaluru

On-site
INR 4,200,000 - 7,000,000
Data Engineer
Data Engineer

T-Systems ICT India Pvt. Ltd • Karnataka

Hybrid
INR 1,300,000 - 1,500,000
Data Engg With Databricks - Technical Lead-Data Engg
Data Engg With Databricks - Technical Lead-Data Engg

Birlasoft • Pune District

On-site
INR 1,200,000 - 1,800,000
Sr. Databricks Architect
Sr. Databricks Architect

Weekday • Pune District

Hybrid
INR 2,500,000 - 3,500,000
Sr. Databricks Architect
Sr. Databricks Architect

Weekday • Chennai District

On-site
INR 2,500,000 - 3,500,000
Data Engineer-Information Technology
Data Engineer-Information Technology

Emcure Pharmaceuticals Limited • Pune District

On-site
INR 1,400,000 - 2,000,000
Senior Developer - Data Engineering
Senior Developer - Data Engineering

Annalect, Omnicom Media Group India Private Limited. • Bengaluru

On-site
INR 1,200,000 - 1,800,000