Senior Data Engineer / Senior Data Architect

Consult

Hyderabad

Hybrid

INR 3,000,000 - 6,000,000

Part time

21 hours ago

Be an early applicant

Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Trackmind is seeking a Senior Data Engineer/Senior Data Architect to design, build, and maintain scalable data solutions using Databricks. The role emphasizes hands-on data engineering, data modeling, and solution design to deliver reliable datasets for reporting and analytics.

Ideal candidates will have strong Databricks, PySpark, Python, and SQL skills, plus experience with Delta Lake, ETL/ELT, and data governance. Hyderabad-based, hybrid work 3 days/wk.

Qualifications

8+ years of IT experience with data engineering focus.
Hands-on experience with Databricks and PySpark.
Experience designing end-to-end data solutions for enterprise-scale projects.

Responsibilities

Design, build, and maintain scalable data pipelines.
Develop ETL/ELT processes and manage Delta Lake tables.
Create logical and physical data models and architectures.
Collaborate with stakeholders to translate requirements into technical designs.

Skills

Databricks

PySpark

Python

SQL

Delta Lake

ETL/ELT

Data Engineering

Data Modeling

Data Architecture

Data Pipeline Development

Data Transformation

Performance Tuning

Data Quality

Stakeholder Communication

Tools

AWS/Azure

Azure Data Factory/AWS Glue

Power BI/Tableau

Kafka/Streaming

CI/CD & DevOps

Git/Azure DevOps

Databricks Unity Catalog

Data Governance

Metadata/Lineage

Data Taxonomy

Job description

Trackmind Posted 2 days ago

External Job Posting Notice This is an external job post. Consult Now does not have a relationship with this companyfor this role. If you have any questions about the position or application process,please contact the company directly.

We are looking for an experienced Senior Data Engineer / Senior Data Architect to design, build, and maintain scalable data solutions using Databricks.

The ideal candidate should have strong hands-on experience in Databricks, PySpark, Python, SQL, Delta Lake, ETL/ELT, and Data Modeling. The candidate will work closely with business and technical stakeholders to understand requirements, design data solutions, build reliable data pipelines, and deliver high-quality datasets for reporting, dashboards, and analytics.

This role requires a combination of hands-on Data Engineering, Data Architecture, Data Modeling, Solution Design, and Stakeholder Management skills.

Key Responsibilities:

Data Engineering & Pipeline Development

Design, develop, and maintain scalable data pipelines using Databricks, PySpark, Python, and SQL.
Build ETL/ELT pipelines to ingest data from internal and external source systems.
Load and manage data in Databricks Delta Tables.
Handle data from multiple and evolving source systems.
Implement data validation, quality checks, error handling, and monitoring.
Troubleshoot and optimize data pipelines for performance, reliability, and scalability.

Data Transformation & Modeling

Analyze source data and business requirements to design appropriate data transformations.
Develop standardized and curated datasets for reporting, dashboards, and analytics.
Design and maintain logical and physical data models.
Apply dimensional modeling concepts such as fact and dimension tables, star schema, and normalization/denormalization.
Ensure data models are scalable and aligned with business requirements.

Solution Architecture

Design end-to-end data architectures and data movement strategies.
Evaluate source systems and integration patterns and recommend appropriate solutions.
Design scalable, secure, maintainable, and reliable data solutions.
Create technical documentation covering architecture, data flows, mappings, and integration processes.
Contribute to reusable data engineering frameworks and best practices.

Business & Stakeholder Management

Work directly with business users, data consumers, and technical teams to understand and clarify requirements.
Translate business requirements into technical specifications and data models.
Understand business processes and determine appropriate data transformation and architecture approaches.
Communicate technical solutions effectively to both technical and non-technical stakeholders.

Data Governance & Quality

Implement data quality and validation frameworks.
Follow data governance, naming conventions, taxonomy, metadata, and lineage standards.
Ensure data accuracy, consistency, traceability, and auditability.
Support enterprise data management and governance initiatives.

Key Skills – Must Have: