Senior Data Engineer

Cognosin Pvt Ltd; Thiruvananthapuram; Hybrid; INR 2,500,000 - 4,200,000; Full time

Job summary

Cognosin Pvt Ltd in Thiruvananthapuram is seeking a Senior Data Engineer to design, build, and maintain data solutions on the Microsoft Azure Data Platform and SQL Server. You will develop scalable data pipelines and collaborate with stakeholders to ensure efficient data processing at scale.

The role requires 8–10 years of hands-on experience with Azure Data Factory, Databricks, Synapse, SSIS/SSAS, and strong SQL skills, plus governance, security, and performance focus.

Qualifications

• Experience with Azure Data Factory, Databricks, Synapse, and SSIS/SSAS.
• Strong SQL, data modeling, and ETL/ELT development skills.
• Experience in Azure and AWS cloud platforms and DevOps/CI/CD tools.
• Ability to work in onshore–offshore model and handle large datasets.

Responsibilities

• Design, build, and maintain scalable data pipelines on Azure.
• Develop ETL solutions using ADF, Databricks, and SSIS.
• Analyze data landscape and propose optimization strategies.
• Collaborate with onshore teams to meet requirements.
• Monitor and optimize data systems for performance and reliability.
• Implement data security, governance, and IaC practices.
• Lead data architecture discussions and migrations.

Skills

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

ADLS

Python

SQL

SSIS

SSAS

Terraform

Jenkins

Tools

Databricks

Power BI

Azure Analysis Services

TFS

UC4

Job description

Job Role / Job Description

Job Title: Senior Data Engineer

Experience Level: 8–10 years

Number of Positions: 1

Location: Trivandrum (Hybrid)

We are looking for a Senior Data Engineer responsible for designing, implementing, and maintaining data solutions on the Microsoft Azure Data Platform and SQL Server (SSIS, SSAS, UC4 Atomic). The role involves working closely with stakeholders to ensure efficient data processing, storage, and retrieval at scale.

Roles And Responsibilities

• Design, build, and maintain scalable, reliable data pipelines.
• Develop ETL solutions using Azure Data Factory, Databricks, and SSIS.
• Analyze the existing data landscape and suggest rearchitecting or optimization strategies.
• Collaborate with onshore teams to resolve technical challenges and requirements.
• Monitor, troubleshoot, and optimize data systems for performance and reliability.
• Ensure data architecture aligns with business goals and governance policies.
• Integrate and transform data from diverse sources with high data quality.
• Lead data engineering strategy and architecture discussions.
• Enable and manage data migrations across systems.
• Perform thorough testing and validation of data transformations.
• Define data mappings and translate business processes into technical data requirements.
• Manage pipeline maintenance, testing, and performance validation.
• Build large, complex data sets to meet business needs.
• Analyze and identify data gaps; align business and IT on data requirements.
• Collaborate with IT, DevOps, and cross-functional teams for infrastructure alignment.
• Implement best practices for data security, privacy, and continuous improvement.
• Manage complex cases accurately and efficiently in high-volume environments.

Candidate Profile Expectations

• Proficient in designing solutions using Azure Synapse Analytics, ADLS, ADF, Databricks, Power BI, Azure Analysis Services.
• Strong hands-on experience in SSIS, SQL, query optimization, and ETL pipelines.
• Worked in onshore–offshore model, managing complex scenarios.
• Skilled in handling large structured/unstructured data, analytics, and data science.
• Experience with Azure and AWS cloud services, and DevOps/CI/CD tools.
• Comfortable working with ambiguous requirements and delivering clear outcomes.
• Strong communication skills; detail-oriented and self-driven.
• Experience with Terraform, Jenkins, and Infrastructure as Code (IaC).
• Contributed to architecture frameworks and data warehouse design.
• Solid understanding of full data lifecycle: ingestion, transformation, loading, validation, tuning.
• Experience in Python and Databricks is a plus.

Must-Have Skills

• Azure Data Factory
• Azure Databricks
• Azure Synapse
• ADLS
• Lakehouse Architecture
• Python
• SCD Concepts and Implementation
• SQL, PL/SQL
• SSIS
• SSAS
• TFS

Good-to-Have Skills

• UC4
• Power BI
• DevOps CI/CD
• Banking Domain