Manager – Azure Data Architect

Jobtailor; Kolkata District; On-site; INR 3,500,000 - 7,000,000; Full time

Job summary

Jobtailor in Kolkata, India, seeks a senior data engineer to lead design and delivery of big data and cloud-based solutions. You will work on data acquisition, transformation, modelling, governance and data management to support client goals.

The role requires hands-on coding (Python, PySpark, SQL), experience with ADB, ADF and Synapse, and strong stakeholder engagement to deliver end-to-end data platforms at scale.

Qualifications

• 7+ years hands-on experience in one or more of the above areas.
• 10+ years industry experience.
• Strong understanding & familiarity with all cloud ecosystem components.
• Strong understanding of underlying cloud architectural concepts and distributed computing paradigms.
• Experience in the development of large-scale data processing.
• Hands-on programming experience in ADB, ADF, Synapse, Python, PySpark, SQL.
• Hands-on expertise in cloud services like AWS and/or Microsoft Azure ecosystem.
• Solid understanding of ETL methodologies in a multi-tiered stack with data modelling & data governance.
• Experience with BI and data analytics databases.
• Experience converting business problems/challenges to technical solutions considering security, performance, scalability etc.
• Experience in enterprise-grade solution implementations.
• Experience in performance benchmarking enterprise applications.
• Strong stakeholder, client, team, process & delivery management skills.

Responsibilities

• Develop standardized practices for delivering new products and capabilities using Big Data & cloud technologies, including data acquisition, transformation, analysis, modelling, governance & data management skills
• Interact with senior client technology leaders, understand their business goals, create, propose solutions, estimate effort, build architectures, develop and deliver technology solutions
• Define and develop client specific best practices around data management within a cloud environment
• Recommend design alternatives for data ingestion, processing and provisioning layers
• Design and develop data ingestion programs to process large data sets in Batch mode using ADB, ADF, PySpark, Python, Snypase
• Develop data ingestion programs to ingest real-time data from live sources using Apache Kafka, Spark Streaming and related technologies
• Have managed a team and have experience in end‑to‑end delivery
• Have experience building technical capability and teams to deliver
• Demonstrates extensive experience in developing and delivering technology solutions using Big Data and cloud technologies, with a strong focus on data management, ingestion, and processing. Proven ability to interact with senior stakeholders and translate business goals into technical solutions while managing teams and ensuring successful project delivery.

Skills

Big Data

Cloud architectures

Data governance

Team leadership

End-to-end delivery

Data ingestion

Python

PySpark

SQL

Kafka

Spark Streaming

Azure Databricks

Azure Data Factory

Azure Synapse

Tools

Python

PySpark

SQL

Apache Kafka

Spark Streaming

Azure Synapse

Azure Data Factory

Azure Databricks

AWS

Job description

Responsibilities

• Develop standardized practices for delivering new products and capabilities using Big Data & cloud technologies, including data acquisition, transformation, analysis, modelling, governance & data management skills
• Interact with senior client technology leaders, understand their business goals, create, propose solutions, estimate effort, build architectures, develop and deliver technology solutions
• Define and develop client specific best practices around data management within a cloud environment
• Recommend design alternatives for data ingestion, processing and provisioning layers
• Design and develop data ingestion programs to process large data sets in Batch mode using ADB, ADF, PySpark, Python, Snypase
• Develop data ingestion programs to ingest real-time data from live sources using Apache Kafka, Spark Streaming and related technologies
• Have managed a team and have experience in end‑to‑end delivery
• Have experience building technical capability and teams to deliver

Requirements

• Minimum 7 years hand‑on experience in one or more of the above areas
• Minimum 10 years industry experience
• Strong understanding & familiarity with all cloud ecosystem components
• Strong understanding of underlying cloud architectural concepts and distributed computing paradigms
• Experience in the development of large‑scale data processing
• Hands‑on programming experience in ADB, ADF, Synapse, Python, PySpark, SQL
• Hands‑on expertise in cloud services like AWS and/or Microsoft Azure ecosystem
• Solid understanding of ETL methodologies in a multi‑tiered stack with data modelling & data governance
• Experience with BI and data analytics databases
• Experience converting business problems/challenges to technical solutions considering security, performance, scalability etc.
• Experience in enterprise‑grade solution implementations
• Experience in performance benchmarking enterprise applications
• Strong stakeholder, client, team, process & delivery management skills

Demonstrates extensive experience in developing and delivering technology solutions using Big Data and cloud technologies, with a strong focus on data management, ingestion, and processing. Proven ability to interact with senior stakeholders and translate business goals into technical solutions while managing teams and ensuring successful project delivery.