Azure Data Engineer

Tekskills; Hyderabad; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Tekskills is seeking a Senior Azure Data Engineer to join our Hyderabad/Bangalore/Noida based team. The role focuses on designing and implementing data models and end-to-end data architectures on the Microsoft Azure stack, including Azure Data Factory, Databricks, and related services.

The candidate will lead data engineering initiatives, ensure secure and scalable data workflows, and collaborate with cross-functional teams to deliver data-driven insights and analytics across enterprise-grade

Qualifications

• Deep Microsoft Azure product knowledge and understanding of product features.
• Experience with data modelling from conceptual to physical level.
• End-to-end data architecture and lifecycle management including non-functional requirements.

Responsibilities

• Design, develop and implement data modelling at conceptual, logical and physical levels.
• Own end-to-end Data Architecture and data lifecycle management including operations and NFRs.
• Apply industry data modelling patterns and standards across projects.
• Ensure secure data access with appropriate networking, authorization and authentication.
• Utilize Azure services like Data Factory, Databricks, Blob storage and Cosmos DB.
• Work with ETL/ELT processes and data integration across Azure stack.

Skills

Databricks

Azure Data Factory

Job description

Job Title: Senior Azure Data Engineer

Location: Hyderabad, TA/ Bangalore, KA/ Noida, UP

Skills Required: Digital : Databricks, Azure Data Factory

Experience Range in Required Skills: 10 & Above Years (Relevant should be 8 + yrs.)

Job Description

• Deep Microsoft Azure product knowledge and understanding of product features.
• Proven track record in designing, developing and implementing data modelling, at a conceptual, logical and physical level.
• Experience with accountability for E2E Data Architecture and Lifecycle (including non-functional requirements and operations) management.
• Understands industry recognised data modelling patterns and standards
• Understands overall IT system design, in particular networking, authorization and authentication protocols, data security, disaster recovery.
• Knowledge of the latest technologies to process large amount of data (Apache Spark; Databricks is a plus)
• Experience in MDM, Metadata Management, Data Quality and Data Lineage tools.
• Expertise in cloud security and identity best practices
• A deep understanding of ETL and ELT tools and techniques
• Exposure to other cloud solutions (Google, AWS) a plus.
• Strong experience in architecting fit-for-purpose and fit-for-use complex solutions on the Microsoft Azure cloud stack [IaaS, PaaS and SaaS]
• Very strong hands-on experience in using Microsoft Azure services like Azure Data Factory, Data brick services (like processing streaming data using Spark clusters), usage of Blob containers, ESB, Event Grid, Azure SQL server, Cosmos DB, Azure functions, Analytics (like Power BI) is a mandatory requirement.
• Excellent understanding of architecture patterns and best practices with proven innovative and leading-edge thinking to build cloud-ready systems (e.g., Domain Driven Architecture, multi-tenancy, building for resilience, scalability, performance, and federation, microservices etc.)
• Hands-on work experience on application platforms like .Net, Python, Java etc. preferred
• Understanding of big data platforms concepts and NoSQL technologies, and ability to map such
• The candidate should have experience in modeling data for traditional structured data, as well as information design in Data Lake and NoSQL database engines.
• Fluent with modelling, development and project execution processes around star, snowflake, 3NF, and Data Vault approaches.
• Good experience in working with data using SQLs, Python and Scala in Microsoft based resources like Azure Synapse and Data Lake.
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.