Job Description: Senior Data Engineer (Azure/SQL/BI) Azure Data Engineering with AI Enablement Knowledge We are looking for a Senior Data Engineer (Azure/SQL/BI) with 10-15+ years of experience in data engineering, SQL development, and business intelligence. The ideal candidate should have strong SQL/BI skills along with hands‑on experience in Azure cloud data services. The candidate should also have working knowledge of Generative AI, RAG, conversational AI, and implementing AI solutions using trusted enterprise data.
Key Skills & Experience
- 10-15+ years of experience in data engineering, data warehousing, and SQL Server development.
- Strong in T‑SQL - stored procedures, queries, CTEs, window functions, UDFs, and performance tuning.
- Experience with query optimization, indexes, execution plans, and partitioning.
- Skilled in building data marts with facts, dimensions, and Slowly Changing Dimensions for reporting and BI.
- Hands‑on with Azure Data Factory - pipelines, incremental loads, parameterization, error handling, logging, monitoring, and scheduling.
- Experience with Azure Synapse Analytics for reporting, enterprise data warehousing, and large‑scale data processing.
- Experience with Azure Data Lake, Blob Storage, and Storage Accounts for data management.
- Experience using Azure Databricks and PySpark notebooks for data transformation and processing.
- Strong understanding of ETL/ELT design, with auditing, monitoring, restartability, error handling, and data‑quality checks.
- Proficient in Python, PySpark, PowerShell, REST APIs, and JSON for automation and integration.
- Experience with Azure DevOps - CI/CD pipelines, Git version control, release management, and deployments across development, QA, and production.
- Familiar with SSIS and traditional ETL tools.
- Knowledge of Power BI, including DAX, Row‑Level Security, semantic models, and Paginated Reports, is a plus.
- Experience preparing trusted, reusable, and well‑documented datasets for reporting, analytics, business applications, and AI use cases.
- Understanding of metadata management, data lineage, business definitions, source‑to‑target mappings, data ownership, and refresh processes.
- Experience implementing data‑quality rules for completeness, accuracy, consistency, validity, uniqueness, and timeliness.
- Knowledge of Microsoft Purview, Databricks Unity Catalog, or similar metadata and data‑governance tools is preferred.
- Strong analytical skills to turn business requirements into scalable data solutions.
- Good communication, documentation, troubleshooting, and problem‑solving skills.
- Self‑driven and detail‑oriented, able to work independently and collaboratively with business, application, infrastructure, and data teams.
Preferred Skills
- Experience building metadata‑driven and reusable data integration frameworks.
- Experience supporting Azure data engineering solutions in production environments.
- Exposure to enterprise chatbots, copilots, RAG solutions, conversational analytics, or AI agents.
- Experience integrating Azure data solutions with Power BI, Power Apps, Power Automate, Microsoft Teams, or custom applications.
- Microsoft Azure, Databricks, Power BI, AI, or data‑governance certifications are preferred.
Role Emphasis
This is primarily a Senior Azure Data Engineer role. AI/RAG knowledge is a supporting capability to help prepare trusted data, integrate Azure data services with AI platforms, and collaborate on approved AI implementations.
Senior Data Engineer (Azure/SQL/BI) - Job Description