Azure Data Engineer - Remote work

Techolution LLC; India; A distancia; INR 1.800.000 - 3.000.000; Jornada completa

Descripción de la vacante

Techolution is seeking an Azure Data Engineer to lead end-to-end data migration and transformation projects within the Azure ecosystem.

The role emphasizes designing pipelines with Azure Data Factory or Synapse, building data lakes, and applying PySpark/SQL expertise. Remote work is supported, with a focus on complex migration initiatives and cross-team collaboration.

Formación

• 4+ years of hands-on data engineering with a focus on SQL workload migration to Azure.
• Track record delivering complex data migrations (on-prem to Azure or cloud-to-cloud).
• Experience re-platforming SSIS for Azure Data Factory or Azure-SSIS Runtime.
• MS Azure Data Engineer Associate or similar certification preferred.
• Strong problem-solving and collaboration skills.

Responsabilidades

• Design, build, and manage end-to-end data pipelines using Azure Data Factory or Synapse Data Factory for migration/ETL.
• Create scalable Azure Data Lakes and administer secure data stores during migration.
• Utilize Azure Databricks, Synapse Spark, Python, and PySpark for transformations.
• Develop and optimize SQL/T-SQL scripts across Azure SQL Database and SQL Server.
• Engineer SSIS solutions and reengineer SSIS packages for Azure compatibility.
• Collaborate with cloud architects, DBAs, and teams to choose migration approaches.
• Monitor and optimize data workflows for performance, reliability, and cost.

Conocimientos

Azure Data Factory

Synapse Data Factory

Azure Data Lakes

Azure Databricks

Python

PySpark

SQL/T-SQL

Azure SQL Database

SQL Managed Instances

SQL Server

SSIS

Descripción del empleo

We are seeking a skilled Azure Data Engineer with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem. The ideal candidate will have a strong foundation in data integration, transformation, and migration, along with a passion for working on complex data migration projects.

Location: Remote

Work Timings: 4:00 PM to 1:00 AM IST

Experience: 4+ Years

Please Note: This is a pure Azure-specific role. If your expertise is primarily in AWS or GCP, we kindly request that you do not apply.

Roles and responsibilities:

• Design, develop, and manage end-to-end data pipelines using Azure Data Factory or Synapse Data Factory to orchestrate migration and ETL processes.
• Build and administer scalable, secure Azure Data Lakes to store and manage structured and unstructured data during and post-migration.
• Utilize Azure Databricks, Synapse Spark Pools, Python, and PySpark for advanced data transformation and processing.
• Develop and fine-tune SQL/T-SQL scripts for data extraction, cleansing, transformation, and reporting in Azure SQL Database, SQL Managed Instances, and SQL Server.
• Design and maintain ETL solutions using SQL Server Integration Services (SSIS), including reengineering SSIS packages for Azure compatibility.
• Collaborate with cloud architects, DBAs, and application teams to assess existing workloads and define the best migration approach.
• Continuously monitor and optimize data workflows for performance, reliability, and cost-effectiveness across Azure platforms.
• Enforce best practices in data governance, security, and compliance throughout the migration lifecycle.

Required Skills and Qualifications:

• 4+ years of hands-on experience in data engineering, with a clear focus on SQL workload migration to Azure.
• Proven track record of delivering complex data migration projects (on-prem to Azure, or cloud-to-cloud).
• Experience re-platforming or re-engineering SSIS packages for Azure Data Factory or Azure-SSIS Integration Runtime.
• Microsoft Certified: Azure Data Engineer Associate or similar certification preferred.
• Strong problem-solving skills, attention to detail, and ability to work in fast-paced environments.
• Excellent communication skills with the ability to collaborate across teams and present migration strategies to stakeholders.

About Techolution:

Techolution is a next gen AI consulting firm on track to become one of the most admired brands in the world for "AI done right". Our purpose is to harness our expertise in novel technologies to deliver more profits for our enterprise clients while helping them deliver a better human experience for the communities they serve.

At Techolution, we build custom AI solutions that produce revolutionary outcomes for enterprises worldwide. Specializing in "AI Done Right," we leverage our expertise and proprietary IP to transform operations and help achieve business goals efficiently.

We are honored to have recently received the prestigious Inc 500 Best In Business award, a testament to our commitment to excellence. We were also awarded - AI Solution Provider of the Year by The AI Summit 2023, Platinum sponsor at Advantage DoD 2024 Symposium and a lot more exciting stuff! While we are big enough to be trusted by some of the greatest brands in the world, we are small enough to care about delivering meaningful ROI-generating innovation at a guaranteed price for each client that we serve.

Our thought leader, Luv Tulsidas, wrote and published a book in collaboration with Forbes, “Failing Fast? Secrets to succeed fast with AI”. Refer here for more details on the content - https://www.luvtulsidas.com/

Let's explore further!

Uncover our unique AI accelerators with us:

• 1. Enterprise LLM Studio: Our no-code DIY AI studio for enterprises. Choose an LLM, connect it to your data, and create an expert-level agent in 20 minutes.
• 2. AppMod. AI: Modernizes ancient tech stacks quickly, achieving over 80% autonomy for major brands!
• 3. ComputerVision. AI: Our ComputerVision. AI Offers customizable Computer Vision and Audio AI models, plus DIY tools and a Real-Time Co-Pilot for human-AI collaboration!
• 4. Robotics and Edge Device Fabrication: Provides comprehensive robotics, hardware fabrication, and AI-integrated edge design services.
• 5. RLEF AI Platform: Our proven Reinforcement Learning with Expert Feedback (RLEF) approach bridges Lab-Grade AI to Real-World AI.

• Computer Vision demo at The AI Summit New York 2023
• Life at Techolution
• GoogleNext 2023
• Ai4 - Artificial Intelligence Conferences 2023
• WaWa - Solving Food Wastage
• Saving lives - Brooklyn Hospital
• Techolution featured on Worldwide Business with KathyIreland
• Techolution presented by ION World’s Greatest

Visit us @www.techolution.com : To know more about our revolutionary core practices and getting to know in detail about how we enrich the human experience with technology.