Data Engineer(Localto NC)

American business solutions inc; Raleigh (NC); On-site; USD 110,000 - 170,000; Full time

Job summary

American business solutions inc in Raleigh, NC is seeking a Senior Data Engineer to design, build, and optimize enterprise ETL/ELT pipelines on Azure. You will work with Azure Synapse, Data Factory, PySpark, SQL, and Power BI to deliver analytics datasets and dashboards, while applying AI integrations and governance.

This role requires 7+ years in data analytics/engineering, strong SQL/PLSQL, and Agile experience; onsite collaboration with business users and security controls are essential.

Qualifications

• Experience in enterprise data analytics and engineering.
• 7+ years of ETL workflow design and delivery.
• Advanced SQL and PL/SQL with performance tuning.
• Hands-on PySpark, Python, or Scala experience.
• Azure data modeling and cost optimization knowledge.
• Security with RBAC and Microsoft Entra ID.
• Familiarity with Power BI semantic models and dataflows.
• Knowledge of Azure OpenAI or generative AI data integration is a plus.
• Ability to organize and prioritize complex procedures.

Responsibilities

• Design, build, and maintain robust enterprise ETL/ELT pipelines using Azure Data Factory, Synapse Pipelines, or PL/SQL procedures.
• Manage and optimize Azure Synapse Analytics (SQL and Spark pools) and Microsoft Fabric Lakehouse.
• Develop, test, and tune complex SQL and PL/SQL scripts, stored procedures, packages, and functions to support data integration.
• Collaborate with business users to define analytical goals and build Power BI-ready datasets.
• Integrate AI and machine learning insights using Azure Machine Learning and Azure OpenAI Service.
• Enforce data governance, quality, and security via Microsoft Purview and Microsoft Entra ID.
• Build cross-functional reporting, dashboards, and predictive analytics models

Skills

Enterprise data analytics

Data engineering

ETL workflow design

SQL/PLSQL

Performance tuning

Agile methodologies

RBAC and cloud security

Power BI data modeling

AI integration with Azure

Tools

Azure Synapse Analytics

Azure Data Factory

Power BI

PySpark

Python

Scala

Azure OpenAI

Job description

• Design, build, and maintain robust enterprise ETL/ELT pipelines using Azure Data Factory, Synapse Pipelines, or PL/SQL procedures.
• Manage and optimize Azure Synapse Analytics (SQL and Spark pools) and Microsoft Fabric Lakehouse.
• Develop, test, and tune complex SQL and PL/SQL scripts, stored procedures, packages, and functions to support data integration.
• Collaborate with business users to define analytical goals and build Power BI-ready datasets.
• Integrate AI and machine learning insights using Azure Machine Learning and Azure OpenAI Service.
• Enforce data governance, quality, and security via Microsoft Purview and Microsoft Entra ID.
• Build cross-functional reporting, dashboards, and predictive analytics models

Skill

Required / Desired

Amount

of Experience

• Experience in enterprise data analytics, engineering, and designing complex ETL workflows. Required 7 Years
• Expertise in Azure Synapse Analytics, Azure Data Factory, and cloud data warehousing Required 4 Years
• Advanced SQL and PL/SQL skills, including query optimization, performance tuning, and indexing strategies Required 7 Years
• Hands-on experience with PySpark, Python, or Scala Required 6 Years
• Experience with data modeling, performance tuning, and cost optimization in Azure Required 4 Years
• Strong knowledge of Microsoft Entra ID, role-based access control (RBAC), and cloud security Required 3 Years
• Familiarity with Power BI semantic models and dataflows Required 3 Years
• Knowledge of Azure OpenAI or generative AI data integration Highly desired 3 Years
• Ability to organize, prioritize, and follow complex and/or detailed technical procedures Required 7 Years
• Experience with Agile (Scrum, Kanban, or SAFe) development Required 3 Years

Skills :

• Hands-on experience with PySpark,Python,or Scala Required 6 Years Experience with data modeling,performance tuning,and cost optimization in Azure Required 4 Years Strong knowledge of Microsoft Entra ID,role-based access control (RBAC),and cloud security Required 3 Years