This contract role is for a Senior Azure Data Engineer focused on integrating enterprise HR and organizational data from SAP SuccessFactors into an Azure Databricks-based analytics platform. The position emphasizes end-to-end ETL/ELT pipeline design, API-driven ingestion, and reliable data processing in Microsoft Azure.
Responsibilities
- Design, build, and maintain scalable, high-performance data pipelines in Microsoft Azure to support enterprise data platform initiatives.
- Develop automated ingestion workflows to extract HR, organizational, compensation, job, recruiting, and performance data from SAP SuccessFactors into Azure Databricks.
- Use SAP SuccessFactors OData APIs, Compound Employee APIs, and related integration mechanisms, with Azure Data Factory (ADF) for orchestration, scheduling, and pipeline management.
- Implement data processing and transformation solutions using Azure Databricks, PySpark, and advanced SQL.
- Manage enterprise datasets in Azure Data Lake Storage (ADLS) and Azure-based data platforms, including data modeling, stored procedures, and incremental and full-load extraction strategies.
- Deliver robust validation, reconciliation, error handling, and performance tuning across integration workflows.
- Collaborate with HR business analysts and technical stakeholders to translate complex data requirements into production-grade engineering solutions.
Requirements
- Proven experience as an Azure Data Engineer with expertise in Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Storage (ADLS), and complex SQL.
- Hands-on experience ingesting and transforming SAP SuccessFactors data using OData APIs, Compound Employee APIs, or other API-based integration patterns into Databricks and Azure architectures.
- Strong proficiency in PySpark and Python for data transformation and distributed processing within Databricks.
- Experience designing efficient incremental load, delta lake, and full-load extraction strategies that support data integrity and scalability.
- Excellent communication skills to work with technical architects, data engineers, and business stakeholders.
Key Technologies
- Microsoft Azure
- Azure Data Factory (ADF)
- Azure Databricks
- Azure Data Lake Storage (ADLS)
- SQL
- PySpark and Python
- SAP SuccessFactors APIs, including OData APIs and Compound Employee APIs
- ETL/ELT pipelines, incremental/full-load extraction strategies
- Delta Lake, stored procedures
Benefits
- Medical and Prescription Drug Plans
- Dental Plan
- Vision Plan
- Health Savings Account
- Health Flexible Spending Account
- Dependent Care Flexible Spending Account
- Supplemental Life Insurance
- Short Term and Long Term Disability Insurance
- Business Travel Insurance
- 401(k) with Plus Match
- Weekly Pay
Contract Details
- Location: Charlotte, NC (hybrid)
- Job type: contract
- Pay: USD 55 to 65 per hour
- Initial contract term through March 2027 with strong potential for multi-year extensions
Employment Terms
- Strictly W2 only (no C2C, no third-party agencies, and no referrals)
Benefits Eligibility After Waiting Period
Upon completion of the waiting period, consultants are eligible for: Medical and Prescription Drug Plans, Dental Plan, Vision Plan, Health Savings Account, Health Flexible Spending Account, Dependent Care Flexible Spending Account, Supplemental Life Insurance, Short Term and Long Term Disability Insurance, Business Travel Insurance, 401(k) with Plus Match, and Weekly Pay.