Director, Data Engineer - PGIM Technology (Hybrid - Newark, NJ)

Prudential Annuities Distributors (PAD); Newark (NJ); On-site; USD 130,000 - 170,000; Full time

Job summary

Prudential Annuities Distributors (PAD) is seeking a Director, Data Lead for PGIM Product Technology to spearhead data engineering and AI initiatives using Microsoft Azure services. This role requires extensive experience in cloud computing and data architecture.

The successful candidate will be responsible for implementing configurable ETL frameworks, designing AI solutions, and collaborating with teams to enhance data integration within Microsoft Fabric. A high level of leadership and communication skills is essential.

Qualifications

• 10+ years of data architect experience with cloud computing.
• Proficiency in Azure services like Synapse Analytics and Data Factory.
• Strong knowledge of data governance and security measures.

Responsibilities

• Lead data engineering and AI initiatives with Microsoft Fabric.
• Design and implement ETL frameworks ensuring data quality.
• Develop data integration solutions within Microsoft Fabric.

Skills

Cloud computing experience

Data governance

Leadership

Proficiency with CI/CD pipelines

Excellent communication skills

Education

Bachelor’s or Master’s in Computer Science, Data Engineering

Tools

Microsoft Azure

Power BI

Azure AI Foundry

Job description

Job Summary

As the Director, Data Lead for the PGIM Product Technology, the incumbent will lead data engineering and AI initiatives within Microsoft Fabric and Azure services.

Responsibilities

• Design and implement configurable data ingestion ETL framework, ensuring data quality, transformation, and modeling.
• Implement lakehouse solutions using Microsoft Fabric and Azure services.
• Develop and deploy data integration solutions, including ingestion, transformation, and delivery to consumers within Microsoft Fabric.
• Work with infrastructure and DevOps teams to build CI/CD pipelines extendable organization-wide.
• Architect BI solutions with Power BI, ensuring seamless data integration for analytics and reporting.
• Design and build AI solutions leveraging search, embeddings, retrieval, ranking, and Retrieval‑Augmented Generation (RAG).
• Set up an AI roadmap for service delivery to consuming systems and stakeholders.
• Establish workspace architecture strategy, building data warehouse and lakehouse solutions for data sharing while maintaining security and governance.
• Lead a small team to design, build, and monitor data and AI solutions, enforcing best practices for security, compliance, scalability, reliability, and performance.
• Serve as subject‑matter expert on Fabric, providing hands‑on training and mentorship to teams.
• Maintain comprehensive documentation (playbooks) covering architectures, processes, and procedures.
• Collaborate with business and technology partners to gather requirements and translate them into scalable Microsoft Fabric solutions.
• Continuously seek new knowledge, adopt emerging technologies, and share insights with the engineering community.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Data Engineering or related discipline.
• 10+ years of cloud computing experience with Microsoft Azure, including migrations, integrations, and deployments.
• 10+ years of experience as a Data Architect, designing, managing, and deploying client solutions.
• Strong knowledge of Azure services (Synapse Analytics, Data Factory, Storage Accounts, Logic Apps, Functions, SQL Database, Active Directory, DevOps, Monitor, etc.).
• Deep understanding of Fabric workloads: Notebooks, Deployment Pipelines, Workspace architecture and security, Data Warehouse/Lakehouse Architecture, Semantic Model, Data Flow, Data Activator, AI Skills, Copilot, and Power BI integration.
• Experience building intelligent applications with Azure AI Foundry, Prompt Orchestration, Azure AI Search, and agent orchestration for GenAI use cases.
• Proficiency with CI/CD pipelines using GitHub Actions in Azure environments.
• Proven ability to implement data governance (Purview), security (OneLake), retention schedules, and audit compliance.
• Experience in .NET architecture and development on Azure platform services.
• Track record of delivering multiple concurrent, overlapping projects on‑time, on budget, and within scope.
• Leadership experience driving business outcomes in technical teams.
• Financial Services experience, especially in Asset Management, institutional or mutual funds (preferred).
• Excellent communication, collaboration, and problem‑solving skills.
• Preferred Microsoft certifications: Azure Solutions Architect Expert, Azure Developer Associate, Azure Administrator Associate, Azure Data Engineer, Fabric Engineer, Power BI Data Analyst.

Additional Information

PGIM welcomes all applicants, even if not all requirements are met. If your skills align with the role, we encourage you to apply.

Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, ancestry, sex, sexual orientation, gender identity, genetics, disability, marital status, age, veteran status, domestic partner status, medical condition or any other characteristic protected by law. For accommodations, email [e-mail]. For technical assistance, email [e-mail].