Senior Data Architect & Lead Data Engineer (Onsite)

SIDRAM TECHNOLOGIES

Cary (NC)

On-site

USD 140,000 - 200,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

SIDRAM TECHNOLOGIES in Cary, NC is seeking a Data Architect to lead hands-on data engineering at scale. You will design and implement lakehouse architectures and production-grade pipelines requiring 10–15 years of experience for a full-time onsite role.

The role demands expertise in Python/Scala/SQL, Azure Databricks, Delta Lake, ADLS Gen2, ADF, and LLM deployments. Strong governance, security, and leadership skills are essential for success.

Qualifications

  • Strong production-level data engineering skills with Python, PySpark, Scala and SQL.
  • Experience with Azure Databricks Delta Lake, Spark tuning, and Unity Catalog.
  • Experience with Azure data services: ADLS Gen2 and Data Factory.
  • Hands-on with Bronze-Silver-Gold lakehouse architecture at enterprise scale.
  • Metadata-driven data pipelines, data quality, and large-scale optimization.
  • Hands-on AI/LLM work: RAG, embeddings, retrieval and prompt engineering.
  • LLM frameworks: LangChain, LlamaIndex, LangGraph; Azure OpenAI/OpenAI/Databricks model serving.
  • DevOps/CI-CD for data pipelines; Terraform and Databricks Asset Bundles.
  • Technical leadership: design, code reviews, guide teams.
  • Knowledge of financial/insurance data, reconciliation or GL data.
  • AI-driven data quality, anomaly detection and automated reconciliation.
  • Knowledge graphs, ontologies, semantic layers, or Text-to-SQL.
  • Azure security, data governance, PII protection and fine-grained access controls.
  • MLOps/LLMOps, model evaluation and production AI monitoring.

Responsibilities

  • Lead data engineering initiatives and deliver scalable data solutions.
  • Design and implement lakehouse architectures across Bronze-Silver-Gold.
  • Build production-grade data pipelines with secure governance.
  • Prototype and deploy LLM-based data applications (RAG, embeddings).
  • Mentor engineers, perform code reviews and ensure best practices.

Skills

Python
PySpark
Scala
SQL
Azure Databricks
Delta Lake
Azure Data Factory
ADLS Gen2
LLM/AI
LangChain
OpenAI/Azure OpenAI
Terraform
CI/CD
MLOps
Knowledge graphs
Data governance
PII protection
Security & governance

Tools

Azure Databricks Delta Lake
Spark tuning
Azure Data Factory (ADF)
Unity Catalog
Azure DevOps
Databricks Asset Bundles
Terraform

Job description

SIDRAM TECHNOLOGIES in Cary, NC is seeking a Data Architect to lead hands-on data engineering at scale. You will design and implement lakehouse architectures and production-grade pipelines requiring 10–15 years of experience for a full-time onsite role.

The role demands expertise in Python/Scala/SQL, Azure Databricks, Delta Lake, ADLS Gen2, ADF, and LLM deployments. Strong governance, security, and leadership skills are essential for success.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Architect - Cary, NC // Fulltime // H1B/GC/USC
Data Architect - Cary, NC // Fulltime // H1B/GC/USC

SIDRAM TECHNOLOGIES • Cary (NC)

On-site
USD 140,000 - 200,000
Senior Data Architect - Banking Lakehouse (Onsite)
Senior Data Architect - Banking Lakehouse (Onsite)

Themesoft Inc. • Dallas (TX)

On-site
USD 120,000 - 160,000
Senior Data Engineer, Databricks Lakehouse (Onsite Atlanta)
Senior Data Engineer, Databricks Lakehouse (Onsite Atlanta)

Capgemini • Atlanta (GA)

On-site
USD 89,000 - 166,000
Vacation: 12-25 days
Company paid holidays
Personal days
+5
Senior Azure Databricks Data Engineer (Onsite - Cary, NC)
Senior Azure Databricks Data Engineer (Onsite - Cary, NC)

Tech Mirrors • Cary (NC)

On-site
USD 140,000 - 180,000
Senior Data Architect: Cloud DW, Data Lakes & Governance
Senior Data Architect: Cloud DW, Data Lakes & Governance

Pitech Solutions, Inc. • Durham (NC)

On-site
USD 120,000 - 150,000
Data Warehouse Architect / Data Engineering Lead
Data Warehouse Architect / Data Engineering Lead

Value Innovation Labs • Lansing (MI)

Hybrid
USD 140,000 - 200,000
Senior Data Warehouse & Lakehouse Architect
Senior Data Warehouse & Lakehouse Architect

RICEFW Technologies Inc • Lansing (MI)

On-site
USD 140,000 - 200,000
Senior Data Architect: Lakehouse & AI-Ready Data
Senior Data Architect: Lakehouse & AI-Ready Data

Tata Consultancy Services Limited • Irving (TX)

On-site
USD 140,000 - 180,000
Discretionary Incentive
Medical Coverage
Dental & Vision
Senior Data Architect - Onsite & Enterprise Analytics Lead
Senior Data Architect - Onsite & Enterprise Analytics Lead

Bright Vision Technologies • Short Hills (NJ)

On-site
USD 120,000 - 190,000
Data Engineer Lead: Lakehouse Architect (Onsite Phoenix)
Data Engineer Lead: Lakehouse Architect (Onsite Phoenix)

VSE AVIATION INC (US) • Phoenix (AZ)

On-site
USD 140,000 - 200,000