Senior Data Engineer (Lead) — Databricks & Lakehouse

InfoBeans; Charlotte (NC); On-site; USD 140,000 - 200,000; Full time

Job summary

InfoBeans in Charlotte, NC is seeking a Senior / Lead Data Engineer to design, build, and optimize enterprise-scale data platforms. The role requires deep hands-on expertise with Azure Databricks, PySpark, ADF, and Delta Lake to deliver reliable, scalable solutions.

You will work closely with architects, analysts, and business stakeholders to implement best practices in data governance, streaming pipelines, and lakehouse architectures, while driving performance and cost efficiency.

Qualifications

• 10+ years of experience designing enterprise data platforms.
• Hands-on expertise with Azure Databricks, PySpark, ADF, Delta Lake.
• Experience building scalable, reliable data pipelines and governance.

Responsibilities

• Design, build, and optimize enterprise-scale data platforms.
• Collaborate with architects, analysts, and stakeholders.
• Deliver high-performance, scalable data solutions.
• Lead data engineering best practices and CI/CD automation.

Skills

Azure Databricks

PySpark

ADF (Azure Data Factory)

Delta Lake

Data warehousing

Streaming

CI/CD

Spark tuning

Data governance

Team collaboration

Tools

Databricks

Azure Data Factory

Delta Lake

Job description

InfoBeans in Charlotte, NC is seeking a Senior / Lead Data Engineer to design, build, and optimize enterprise-scale data platforms. The role requires deep hands-on expertise with Azure Databricks, PySpark, ADF, and Delta Lake to deliver reliable, scalable solutions.

You will work closely with architects, analysts, and business stakeholders to implement best practices in data governance, streaming pipelines, and lakehouse architectures, while driving performance and cost efficiency.