Senior Databricks Data Engineer — Azure Lakehouse Lead

capitalfarmcredit; College Station (TX); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Incentive program

Accrued time off

401(k) with employer match

Health coverage

Parental leave

Life & disability insurance

Tuition reimbursement

Wellness stipend

Job summary

Capital Farm Credit seeks a Senior Databricks Data Engineer to design, develop, and support scalable cloud-based data solutions enabling analytics, BI, regulatory reporting, and AI initiatives. You will lead a team of data engineers, drive architecture choices, and ensure secure, governed data products across the enterprise.

You will guide design, review code, mentor teammates, and work closely with data, analytics, security, and AI teams to implement Lakehouse patterns using Azure, Databricks,

Qualifications

• Bachelor's degree or equivalent in a related field is required.
• 5+ years hands-on data engineering with Azure/Databricks or similar cloud platforms.
• Experience leading data engineering teams or mentoring engineers.

Responsibilities

• Provide day-to-day technical leadership to a team of data engineers.
• Lead design sessions and establish standards for ingestion, transformation, governance, deployment, observability, and data consumption.
• Own quality through design/code reviews and release practices.
• Partner with cross-functional teams to architect enterprise data solutions on Azure/Databricks.
• Design and maintain batch and real-time pipelines using Databricks.

Skills

Databricks knowledge

Cloud data governance

Mentoring/team leadership

Data modeling

Python scripting

Education

Bachelor's degree in CS/IS/Engineering or related field

Databricks certification (Associate)

Tools

Databricks

Apache Spark

PySpark

Delta Lake

Unity Catalog

Azure Data Lake Storage

Azure SQL

Key Vault

ETL/ELT tools

SQL tools

Job description

Capital Farm Credit seeks a Senior Databricks Data Engineer to design, develop, and support scalable cloud-based data solutions enabling analytics, BI, regulatory reporting, and AI initiatives. You will lead a team of data engineers, drive architecture choices, and ensure secure, governed data products across the enterprise.

You will guide design, review code, mentor teammates, and work closely with data, analytics, security, and AI teams to implement Lakehouse patterns using Azure, Databricks,