Senior Databricks Data Engineer - Lead Enterprise Lakehouse

Capital Farm Credit; College Station (TX); On-site; USD 140,000 - 180,000; Full time

Benefits offered by this job

Incentive Program

Accrued Time Off

Retirement 401(k)

Health Coverage

Parental Leave

Life & Disability Insurance

Education & Wellness

Job summary

Capital Farm Credit, the largest rural lending cooperative in Texas, seeks a Senior Databricks Data Engineer to design, build, and govern cloud-based data solutions supporting enterprise analytics and AI initiatives.

You'll lead a team of data engineers, implement Lakehouse patterns with Databricks and Azure, ensure data quality, security, and scalable ETL/ELT pipelines while collaborating with analytics, security, and application teams.

Qualifications

• Bachelor’s degree or equivalent in CS/IS/Engineering/Data Analytics or related field.
• 5+ years hands-on data engineering with Azure/Databricks; 2+ years as senior engineer or mentor.
• Databricks, Spark, PySpark, Delta Lake, Unity Catalog, SQL, Python, notebooks, jobs, clusters, Lakehouse architecture required.
• Azure Data Lake Storage, Azure SQL, Key Vault, managed identities, ETL/ELT, dimensional modeling, cloud security fundamentals required.
• Designing data solutions for analytics, ML, governed reporting, and secure data consumption; knowledge of feature engineering and AI data prep.
• Databricks Data Engineer certifications required; Professional cert preferred.

Responsibilities

• Lead a team of data engineers; assign work, estimate effort, track delivery, remove obstacles.
• Mentor engineers; provide design guidance and onboarding.
• Lead technical design sessions; set engineering standards for ingestion, transformation, governance, deployment, observability, data consumption.
• Ensure quality through design/code reviews, testing, documentation, and release standards.
• Collaborate with data, analytics, app, infra, security, and AI teams to architect enterprise data solutions.

Skills

Databricks

Delta Lake

Unity Catalog

Azure Data Lake Storage (ADLS)

Azure SQL

Python

SQL

PySpark

Spark

ETL/ELT

Education

Bachelor’s degree in computer science, Information Systems, Engineering, Data Analytics, or related field

5+ years data engineering experience

Tools

Databricks

Apache Spark

Python

Delta Lake

Unity Catalog

Azure Data Lake Storage

Azure SQL

Key Vault

Azure DevOps

Job description

Capital Farm Credit, the largest rural lending cooperative in Texas, seeks a Senior Databricks Data Engineer to design, build, and govern cloud-based data solutions supporting enterprise analytics and AI initiatives.

You'll lead a team of data engineers, implement Lakehouse patterns with Databricks and Azure, ensure data quality, security, and scalable ETL/ELT pipelines while collaborating with analytics, security, and application teams.