Senior Data Engineer – Databricks ETL/ELT

Intellisoft Technologies; Austin (TX); On-site; USD 120,000 - 160,000; Full time

Job summary

Intellisoft Technologies in Austin, TX is seeking a data engineer with strong ETL/ELT and cloud experience to design and optimize data platforms.

You will work with Python, SQL, Spark, and Databricks, including Azure Databricks notebooks and workflows, to deliver scalable data products. Strong collaboration, troubleshooting, and leadership are essential as you help drive production deployment patterns in a fast-paced environment.

Qualifications

• Bachelor's degree in a technical field or equivalent practical experience.
• Extensive ETL/ELT pipelines and data platforms in cloud environments.
• Proficiency in Python, SQL, Spark, and Databricks for data engineering.
• Experience with Azure Databricks notebooks, jobs/workflows, Unity Catalog.
• CI/CD pipelines, GitHub workflows, and automated data product deployment.
• Strong understanding of medallion architecture and data ingestion patterns.
• Cross-functional collaboration with architecture, product, and business teams.
• Excellent troubleshooting, communication, and technical leadership.

Responsibilities

• Collaborate with architecture, product, and business teams to deliver data solutions.
• Troubleshoot complex data pipelines and mentor junior engineers.
• Lead data engineering initiatives and ensure production deployment patterns.

Skills

Python

SQL

Spark

Databricks

Azure Databricks

CI/CD pipelines

GitHub workflows

Data ingestion patterns

Medallion architecture

Troubleshooting

Technical leadership

Education

Bachelor's degree or equivalent practical experience

Tools

Azure Databricks

Job description

Location: Austin, TX (ONSITE)

Required Qualifications

• Bachelor’s degree in Computer Science, Software Engineering, Computer Engineering, Electrical Engineering, or a related technical field, or equivalent practical experience.
• Strong experience building and supporting ETL/ELT pipelines and data platforms in cloud environments.
• Strong proficiency in Python, SQL, Spark, and Databricks for data engineering use cases.
• Experience with Azure Databricks, including notebooks, jobs/workflows, Unity Catalog, and production deployment patterns.
• Experience with CI/CD pipelines, GitHub-based workflows, and automated deployment of data products.
• Strong understanding of medallion architecture, data ingestion patterns, and batch/streaming tradeoffs.
• Experience working across architecture, product, and business teams to deliver.
• Strong troubleshooting, communication, and technical leadership skills.

Equal Employment Opportunity Statement

We are an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, age, disability, genetic information, veteran status, or any other protected characteristic in accordance with applicable federal, state, and local laws.

We are committed to creating an inclusive environment for all employees.