Azure Databricks Engineer

MACHINE LEARNING TECHNOLOGIES LLC

Houston (TX)

On-site

USD 120,000 - 180,000

Full time

6 hours ago

Be an early applicant

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

MACHINE LEARNING TECHNOLOGIES LLC is seeking an Azure Databricks Engineer in Houston, TX to design and build scalable data pipelines using Azure Databricks. You will develop ETL workflows and integrate with Azure data services to enable enterprise-grade analytics.

The ideal candidate has around 7 years of experience in data engineering, strong PySpark and Python skills, and a track record of delivering robust data platforms in cloud environments. This role is on-site with DOE compensation.

Qualifications

Experience designing scalable data pipelines using Azure Databricks.
Strong ETL development and data integration skills.
Familiarity with cloud data services and data governance practices.

Responsibilities

Lead design and enhancement of complex data pipelines with Azure Databricks.
Write clean PySpark and Python code for data ingestion and transformation.
Troubleshoot data pipelines to ensure high availability and performance.
Collaborate with architects and stakeholders to deliver scalable data solutions.

Tools

Databricks

PySpark

Python

Job description

Home
About
Adaptive AI
Industries
Consulting
Jobs-Portal
Contact Us
Home
About
Adaptive AI
Industries
Consulting
Jobs-Portal
Contact Us

Job Overview

Job ID: J52731
Job Title: Azure Databricks Engineer
Location: Houston, TX
Duration: 24 Months + Extension
Hourly Rate: Depending on Experience (DOE)
Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, L2-EAD, GC-EAD
Client: To Be Discussed Later
Employment Type: W-2, 1099, C2C

Job Description

Seeking a Specialist with 7 years of experience in designing and developing scalable data solutions using Azure Databricks. Design develop and optimize scalable data pipelines leveraging Azure Databricks to support enterprise level data processing and analytics. Implement and maintain ETL workflows ensuring high performance data quality and reliability. Integrate Azure Databricks with various Azure data services to build robust and scalable data platforms. Monitor and optimize data workflows for scalability cost effectiveness and operational efficiency. Collaborate with cross functional teams to align data solutions with business objectives and technical requirements. Stay updated with the latest advancements in Azure Databricks and recommend best practices for continuous improvement.

Roles and Responsibilities

Lead the design development and enhancement of complex data pipelines using Azure Databricks. Write clean maintainable and efficient PySpark and Python code to support data ingestion transformation and analytics. Troubleshoot and resolve issues related to data pipelines and workflows to ensure minimal downtime and high availability. Collaborate with data architects analysts and stakeholders to gather requirements and deliver scalable data solutions. Mentor and guide junior team members on Azure Databricks and best practices in data engineering. Document data processes architectures and workflows to ensure knowledge sharing and compliance. Participate actively in design discussions code reviews and agile ceremonies to foster a collaborative and highperforming team environment.

Mandatory Skills :

Databricks

Equal Opportunity Employer

MACHINE LEARNING TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. MACHINE LEARNING TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will MACHINE LEARNING TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract.