Azure Databricks Engineer

Ethereum Technologies LLC; Houston (TX); On-site; USD 120,000 - 150,000; Full time

Job summary

ETHEREUM TECHNOLOGIES LLC in Houston, TX seeks a Specialist with 7 years of experience to design and develop scalable data solutions using Azure Databricks. You will build and optimize data pipelines, implement ETL workflows, and collaborate with cross-functional teams to meet enterprise analytics needs.

Responsibilities include writing clean PySpark and Python code, integrating with Azure data services, and maintaining data quality and reliability.

Qualifications

• 7+ years of experience designing and developing scalable data solutions using Azure Databricks.
• Ability to write clean PySpark and Python code for data ingestion and analytics.
• Experience with ETL workflows, data quality, and enterprise data processing.

Responsibilities

• Lead design and development of complex data pipelines on Azure Databricks.
• Write PySpark/Python code for ingestion, transformation and analytics.
• Troubleshoot pipelines to ensure high availability and performance.
• Collaborate with data architects, analysts and stakeholders to align solutions with business goals.

Skills

PySpark

Python

Data pipelines

ETL

Data quality

Collaboration

Tools

Azure Databricks

Job description

Seeking a Specialist with 7 years of experience in designing and developing scalabledatasolutions using AzureDatabricks

Design develop and optimize scalabledatapipelines leveraging AzureDatabricksto support enterprise leveldataprocessing andanalyticsImplement and maintain ETL workflows ensuring high performancedataquality and reliability Integrate AzureDatabrickswith various Azuredataservices to build robust and scalabledataplatforms Monitor and optimizedataworkflows for scalability cost effectiveness and operational efficiency Collaborate with cross functional teams to aligndatasolutions with business objectives and technical requirements Stay updated with the latest advancements in AzureDatabricksand recommend best practices for continuous improvement

Roles and Responsibilities

Lead the design development and enhancement of complexdatapipelines using AzureDatabricksWrite clean maintainable and efficient PySpark and Python code to supportdataingestion transformation andanalyticsTroubleshoot and resolve issues related todatapipelines and workflows to ensure minimal downtime and high availability Collaborate withdataarchitectsanalystsand stakeholders to gather requirements and deliver scalabledatasolutions Mentor and guide junior team members on AzureDatabricksand best practices indataengineering Documentdataprocesses architectures and workflows to ensure knowledge sharing and compliance Participate actively in design discussions code reviews and agile ceremonies to foster a collaborative and highperforming team environment

ETHEREUM TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. ETHEREUM TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will ETHEREUM TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract