Databricks Data Engineer — Remote Contract

Centillion Infotech LLC.; United States; Remote; USD 120,000 - 160,000; Part time

Job summary

Centillion Infotech LLC. is seeking an experienced Databricks Engineer/Data Engineer for a remote contract role. The ideal candidate has 7+ years of overall experience and at least 2 years hands-on Databricks experience, with strong PySpark, SQL, Delta Lake, and AWS skills.

The role covers the full data engineering lifecycle from ingestion to deployment, monitoring, and optimization, including CI/CD, data quality, and collaboration with cross-functional teams.

Qualifications

• 5 years of experience designing and delivering cloud-based data solutions.
• 2 years of hands-on Databricks experience.
• Strong experience with Databricks, Lakeflow Connect, Lakeflow Jobs, Spark Declarative Pipelines, DABs/Databricks Asset Bundles, Unity Catalog, Delta Lake, PySpark, SQL.

Responsibilities

• Design, develop, test, deploy, monitor, and optimize secure data pipelines (batch and streaming).
• Build scalable data ingestion pipelines using different patterns.
• Develop data solutions with Databricks, PySpark, SQL, Delta Lake, Unity Catalog.
• Work with Lakeflow Connect, Lakeflow Jobs, Spark Declarative Pipelines.
• Develop and manage deployments using DABs/Databricks Asset Bundles.
• Implement data modeling within pipelines and analytics solutions.
• Create data quality checks, validation rules, and pipeline expectations.
• Implement CI/CD for data engineering workflows.
• Use Git and related practices for source control and deployment automation.
• Support real-time and batch data processing; monitor and troubleshoot production pipelines.

Skills

Hands-on data engineering

Troubleshooting

Team collaboration

Communication

Education

Bachelor's degree or equivalent in CS/Engineering/IT

Tools

Databricks

Lakeflow Connect

Lakeflow Jobs

Spark Declarative Pipelines

Databricks Declarative Automation Bundles (DABs)

Databricks Asset Bundles

Unity Catalog

Delta Lake

PySpark

SQL

AWS

Git

CI/CD

Job description

Centillion Infotech LLC. is seeking an experienced Databricks Engineer/Data Engineer for a remote contract role. The ideal candidate has 7+ years of overall experience and at least 2 years hands-on Databricks experience, with strong PySpark, SQL, Delta Lake, and AWS skills.

The role covers the full data engineering lifecycle from ingestion to deployment, monitoring, and optimization, including CI/CD, data quality, and collaboration with cross-functional teams.