Senior Data Engineer — Databricks & Cloud Platforms

VDart Inc; Dallas (TX); On-site; USD 120,000 - 150,000; Full time

Job summary

VDart Inc. seeks a Senior Data Engineer to design, build, and support enterprise data platforms powering critical business initiatives. This role combines hands-on data engineering, cloud platform administration, database management, and DevOps practices to deliver scalable data solutions.

Expertise in Databricks, Azure, AWS, Python, and SQL is essential. The ideal candidate will design ETL/ELT pipelines, manage data models and cloud databases, and implement CI/CD with Azure DevOps.

Qualifications

• Bachelor's degree in CS, Data Eng, Computer Eng, or related field.
• 5+ years of data engineering experience.
• Hands-on ETL/ELT development experience.
• Experience designing scalable data models and database architectures.
• Strong Databricks administration and platform management experience.
• Experience with Azure and AWS cloud platforms.
• Strong SQL development and database optimization skills.
• Experience with SQL Server and PostgreSQL.
• Experience developing applications using Python.
• Experience with Azure DevOps, CI/CD pipelines, and deployment automation.
• Knowledge of HA/DR concepts.
• Strong communication and collaboration skills.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines and data integration processes.
• Build and support enterprise data models, database structures, and cloud-based data solutions.
• Administer and optimize Databricks environments, including deployment, configuration, monitoring, and performance tuning.
• Support data platforms hosted in Azure and AWS cloud environments.
• Develop and maintain solutions using Python and Node.js.
• Configure, monitor, and maintain SQL Server and PostgreSQL database environments.
• Implement and support CI/CD pipelines and automated deployment processes using Azure DevOps.
• Collaborate with business stakeholders, application teams, and data consumers to gather requirements and deliver scalable solutions.
• Troubleshoot and resolve data, database, and platform-related issues.
• Ensure database security, performance, availability, and reliability through proactive monitoring and maintenance.
• Optimize SQL queries, indexes, and database performance.
• Support high availability, disaster recovery, backup, and recovery strategies.
• Participate in production deployments, maintenance activities, and platform upgrades as needed.
• Promote data governance, security, and best practices across the data ecosystem.

Skills

Communication skills

Team collaboration

Education

Bachelor's degree in Computer Science, Data Engineering, Computer Engineering, or related field

Tools

Databricks

Azure

AWS

Python

Node.js

SQL Server

PostgreSQL

Azure DevOps

CI/CD

Job description

VDart Inc. seeks a Senior Data Engineer to design, build, and support enterprise data platforms powering critical business initiatives. This role combines hands-on data engineering, cloud platform administration, database management, and DevOps practices to deliver scalable data solutions.

Expertise in Databricks, Azure, AWS, Python, and SQL is essential. The ideal candidate will design ETL/ELT pipelines, manage data models and cloud databases, and implement CI/CD with Azure DevOps.