Senior Data Engineer (Databricks, dbt & SQL) | Qualis1 | Remote

Qualis1

United States

Remote

USD 120,000 - 180,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Visa sponsorship

Job summary

Qualis1 is seeking a remote Senior Data Engineer to own end-to-end data pipelines, ensuring data quality and robust performance in a Lakehouse environment. You will leverage SQL, dbt, Python, and PySpark to build scalable solutions for an international client base.

The role offers visa sponsorship support and a 12-month contract, with opportunities for growth and exposure within a leading data-centric organization.

Qualifications

  • Bachelor’s degree in Computer Science, Software Engineering, Data Engineering, IT, or related field.
  • 4+ years of hands-on data engineering, big data processing, and production pipeline ownership.
  • Proficiency in SQL, dbt, Python, PySpark and Delta Lake technologies.

Responsibilities

  • Architect, build, optimize, and maintain robust data pipelines using SQL, dbt, and Python.
  • Implement data-quality checks and automated testing within dbt to catch anomalies.
  • Monitor production workflows, manage alerts, and debug pipeline failures end-to-end.
  • Write PySpark transformations for large-scale datasets in Lakehouse environments.
  • Build modular models, snapshots, and tests in dbt for high-performance warehousing.
  • Ensure Delta Lake or similar Lakehouse tech optimization, including ACID/MERGE.
  • Collaborate with teams and stakeholders with clear communication.
  • Maintain technical docs, data lineage maps, and runbooks.
  • Participate in agile planning, code reviews, and design sessions.
  • Deliver high-quality data solutions within project milestones.

Skills

SQL
dbt
Python
PySpark
Delta Lake
Data quality checks
Automated testing
Agile collaboration
Documentation

Education

Bachelor’s degree in Computer Science, Software Engineering, Data Engineering, Information Technology, or a related technical discipline

Tools

Docker
Kubernetes
Terraform
GitHub Actions
Jenkins

Job description

Position Summary: Driving production-focused data engineering, reliable Lakehouse pipelines, automated testing frameworks, and scalable data transformations on a remote basis, Qualis1 is actively seeking an experienced Senior Data Engineer for a 12-month contract engagement with visa sponsorship support. In this vital production ownership role, you will take full operational, tactical, and technical ownership of end-to-end data pipelines, ensuring high data quality, robust system performance, and seamless Lakehouse integration. Bringing deep technical proficiency in Databricks, dbt, SQL, Python, and PySpark, you will empower an elite international technology and consulting corporation to achieve uncompromised data integrity, lightning-fast processing speeds, and superior client delivery. This prestigious career opportunity offers competitive remuneration, enterprise client exposure, and exceptional professional growth within a leading global organization.

Detailed Job Description: As a Senior Data Engineer supporting Qualis1 on a professional remote basis (welcoming all visa backgrounds), you will take full operational, tactical, and technical ownership of pipeline development, data quality assurance, automated testing, and cross-functional engineering collaboration. Your day-to-day responsibilities include building, optimizing, and maintaining robust data pipelines using SQL, dbt, and Python, implementing rigorous data-quality checks and automated testing frameworks within dbt to proactively catch anomalies, monitoring production workflows, managing alerts, and rapidly debugging pipeline failures from root cause to permanent fix, writing efficient PySpark transformations to process large-scale datasets within Lakehouse environments, translating complex data issues into clear, concise action plans for technical teammates and business stakeholders, adhering to strict corporate data engineering standards, and managing application requirements by submitting your updated resume via direct email to Tushar@qualis1inc.com.

Key Responsibilities
  • Architect, build, optimize, and maintain robust data pipelines utilizing SQL, dbt, and Python.
  • Implement rigorous data-quality checks and automated testing frameworks within dbt to proactively catch anomalies and data drift.
  • Monitor production workflows, manage operational alerts, and rapidly debug pipeline failures from root cause to permanent fix.
  • Write efficient PySpark transformations to process large-scale datasets within Lakehouse environments.
  • Build modular models, snapshots, and custom schema tests in dbt for high-performance data warehousing.
  • Ensure functional understanding and optimization of Delta Lake or similar Lakehouse technologies, including ACID transactions and MERGE operations.
  • Collaborate proactively with technical teammates, business stakeholders, and data engineering squads using clear communication.
  • Maintain meticulous technical documentation, data lineage maps, pipeline schematics, and operational runbooks.
  • Participate actively in agile sprint planning, code reviews, architectural design sessions, and continuous improvement reviews.
  • Deliver high-quality data engineering solutions strictly within established project timelines and milestone objectives.
Required Qualifications & Skills
  • Bachelor’s degree in Computer Science, Software Engineering, Data Engineering, Information Technology, or a related technical discipline.
  • Minimum of 4+ years of progressive professional hands-on experience in data engineering, big data processing, and production pipeline ownership.
  • Expert-level SQL skills and extensive hands-on experience building modular models, snapshots, and custom schema tests in dbt.
  • Strong proficiency in writing clean, maintainable Python scripts for data manipulation, automation, and API integrations.
  • Practical experience utilizing PySpark for data transformation and basic performance tuning (e.g., handling joins, DataFrame API).
  • Functional understanding of Delta Lake or similar Lakehouse technologies, including ACID transactions and MERGE operations.
  • Superior troubleshooting skills with a methodical approach to identifying root causes and validating fixes.
  • Mandatory legal work authorization (Visa: Any) and availability for professional remote operations.
Nice-to-Have Skills
  • Professional advanced certifications such as Databricks Certified Data Engineer Professional or AWS Certified Data Analytics.
  • Prior professional working experience supporting Tier-1 global technology enterprises, financial institutions, or digital consulting firms.
  • Hands-on familiarity with containerization (Docker, Kubernetes), infrastructure as code (Terraform), and CI/CD pipelines (GitHub Actions, Jenkins).
  • Experience utilizing enterprise agile tracking and version control platforms (Jira, Confluence, Git/GitHub).
  • Active participation in data engineering user groups, Apache Spark meetups, or open-source data communities.
Application Information
  • Salary/Rate: Market Competitive / Enterprise Data Engineering Package (Visa: Any)
  • Work Schedule: Professional Remote Operations
  • Deadline: Open until filled (Urgent Remote Senior Data Engineer Opening)
  • Notice Period: Immediate to 30 Days Preferred
  • Contract Duration: 12-Month Contract Engagement
Recruitment Pro Tip

When applying for this Senior Data Engineer position with Qualis1, ensure your resume and project portfolio explicitly highlight your dbt modular modeling tenure, PySpark Lakehouse optimization case studies, and your direct, impact-driven troubleshooting approach.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Senior Data Engineer - Databricks, dbt, SQL, PySpark
Remote Senior Data Engineer - Databricks, dbt, SQL, PySpark

Qualis1 • United States

Remote
USD 120,000 - 180,000
Visa sponsorship
Senior Data Quality Engineer - Remote Work | REF#300671
Senior Data Quality Engineer - Remote Work | REF#300671

BairesDev • Palo Alto (CA)

Hybrid
MXN 1,676,000 - 2,235,000
100% remote
USD or local currency
Home office setup
+4
Senior Data Engineer (Databricks) - Contractor
Senior Data Engineer (Databricks) - Contractor

Job Envoy • United States

Remote
USD 140,000 - 190,000
Fully remote in US
6-month+ contract option
Flexible start date
+2
Data Engineer | Octagon IT | Remote (PST Zone)
Data Engineer | Octagon IT | Remote (PST Zone)

Octagon IT • United States

Remote
USD 110,000 - 160,000
Senior Data Engineer
Senior Data Engineer

Staff Hire, LLC • Mount Prospect (IL)

On-site
USD 120,000 - 180,000
Senior Data Engineer
Senior Data Engineer

Quantori, LLC • United States

Remote
USD 120,000 - 180,000
Competitive compensation
Continuous education, mentoring, and专业
Senior Data Engineer (Databricks) - Contractor
Senior Data Engineer (Databricks) - Contractor

Jobgether • United States

Remote
USD 96,000 - 165,000
Remote work
Contract 6 months
Extension possibility
Data Engineer Sr
Data Engineer Sr

Sequoia Connect • United States

Remote
USD 120,000 - 160,000
Sr. / Lead Data Quality Engineer
Sr. / Lead Data Quality Engineer

Pipe Recruit • Santa Monica (CA), Seattle (WA)

On-site
USD 120,000 - 160,000
Data Engineer
Data Engineer

Tential Solutions • Conroe (TX)

Hybrid
USD 120,000 - 180,000