Databricks Engineer

Concentrix CVG Customer Management Group Inc.; Texas; Hybrid; USD 92,000 - 120,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

Comprehensive employee assistance

401(k) retirement plan

Paid time off and holidays

Paid learning days

Job summary

Concentrix CVG Corporation is seeking a Databricks Engineer to design and maintain data pipelines on Databricks across Azure, AWS, or GCP. You will leverage Python, PySpark, SQL, and Delta Lake to deliver robust ingestion, transformation, and modeling capabilities, collaborating with senior engineers to own end-to-end pipeline delivery.

You will work with cross-functional teams to meet performance goals, implement data quality checks, and participate in code reviews, CI/CD, and governance

Qualifications

• 6+ years of professional experience in data engineering, data & analytics or data warehousing.
• 3+ years of hands-on experience with Databricks in a data engineering capacity.
• 3+ years of experience with Python, PySpark DataFrames, Spark SQL, or pandas API on Spark.
• 2+ years of data engineering on Microsoft Azure (ADLS Gen2, Azure Data Factory, Key Vault).

Responsibilities

• Build and maintain batch and streaming data pipelines for ETL/ELT into the Databricks lakehouse on Azure.
• Implement data ingestion using Auto Loader, Lakeflow Connect, and Azure Data Factory.
• Develop pipelines with Lakeflow Spark Declarative Pipelines, including data quality expectations.
• Write PySpark and Spark SQL transformations to prepare data for analytics and reporting.
• Configure, schedule, and monitor data workflows with Lakeflow Jobs and Databricks Workflows.
• Apply medallion architecture and Unity Catalog permissions to data assets.
• Write unit tests and deploy pipelines with CI/CD using Git folders and Declarative Automation Bundles.
• Monitor, troubleshoot, and resolve pipeline failures and data quality issues in production.
• Collaborate with cross-functional teams to ensure data solutions meet business requirements.

Skills

Databricks

Python

Spark SQL

SQL

Azure

Git

CI/CD

Pandas API

Tools

Delta Lake

Unity Catalog

Lakeflow

Azure Data Factory

ADLS Gen2

Databricks SQL

Job description

Job Title: Databricks Engineer

We're Concentrix. The intelligent transformation partner. Solution-focused. Tech-powered. Intelligence-fueled. The global technology and services leader that powers the world’s best brands, today and into the future. We’re solution-focused, tech-powered, intelligence-fueled. With unique data and insights, deep industry expertise, and advanced technology solutions, we’re the intelligent transformation partner that powers a world that works, helping companies become refreshingly simple to work, interact, and transact with. We shape new game-changing careers in over 70 countries, attracting the best talent. The Concentrix Technical Products and Services team is the driving force behind Concentrix’s transformation, data, and technology services. We integrate world-class digital engineering, creativity, and a deep understanding of human behavior to find and unlock value through tech-powered and intelligence-fueled experiences. We combine human-centered design, powerful data, and strong tech to accelerate transformation at scale. You will be surrounded by the best in the world providing market leading technology and insights to modernize and simplify the customer experience. Within our professional services team, you will deliver strategic consulting, design, advisory services, market research, and contact center analytics that deliver insights to improve outcomes and value for our clients. Hence achieving our vision. Our gamechangers around the world have devoted their careers to ensuring every relationship is exceptional. And we’re proud to be recognized with awards such as "World's Best Workplaces," “Best Companies for Career Growth,” and “Best Company Culture,” year after year. Join us and be part of this journey towards greater opportunities and brighter futures.

Location: Remote in USA. Working hours in EST.

Role Summary The Data Engineer is responsible for building, maintaining, and supporting data solutions on the Databricks Data Intelligence Platform running on Microsoft Azure, AWS or GCP. The role leverages Databricks, Python, PySpark, and SQL to deliver data ingestion, transformation, modeling, and pipeline orchestration. Working within the standards and designs set with the Senior Data Engineer, this role independently owns the delivery of assigned pipelines from development through production support.

Responsibilities

• Build and maintain batch and streaming data pipelines for extracting, transforming, and loading (ETL/ELT) data from multiple sources into the Databricks lakehouse on Azure.
• Implement data ingestion using Auto Loader, Lakeflow Connect, and Azure Data Factory.
• Develop pipelines with Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables), including data quality expectations.
• Perform data manipulation and transformation using PySpark and Spark SQL, ensuring data is prepared for analytics and reporting.
• Configure, schedule, and monitor data workflows with Lakeflow Jobs (formerly Databricks Workflows).
• Implement data models within the lakehouse following medallion architecture (bronze/silver/gold) and team modeling standards.
• Apply Unity Catalog permissions and governance standards to the data assets you build.
• Write unit and data quality tests and deploy pipelines through CI/CD using Git folders and Declarative Automation Bundles (formerly Databricks Asset Bundles).
• Monitor, troubleshoot, and resolve pipeline failures and data quality issues in production.
• Participate in code reviews and contribute to team documentation and engineering standards.
• Collaborate with cross-functional teams, including business stakeholders and IT, to ensure data solutions meet business and performance requirements aligned to project goals.

Required Qualifications

• 6+ years of professional experience in data engineering, data & analytics or data warehousing.
• 3+ years of hands‑on experience working with Databricks in a data engineering capacity.
• 3+ years of experience with Python, including manipulating large datasets using PySpark DataFrames, Spark SQL, and/or the pandas API on Spark.
• 2+ years of data engineering experience on Microsoft Azure (e.g., ADLS Gen2, Azure Data Factory, Key Vault).

Skills and Knowledge

• Proficiency in Python programming for data engineering tasks.
• Strong knowledge of SQL for data modeling, transformation, and querying.
• Working knowledge of Delta Lake fundamentals (e.g., MERGE, schema evolution, time travel).
• Working knowledge of Unity Catalog concepts, including catalogs, schemas, and permissions.
• Experience with Git-based version control and familiarity with CI/CD practices for data pipelines.
• Understanding of testing and deployment strategies for data pipelines, including productionizing ETL pipelines and Databricks SQL queries.

Preferred Qualifications

• Experience implementing streaming data ingestion in Databricks (Structured Streaming, Auto Loader, Event Hubs).
• Experience with healthcare data (e.g., claims, EHR/clinical data, HL7/FHIR) and HIPAA/PHI handling.
• Exposure to Spark and Delta Lake performance tuning and compute cost optimization.
• Familiarity with dimensional modeling and SCD Type 1 and Type 2 patterns.
• Experience enabling BI consumption through Databricks SQL warehouses and tools such as Power BI.

The base salary for this position is $92,250 to $120,000 plus incentives that align with individual and company performance. Actual salaries will vary based on work location, qualifications, skills, education, experience, and competencies.

Benefits

• medical, dental, and vision insurance
• comprehensive employee assistance program
• 401(k) retirement plan
• paid time off and holidays
• paid learning days

Equal Employment Opportunity: Concentrix is an equal opportunity and affirmative action (EEO-AA) employer. We promote equal opportunity to all qualified individuals and do not discriminate in any phase of the employment process based on race, color, religion, sex, sexual orientation, gender identity, national origin, age, pregnancy or related condition, disability, status as a protected veteran, or any other basis protected by law. For more information regarding your EEO rights as an applicant, please visit the following websites: English Spanish

Accommodation: Concentrix welcomes and encourages applications from candidates with disabilities and is committed to providing an inclusive recruitment process. If you require reasonable accommodation to participate in any stage of the application or interview process, please let us know. Requests may be made by contacting [e-mail]. All information will be treated confidentially and used solely to facilitate your participation in the recruitment process.

Artificial Intelligence: As part of our recruitment process, we may use artificial intelligence (AI) tools to assist in the screening and/or assessment of job applicants. These tools could be used to evaluate resumes, applications, and other materials submitted to help us identify the best candidates for the role.

Work Authorization: In accordance with federal law, only applicants who are legally authorized to work in the United States will be considered for this position. Must reside in the United States or have a valid U.S. address for residence. For further information on available work states and Equal Employment Opportunity as an applicant.

Mission: Hi, we're Concentrix. We’re a global technology and services leader that powers the brands of the future. We help well-known brands — the ones you use every day — improve their businesses with technology and integrated solutions, in over 70 countries. Company Overview: We power the brands of the future. Some call us a global technology and services leader. But we’re so much more. Human-centered, tech-powered, intelligence fuelled. Every day we’re busy helping over 2000 of the world's best brands solve their toughest business challenges. Whether it’s…… designing game-changing brand experiences, building and scaling secure AI technologies, or building loyalty to drive revenue. We’ve got them covered. But how? We design, build, and run fully integrated, end-to-end solutions across the entire enterprise, at speed and scale. We’re the strategic thinkers who designbrand‑defining experiences. The technologists & engineers who buildsmarter solutions. And the operational experts who run it all and make it work seamlessly. By integrating strategy & design with data & analytics, enterprise technology, and digital operations. You could say, at the heart of everything we do lies a commitment to transform the way companies connect, interact, and grow across the world and into the future. Experience the power of Concentrix. Concentrix CVG Corporation is an EEO/AA/M/F/Vet/Disability Employer.