Master Data Developer, Databricks

CI&T

United States

Remote

USD 120,000 - 160,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Premium Healthcare
Meal voucher
Maternity and Parental leaves
Mobile services subsidy
Sick pay-Life insurance
CI&T University
Colombian Holidays
Paid Vacations And many others.

Job summary

CI&T is seeking a Data Developer in the United States to design, build, and maintain scalable data pipelines and architectures that empower analytics and AI-driven decision making. You will work with Databricks, AWS data services, and modern data stack tools to deliver reliable data products, ensure data quality, and collaborate with analytics teams across the business.

This role emphasizes security, governance, and performance optimization, with opportunities to mentor colleagues and contribute

Qualifications

  • Experience designing and implementing scalable data architectures.
  • Proficiency with Databricks and cloud data services (AWS).
  • Strong SQL, Python/Java/Scala for data processing and orchestration.

Responsibilities

  • Data Pipeline Development: Build and optimize scalable ETL/ELT processes.
  • Data Architecture Implementation: design data lakes, warehouses, and integration layers.
  • Data Quality & Governance: implement checks, validation, and monitoring.
  • Integration & API Development: develop integrations between data sources and analytics platforms.
  • Collaboration: work with Data & Analytics teams to deliver data-driven solutions.
  • Performance Optimization: monitor and optimize pipeline performance and costs.
  • Documentation: maintain technical documentation for data systems.
  • Data Security: ensure data privacy compliance across systems.
  • Powered by AI: apply AI tools to enhance data workflows.

Skills

Data pipelines
ETL/ELT
Data quality
Data governance
API development
Databricks
SQL
Spark SQL
PySpark
Java
Python
Scala

Tools

Databricks
AWS
Glue
S3
DLT
Iceberg
Delta Lake
Airflow
Git

Job description

At CI&T, we help large enterprises transform the potential of AI into real business impact with AI Deployment, AI-native execution, and tech-integrated business solutions. With 30 years of experience in technological transformation, we accelerate innovation with expertise in Agentic SDLC, Application modernization, Data & AI, Martech and Business strategy. We are 8,000 CI&Ters across more than 25 countries, collaborating to build solutions with real impact. AI is already part of how we work, evolve, and innovate every day.

As CI&T grows, we seek a talented, motivated, and experienced Data Developer to join our team and build robust data-driven solutions for our customers. This role is pivotal in designing, developing, and maintaining scalable data infrastructure and pipelines that enable our data initiatives to thrive. The Data Developer will be responsible for implementing and optimizing data architectures, ensuring data quality and reliability, and collaborating closely with analytics and business teams to deliver high-performance data solutions. This position requires strong technical expertise in data engineering, cloud platforms, and modern data stack technologies, combined with the ability to translate business requirements into effective technical solutions.

Responsibilities:
  • Data Pipeline Development: Build, optimize, and maintain scalable data pipelines and ETL/ELT processes to support analytics and business intelligence needs.
  • Data Architecture Implementation: implement data architectures, including data lakes, warehouses, and integration layers that support the organization's data strategy and modernization.
  • Data Quality & Governance: Implement data quality checks, validation processes, and monitoring systems to ensure data accuracy, consistency, and reliability.
  • Integration & API Development: Develop and maintain integrations between various data sources, third-party tools, and analytics platforms.
  • Collaboration: Work closely with Data & Analytics Managers and business stakeholders to understand requirements and deliver technical solutions that enable data-driven decision making.
  • Performance Optimization: Monitor and optimize data pipeline performance, query efficiency, and storage costs to ensure scalable and cost-effective solutions.
  • Documentation: Create and maintain comprehensive technical documentation for data architectures, pipelines, and processes.
  • Data Security: Implement security best practices and ensure compliance with data privacy regulations across all data systems.
  • Powered by AI: Leverage AI tools and automation to enhance data engineering workflows and productivity.
Requirements:

Hands-on Databricks migration with the databricks/migrate tool (notebooks, jobs, clusters, secrets, ACLs), Unity catalog to Glue Catalog Notebook and job migration: notebooks, DAG pipelines, DLT pipelines Storage path refactoring: /mnt/ DBFS references to S3-backed locations Data migration execution: Deltalake format to Iceberg format on S3 (Delta tables, raw files), incremental sync Streaming: Auto Loader / DLT checkpoint re-bootstrap, event_id dedup Validation: row counts, checksums, sample queries, ETL runtime comparison Secrets: recreate secret scopes in AWS Secrets Manager AWS services: S3, Glue, Secrets Manager, IAM basics, Athena, LakeFormation and EMR Languages: Spark SQL, PySpark, Java, Python and Scala Agile pod delivery: daily ticket updates, standups, code review

Nice to Have:

Databricks Certified Consultant (Associate/Professional); DBR to EMR on AWS migration experience #LI-LO1

Our benefits include:
  • Premium Healthcare
  • Meal voucher
  • Maternity and Parental leaves
  • Mobile services subsidy
  • Sick pay-Life insurance
  • CI&T University
  • Colombian Holidays
  • Paid Vacations And many others.

Collaboration is our superpower, diversity unites us, and excellence is our standard. We value diverse identities and life experiences, fostering a diverse, inclusive, and safe work environment. We encourage applications from diverse and underrepresented groups to our job positions.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer - Databricks
Senior Data Engineer - Databricks

Remote • San Francisco (CA)

On-site
USD 140,000 - 190,000
Health and dental insurance
Meal and food allowance
Childcare assistance
+2
[Job-32192] Senior Data Engineer - Databricks
[Job-32192] Senior Data Engineer - Databricks

Ci&T • United States

Remote
BRL 180,000 - 330,000
Health insurance
Meal allowance
Life insurance
+6
Senior Data Developer, Colombia
Senior Data Developer, Colombia

Remote • San Francisco (CA)

Remote
USD 140,000 - 190,000
Maternity and Parental leaves
Mobile services subsidy
Sick pay-Life insurance
+3
[Job -31821] Master Data Architect (Databricks), Colombia
[Job -31821] Master Data Architect (Databricks), Colombia

CI&T • United States

Remote
USD 160,000 - 210,000
Premium Healthcare
Meal voucher
Maternity and Parental leaves
+5
DATA Tech Lead, Brazil
DATA Tech Lead, Brazil

Remote • San Francisco (CA)

Remote
USD 140,000 - 190,000
Health insurance
Wellness stipend
AWS Databricks Data Engineer
AWS Databricks Data Engineer

Cognizant • Norfolk (VA)

Remote
USD 83,000 - 95,000
Medical/Dental/Vision/Life Insurance
Paid holidays plus PTO
401(k) plan and contributions
+3
Data Engineer (Databricks)
Data Engineer (Databricks)

Cogent People Inc • Columbia (MD)

Hybrid
USD 120,000 - 180,000
Health insurance
401(k) Plan
Life Insurance & Disability Coverage
+1
Specialist Solutions Architect - Data Engineering
Specialist Solutions Architect - Data Engineering

Databricks Inc. • City of Amsterdam (NY)

Hybrid
USD 135,000 - 191,000
Senior Databricks Data Engineer
Senior Databricks Data Engineer

CGI Group, Inc. • Miami (FL)

Hybrid
USD 92,000 - 204,000
Competitive compensation
Comprehensive insurance options
401(k) match and share purchase plan
+3
Databricks Specialist
Databricks Specialist

Tata Consultancy Services Limited • New York (NY)

On-site
USD 130,000 - 150,000
Discretionary Annual Incentive
Comprehensive Medical Coverage
Parental Leaves
+3