Senior Data Engineer: AWS & Databricks for GenAI

Remodevs; United States; Remote; USD 150,000 - 190,000; Full time

Job summary

Dateonic is seeking a Senior Data Engineer to design, build, and optimise modern cloud-based data platforms powering analytics, AI, and data products. You will work on scalable pipelines, ingestion, and governance across AWS Databricks, with growing demand in GCP and Azure as project streams require.

You will collaborate with data scientists, ML engineers, and business stakeholders to shape requirements and surface better architectural solutions while embracing GenAI data pipelines and lakehouse

Qualifications

• Strong hands-on experience with Apache Spark, Delta Lake, and production-grade batch and streaming pipeline development.
• Advanced programming skills in Python and SQL with data modelling, quality, and governance knowledge.
• Proven Databricks Lakehouse Platform experience, preferably on AWS with S3/Glue/EMR/Redshift/Kinesis/Lambda.
• Deep cloud expertise in at least one major provider (AWS, GCP, or Azure/Fabric) with openness to multi-cloud work.
• Solid understanding of distributed systems and lakehouse architectures with performance tuning.
• Proactive, consultative mindset for cross-functional agile collaboration.

Responsibilities

• Design, implement, and optimise scalable data platforms for batch and streaming workloads using Spark/Delta Lake on AWS Databricks.
• Build ingestion, transformation, and curation workflows for structured and unstructured data.
• Support cloud-to-cloud migrations and re-platforming of legacy pipelines and schemas.
• Deliver production-grade, model-ready datasets for ML, GenAI, and analytics use cases.
• Design logical/physical data models and orchestrate workflows with Databricks, Airflow, dbt, or equivalents.
• Enforce data governance, lineage, quality, and access controls across platforms.
• Implement platform observability, data freshness monitoring, and cost-efficient operations.
• Collaborate with data scientists and business stakeholders to refine requirements and architectures.

Skills

Spark & Delta Lake

Python & SQL

Databricks Lakehouse on AWS

Multi-cloud (AWS/GCP/Azure)

Distributed systems & scalability

Collaborative, cross-functional skills

Tools

Databricks

Airflow

dbt

Terraform / CloudFormation

Job description

Dateonic is seeking a Senior Data Engineer to design, build, and optimise modern cloud-based data platforms powering analytics, AI, and data products. You will work on scalable pipelines, ingestion, and governance across AWS Databricks, with growing demand in GCP and Azure as project streams require.

You will collaborate with data scientists, ML engineers, and business stakeholders to shape requirements and surface better architectural solutions while embracing GenAI data pipelines and lakehouse