Senior Databricks Engineer - Cloud Data Platform & ETL

Intone Inc; Pennsylvania; Presencial; USD 120 000 - 180 000; Tempo integral

Resumo da oferta

Intone Inc. seeks a Senior Databricks Engineer for a contract role based in Malvern, Pennsylvania. The position requires 5–7+ years in enterprise data engineering and deep expertise with Databricks, Apache Spark, PySpark, Python, and SQL to design scalable data platforms.

The role involves building end-to-end ETL/ELT pipelines, implementing CI/CD, and collaborating with stakeholders in an Agile environment. Contract duration: minimum six months.

Qualificações

• Bachelor's degree in Computer Science, Engineering, Information Systems, or related discipline
• 5–7+ years of enterprise Data Engineering experience
• Strong Python development experience
• Advanced SQL programming skills
• Extensive experience with Apache Spark and PySpark
• Strong experience with Databricks application
• Hands-on experience with AWS data services including S3, AWS Glue, Athena, Lambda, Step Functions, and EventBridge
• Experience building enterprise ETL and ELT pipelines
• Strong understanding of distributed data processing
• Experience working with large-scale cloud data platforms
• Strong knowledge of dimensional data modeling
• Experience implementing CI/CD pipelines
• Familiarity with Agile/Scrum methodologies
• Excellent communication and stakeholder management skills

Responsabilidades

• Design and build enterprise ETL and ELT pipelines using Databricks and related cloud technologies
• Develop and optimize data processing solutions using Apache Spark and PySpark
• Architect and implement large-scale cloud data platform solutions
• Write and maintain Python and SQL code for data engineering workflows
• Implement CI/CD pipelines for data engineering applications
• Apply dimensional data modeling principles to support analytics and reporting
• Collaborate with stakeholders to gather requirements and communicate technical solutions
• Participate in Agile/Scrum development processes

Conhecimentos

Python development

SQL

Databricks

Apache Spark

PySpark

AWS data services

ETL/ELT pipelines

Dimensional data modeling

CI/CD

Agile/Scrum

Stakeholder management

Communication

Formação académica

Bachelor's degree in Computer Science/Engineering/IS

Ferramentas

Databricks

Apache Spark

PySpark

AWS (S3, Glue, Athena, Lambda, Step Functions, EventBridge)

Descrição da oferta de emprego

Intone Inc. seeks a Senior Databricks Engineer for a contract role based in Malvern, Pennsylvania. The position requires 5–7+ years in enterprise data engineering and deep expertise with Databricks, Apache Spark, PySpark, Python, and SQL to design scalable data platforms.

The role involves building end-to-end ETL/ELT pipelines, implementing CI/CD, and collaborating with stakeholders in an Agile environment. Contract duration: minimum six months.