Senior Data Engineer (6-month contract)

gravity9; United States; À distance; USD 140 000 - 190 000; Plein temps

Résumé du poste

gravity9 is seeking a Senior Data Engineer to join our Digital Practice client team. You will build robust data platforms and AI-enabled solutions on Microsoft Azure, delivering data pipelines, governance, and scalable architectures in an agile environment.

You will mentor teammates, drive end-to-end data solutions, and communicate progress to stakeholders while staying ahead of technology trends. A strong background in data engineering and Azure services is essential.

Qualifications

• 7+ years of data engineering or software development experience.
• Hands-on with Azure Databricks or Spark for 3+ years and mentoring junior team members.
• Proficiency in Python, PySpark, and SQL; strong data modelling skills.
• Experience with secure CI/CD and infrastructure-as-code.

Responsabilités

• Deliver data solutions in Agile teams with clear acceptance criteria.
• Design, build and operate ingestion and orchestration pipelines in Azure Data Factory.
• Develop ETL/ELT using Azure Databricks for analytics, reporting and AI.
• Lead code reviews and set engineering standards; help with planning and testing.
• Shape data architectures, semantic models, and data serving AI agents.
• Apply data governance, security and residency-compliant access controls.
• Communicate progress and risks to stakeholders and management.
• Stay current with relevant data tech developments.

Connaissances

Python/PySpark

SQL

Data modelling

Mentoring

Agile delivery

Data quality

Formation

Bachelor’s degree in CS/Engineering or related field

Outils

Azure Data Factory

Azure Databricks

Delta Lake

Unity Catalog

Workflows

Azure Data Lake Storage

Azure SQL

APIs/OData/JDBC/ODBC

Azure OpenAI / Azure AI Foundry

Terraform

Bicep

Databricks Asset Bundles

Azure DevOps or GitHub

Description du poste

gravity9 is a boutique IT consulting company headquartered in the UK with offices in the US, Canada, and Poland. Our team has deep experience in engineering, experience design and product management. We enjoy a challenge and pride ourselves on working with our clients on their most complex problems, finding elegant and flexible solutions that help them transform their businesses.

Role Description

We are seeking a highly motivated Senior Data Engineer to join our client's Product Development team within their Digital Practice. In this role, you will play a key part in client digital transformation journeys by delivering solutions that support decision-making, autonomous execution, and integrated operations. You will focus on productizing deep subject-matter expertise through robust data platforms and AI-enabled solutions built on Microsoft Azure. Operating within a flat, connected organization that values innovation and an entrepreneurial mindset, you will challenge existing ideas to take business outcomes to higher levels. The ideal candidate is a confident, passionate, and outcome-oriented leader with exceptional communication skills who excels at setting direction, mentoring team members, and leading directly by doing.

• Work in Agile teams to deliver the committed backlog against acceptance criteria
• Design, build and operate ingestion and orchestration pipelines in Azure Data Factory
• Develop ETL/ELT in Azure Databricks using a medallion architecture to deliver trusted data for analytics, reporting and AI
• Lead code reviews and set engineering standards; take part in estimating, planning, testing, deployments and documentation
• Shape data architecture decisions, including metric definitions, semantic models and data that serves AI agents
• Apply data governance, security and access controls in line with client classification and residency requirements
• Use AI-assisted development tools responsibly to accelerate delivery without compromising quality or security
• Communicate progress, open items and issues to stakeholders, including management
• Stay abreast of relevant technology developments

Experience:

• 7+ years’ experience in data engineering or software development, including 3+ years hands-on with Azure Databricks or Spark and actively mentoring junior team members. Proven capabilities in:
  • Python and PySpark (expert level) and SQL
  • Azure Data Factory, Azure Databricks (Delta Lake, Workflows, Unity Catalog), Azure Data Lake Storage and Azure SQL
  • Data modelling (dimensional and lakehouse) and integration via APIs, OData, JDBC/ODBC and files
  • Azure AI services (e.g. Azure AI Foundry, Azure OpenAI) and preparing data for AI agents
• Secure CI/CD and infrastructure-as-code (e.g. Terraform, Bicep, Databricks Asset Bundles) across DEV, UAT and PROD using Azure DevOps or GitHub, with sound Git branching practices
• AI-assisted development, with sound judgement in reviewing generated code
• Data quality, testing, security and privacy in regulated or restricted-data environments
• Designing end-to-end data solutions and recommending new frameworks and technologies
• Agile and Kanban delivery in mixed-discipline teams, building consensus across subject matter experts, engineers, data scientists and designers
• A self-starter who is organized and needs minimal supervision
• Bachelor’s degree in computer science, Engineering or a related field, or equivalent education and experience

Nice to have:

• Experience in integrating enterprise systems (e.g. ERP, project management or document management platforms)
• Data management and governance concepts (e.g. data quality, cataloguing, lineage, master data, stewardship) using any supporting toolset