Senior Data Engineer (US only)

Nimble Gravity, LLC; United States; On-site; USD 120,000 - 160,000; Full time

Job summary

Nimble Gravity, LLC seeks a Senior Cloud Data Engineer to lead cloud-based data solutions, design robust pipelines, and ensure data reliability. You will mentor a team, collaborate with architects, and stay ahead of cloud data engineering trends.

Ideal candidates bring 5+ years in data engineering, strong Azure, and expertise in Spark, ETL/ELT, and data warehousing. Equal opportunity employer with a focus on growth.

Qualifications

• Bachelor's or Master's degree in CS/Engineering or related field.
• 5+ years of data engineering experience focusing on cloud-based solutions.
• Strong Azure expertise with hands-on services.
• Experience with Azure data platforms: Databricks, SQL DB, Synapse.
• Spark programming: Python, PySpark, SparkSQL.
• Orchestration/Automation: Data Factory and Logic Apps.
• Storage: Azure Data Storage Gen2; Event processing with Kafka and Event Hubs.
• Data modeling, ETL/ELT, and data warehousing concepts.
• SQL/NoSQL databases; Apache Spark processing.

Responsibilities

• Design end-to-end data pipelines that collect, process, transform, and load data into the cloud.
• Collaborate with architects to ensure scalable, reliable pipelines.
• Develop data transformation logic for analytics and reporting.
• Build and optimize ETL processes ensuring data quality and integrity.
• Collaborate with stakeholders to deliver actionable insights.
• Lead a team of data engineers with mentorship and guidance.
• Stay current with cloud technologies and data engineering practices.

Skills

5+ years experience as Data Engineer

Leadership

Problem-solving

Mentoring junior teammates

Data modeling

ETL/ELT

Data warehousing concepts

SQL

Education

Bachelor's or Master's degree in Computer Science or Engineering

Tools

Azure Databricks

Azure SQL Database

Azure Synapse Analytics

Python

PySpark

SparkSQL

Azure Data Factory

Logic Apps

Azure Data Storage Gen2

Kafka

Azure Event Hubs

Apache Spark

Job description

Job Description: Senior Cloud Data Engineer

Position Overview

We are seeking an experienced and innovative Senior Cloud Data Engineer to lead our clients in the design, development, and maintenance of cloud-based data solutions. As a key member of our data engineering team, you will be responsible for designing and developing robust data pipelines, optimizing data workflows, and ensuring the availability and reliability of our client’s cloud data platform.

Key Responsibilities

• Design end-to-end data pipelines that efficiently collect, process, transform, and load data from various sources into our cloud environment.
• Collaborate with data architects and other stakeholders to ensure the scalability, reliability, and performance of data pipelines.
• Develop complex data transformation logic to prepare raw data for analysis and reporting purposes.
• Build and optimize Extract, Transform, Load (ETL) processes to ensure data quality and integrity.
• Collaborate with client stakeholders to understand data requirements and deliver actionable insights.
• Lead a team of data engineers, providing technical guidance, mentorship, and fostering a culture of innovation and collaboration.
• Stay current with the latest advancements in cloud technologies and data engineering practices.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or related field.
• Proven experience (5+ years) as a Data Engineer, with a focus on cloud-based solutions.
• Strong expertise in Microsoft Azure, including hands-on experience with relevant services.
• Data Platforms (Azure Databricks, Azure SQL Database and Azure Synapse Analytics)
• Spark Programming (Python, PySpark and SparkSQL)
• Orchestration and Automation (Azure Data Factory and Logic Apps)
• Storage (Azure Data Storage Gen2)
• Event Processing (Kafka and Azure Event Hubs)
• Proficiency in data modeling, ETL/ELT processes, and data warehousing concepts.
• Knowledge of SQL and NoSQL databases, along with data processing frameworks (e.g., Apache Spark).
• Excellent problem-solving skills and the ability to troubleshoot complex data engineering issues.
• Strong leadership skills, with the ability to guide and mentor junior team members.
• Relevant Microsoft Azure data certifications are a plus.

About Nimble Gravity

Nimble Gravity is a team of outdoor enthusiasts, adrenaline seekers, and experienced growth hackers. We love solving hard problems and believe the right data can transform and propel growth for any organization.

Nimble Gravity is an Equal Opportunity Employer and considers applicants for employment without regard to race, color, religion, sex, orientation, national origin, age, disability, genetics or any other basis forbidden under federal, state, or local law. Nimble Gravity considers all qualified applicants.

We do not sponsor H1B visas.