Data Engineer

Recurring Decimal; New York (NY); On-site; USD 180,000 - 260,000; Full time

Job summary

Recurring Decimal seeks an accomplished Backend Architect to lead scalable Django-based systems and data pipelines for large-scale analytics. You will design and optimize RESTful APIs, ETL workflows, and cloud infrastructure using Azure services.

The role requires 10+ years in backend development with Django, strong Python and SQL/NoSQL skills, and proven experience with Azure Databricks, Delta Lake, and Delta tables.

Qualifications

• 10+ years of professional backend development experience with a heavy Django specialization.
• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Proven expertise in Azure Cloud, PySpark, Azure Databricks, Delta Lake, and Delta tables.
• Advanced Python, SQL/NoSQL databases, Git, and Agile methodologies.
• Strong ownership mindset, proactive problem-solving, excellent communication skills, and delivery focus.

Responsibilities

• Lead architecture and implementation of scalable, secure backend systems using Django.
• Build robust ETL pipelines and optimize data storage with Azure Databricks, Delta Lake, and Delta tables.
• Design secure, high-performance RESTful APIs and web services.
• Manage cloud infrastructure and deploy applications using Azure services.
• Oversee database management across SQL and NoSQL for speed and data quality.
• Collaborate with frontend, product managers, and stakeholders to deliver comprehensive solutions.

Skills

Django

Python

SQL/NoSQL

Git

Agile

Education

Bachelor's degree in Computer Science or related field

Tools

Azure Databricks

Delta Lake

Delta tables

PySpark

Azure Cloud

Job description

Builds, scales, and manages high-performance backend systems and data pipelines to process large volumes of data. Leads technical architecture, mentors engineering teams, and optimizes cloud storage and data solutions for advanced analysis.

Core Responsibilities

• Lead Backend Development: Drive the architecture and implementation of scalable, secure backend systems utilizing Django.
• Build Data Pipelines: Develop robust ETL pipelines, optimizing data storage solutions with Azure Databricks, Delta Lake, and Delta tables.
• Design Scalable APIs: Architect and implement secure, high-performance RESTful APIs and web services.
• Manage Cloud Infrastructure: Integrate and deploy applications seamlessly using Azure Cloud services.
• Optimize Performance: Oversee database management across SQL and NoSQL environments to ensure maximum speed and data quality.
• Collaborate Cross-Functionally: Partner with frontend developers, product managers, and stakeholders to deliver comprehensive technical solutions.

Required Qualifications & Skills

• Experience: 10+ years of professional backend development experience, with a heavy specialization in Django.
• Education: Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Cloud & Big Data: Proven expertise in Azure Cloud, PySpark, Azure Databricks, Delta Lake, and Delta tables.
• Technical Skills: Advanced Python, SQL/NoSQL databases, Git, and Agile methodologies.
• Core Competencies: Strong ownership mindset, proactive problem-solving, excellent communication skills, and a commitment to delivery.