Lead Data Engineer / Senior Data Engineer

Tachyon Technologies; Chicago (IL); On-site; USD 130,000 - 170,000; Full time

Job summary

Tachyon Technologies in Chicago, IL seeks a Lead Data Engineer / Senior Data Engineer to design, build, and operate enterprise-grade data platforms for Marketing Intelligence and Conversational BI. You will own data pipelines, analytics models, and AI-enabled insights using Databricks technology.

Ideal candidates have 7+ years in data engineering, 3+ years with Azure Databricks, and a track record delivering scalable analytics solutions for marketing domains.

Qualifications

• 7+ years of data engineering experience in cloud analytics.
• Hands-on Azure Databricks, PySpark, SQL, and Python.
• Experience with data platforms architecture and governance.
• Marketing analytics or digital marketing domain preferred.

Responsibilities

• Design, build, and support scalable data pipelines and data products.
• Implement ingestion, transformation, and orchestration using PySpark, SQL, Python, and ADF.
• Apply Medallion Architecture Bronze-Silver-Gold data layers.
• Develop semantic models and governed data products for analytics.
• Enable AI-ready data foundations and GenAI/conversational BI initiatives.
• Mentor junior engineers and participate in Agile ceremonies.

Skills

Data engineering

AI analytics

Mentoring

Tools

Azure Databricks

PySpark

SQL

Python

Azure Data Factory

Unity Catalog

Databricks Genie

Job description

We are seeking a highly skilled Lead Data Engineer / Senior Data Engineer with strong hands-on experience in Data Engineering, Azure Databricks, and AI-enabled analytics to design, develop, and support enterprise-scale Marketing Intelligence and Conversational BI solutions. The ideal candidate will be responsible for building scalable data platforms, developing data products, and enabling AI-driven analytics capabilities using modern Databricks technologies.

Responsibilities

• Design, develop, and maintain scalable data pipelines and data products using Azure Databricks and modern Data & AI engineering practices.
• Implement and optimize data ingestion, transformation, and orchestration frameworks using PySpark, SQL, Python, and Azure Data Factory.
• Build and manage curated data layers following Medallion Architecture (Bronze, Silver, Gold).
• Develop semantic models, business-ready datasets, and governed data products to support analytics and AI use cases.
• Implement and support Databricks Genie for conversational analytics and self-service business intelligence.
• Collaborate with architects, business analysts, and stakeholders to translate business requirements into scalable technical solutions.
• Integrate and model data from marketing platforms including Salesforce, Marketo, Google Ads, LinkedIn Ads, and Bing Ads.
• Ensure data quality, performance optimization, governance, and security using Unity Catalog and industry best practices.
• Support AI-powered analytics, GenAI, and conversational BI initiatives by enabling AI-ready data foundations.
• Mentor junior engineers, conduct code reviews, and promote engineering best practices across the team.
• Participate in Agile ceremonies, sprint planning, backlog refinement, and release activities.

Experience

• 7+ years of experience in Data Engineering and cloud-based analytics solutions.
• 3+ years of hands-on experience with Azure Databricks and modern data platforms.
• Experience delivering enterprise-scale data, analytics, or AI solutions.
• Experience in Marketing Analytics, Customer Analytics, or Digital Marketing domain is highly preferred.