Sr. Manager, Data Engineering

Trade Station Group, Inc.; Plantation, Northern (FL, KY); Hybrid; USD 168,000 - 187,000; Full time

Benefits offered by this job

Collaborative work environment

Day 1 comprehensive benefits

Flexible working environment

Access to trading education materials

Job summary

TradeStation Group, Inc. seeks a Senior Manager of Data Engineering to lead the data team and own end-to-end Databricks infrastructure. You will design robust data pipelines, implement AI capabilities, and partner with product and business teams to align the data roadmap with strategic goals.

The role emphasizes leadership, security, and scalable data solutions, leveraging Databricks and cloud platforms to enable data-driven decision making across the organization.

Qualifications

• Bachelor's degree in computer science/engineering or equivalent work experience.
• Minimum 5+ years in technology with data engineering leadership.
• Experience with Databricks, Delta Lake, MLflow and AI workflows.
• Strong data governance, security and compliance knowledge.

Responsibilities

• Lead and mentor a team of data engineers to deliver high-quality work.
• Define and own the data roadmap aligning with business needs.
• Architect scalable data pipelines and Databricks-based infrastructure.
• Implement Databricks AI capabilities and Genie apps for self-service analytics.
• Collaborate with data scientists, analysts and product teams.
• Manage projects, ensure timely delivery and establish success metrics.

Skills

Databricks

Leadership

Data governance

Python/SQL

Cloud platforms

ETL pipelines

Data warehousing

Communication

Education

Bachelor's degree in CS/Engineering or equivalent

Tools

Databricks

Delta Lake

MLflow

SQL

Python

Cloud platforms (AWS/Azure/GCP)

Job description

Remote Position - must reside Florida, Texas, Illinois, New York, New Jersey, Alabama, Arizona, Arkansas, Colorado, Connecticut, Delaware, Georgia, Indiana, Kansas, Massachusetts, Missouri, North Carolina, Tennessee, Utah or Wisconsin

Who We Are:

TradeStation is the home of those born to trade. As an online brokerage firm and trading ecosystem, we are focused on delivering the ultimate trading experience for active traders and institutions. We continuously push the boundaries of what's possible, encourage out-of-the-box thinking, and relentlessly search for like-minded innovators.

At TradeStation, we are building an AI-First culture. We expect team members to embrace AI as a core part of their daily workflow, whether that's using AI to accelerate development, enhance decision-making, improve client outcomes, or streamline internal processes. We hire, grow, and promote people who can harness AI responsibly and creatively. We treat AI as a partner in problem-solving, not just a tool; following our governance standards to ensure AI is used ethically, securely, and transparently. If you join us, you're joining a culture where AI is how we work.

Are you ready to make yourself at home?

What We Are Looking For:

We are looking for a Senior Manager of Data Engineering who will play a pivotal role in our organization, leading the Data Engineering team and ensuring the secure, efficient, and seamless handling of our organization's data assets. With Databricks as our primary SaaS platform, this role owns and manages our end-to-end Databricks environment and will focus on designing and implementing robust data infrastructure including Databricks AI capabilities and AI/BI Genie apps to support business operations, analytics, and innovation. Partnering closely with business and product management, the Senior Manager will help define and drive both the technical and business data roadmap. The successful candidate will possess strong leadership skills, deep knowledge of data and AI infrastructure, and a drive to enhance the data-driven nature of our business. This position combines technical expertise with strategic oversight, enabling the team to deliver scalable, high-performing data solutions aligned with organizational goals.

Bring your passion and skills to solve interesting problems and have an immediate impact. Join us!

What You'll Be Doing:

Leadership & Team Management:

• Manage, mentor, and inspire a team of skilled data engineers to deliver high-quality work
• Provide direction, performance feedback, and career development opportunities
• Foster a culture of collaboration, innovation, and continuous learning
• Manage the design and implementation of scalable and efficient data pipelines on Databricks
• Define and implement data architecture to support both batch and real-time data processing
• Leverage Databricks features (e.g., Delta Lake, Databricks SQL, MLflow) to optimize infrastructure for performance and cost
• Own, administer, and continuously optimize the end-to-end Databricks environment, including workspace administration, cluster and compute management, Unity Catalog governance, and cost/performance monitoring
• Build and operationalize Databricks AI capabilities (Mosaic AI, model serving, and generative AI/agent workflows) to power intelligent, data-driven products
• Design, deploy, and maintain AI/BI Genie spaces and Genie-powered apps that enable business users to explore data and get answers through natural-language conversation

Secure and Efficient Data Handling:

• Implement and maintain data governance frameworks to ensure data integrity, security, and compliance
• Collaboration and Business Impact:
• Partner with data scientists, analysts, and business teams to enable data-driven decision-making
• Work closely with business and product management to define, prioritize, and own both the technical and business data roadmap, aligning platform investments with organizational strategy
• Translate business needs into technical requirements and scalable data solutions
• Communicate technical plans, challenges, and achievements to stakeholders at all levels

Project Management:

• Prioritize and manage multiple data engineering projects, ensuring timely delivery
• Define success metrics and continuously track progress to achieve desired outcomes
• Stay informed on industry trends, particularly advancements in Databricks, Databricks AI (Mosaic AI, AI/BI Genie), generative AI, and cloud-based data platforms.
• Establish and enforce best practices for coding, testing, and deploying data engineering solutions

The Skills You Bring:

• Proven experience running projects and managing direct reports
• Knowledge of data governance practices, business and technology issues related to managing enterprise information assets, and approaches related to data protection
• Knowledge of industry-leading data quality and data protection management practices
• Strong analytical, technical, oral, and written communication skills
• Strong knowledge of database design, data warehousing, and ETL processes
• Ability to present projects to technical and non-technical staff
• Team player who can work flexible hours
• Expertise in Databricks and its ecosystem (Delta Lake, Spark, Databricks SQL, MLflow, etc.).
• Hands-on experience with Databricks AI, including Mosaic AI, model serving, and generative AI/agent solutions.
• Experience building and deploying AI/BI Genie spaces and Genie apps to deliver natural-language, self-service analytics to business users.
• Experience administering and managing a Databricks environment, including workspace/cluster management, Unity Catalog, security, and cost governance.
• Proficiency in programming languages such as Python, Scala, or SQL
• Experience with cloud platforms (AWS, Azure, or GCP) and associated data services
• Strong understanding of ETL processes, data pipelines, and real-time data streaming
• Knowledge of data modeling, database design (relational and non-relational), and optimization techniques
• Comfortable with writing scripts and using command-line interfaces preferred
• Knowledge of full-stack monitoring concepts and tooling from code to system resources preferred
• Programming Skills – knowledge of statistical programming languages like R, and Python and database query languages like SQL preferred
• Data Wrangling – proficiency in handling imperfections in data preferred
• Strong software engineering background preferred
• Experience in Databricks AI capabilities and AI/BI Genie solutions into a production environment preferred
• Prior experience owning a data platform roadmap in partnership with product management in a financial services or brokerage environment preferred

Minimum Qualifications:

• Bachelor's degree in computer science/Engineering or equivalent work experience
• Must have 5+ years of technology industry experience

Desired Qualifications:

• Databricks certification(s), such as Databricks Certified Data Engineer Professional or a Databricks Generative AI / Machine Learning certification
• 7+ years of technology industry experience with prior people-management experience leading a data engineering team

Benefits at TradeStation

• Collaborative work environment
• Comprehensive benefits for you and your family starting Day 1
• Flexible working environment
• TradeStation Account employee benefits, as well as full access to trading education materials
• Pay Range (US) $168-187K (Countries outside of the US have differing ranges in accordance with local labor markets)

TradeStation provides equal employment opportunities to current and prospective employees, without regard to race, color, religion, sex, national origin, ancestry, sexual orientation, age, pregnancy, disability, handicap, citizenship, veteran or marital status, or any other legally recognized status entitled to protection under federal, state, or local anti-discrimination laws.

Benefits at TradeStation

• Collaborative work environment
• Comprehensive benefits for you and your family starting Day 1
• Flexible working environment
• TradeStation Account employee benefits, as well as full access to trading education materials
• Pay Range (US) $168-187K (Countries outside of the US have differing ranges in accordance with local labor markets)