Senior Data Engineer: AI-Driven Data Pipelines

DataJobs; Orlando (FL); On-site; USD 110,000 - 160,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

401(k) with company match

Short-term disability

Life insurance with AD&D

Job summary

Software Resources, Inc. in Orlando, FL is seeking a Senior Data Engineer for an onsite contract role focused on B2B AI and data products enablement. You will design scalable data pipelines and enterprise datasets powering dashboards, analytics, and AI initiatives.

We expect 7+ years in data engineering, strong SQL and Python, and hands-on experience with Snowflake/AWS/Azure, ETL/ELT, and AI-ready architectures including RAG and vector search. Collaboration with stakeholders is essential.

Qualifications

• 7+ years of experience in data engineering, data architecture, or enterprise data platform development.
• Proven experience designing and supporting enterprise data pipelines and data warehouse / Lakehouse solutions.
• Strong expertise in SQL and Python.
• Experience with cloud data platforms (Snowflake, AWS, Azure) and hybrid data integration patterns.
• Hands-on experience with ETL/ELT orchestration tools and data pipeline automation.
• Strong understanding of data modeling, semantic layer design, and performance optimization techniques.
• Experience developing solutions supporting generative AI, LLMs, AI assistants, copilots, or conversational AI applications.
• Experience designing data architectures for RAG and semantic search solutions.
• Familiarity with vector databases, embeddings, semantic indexing, and knowledge retrieval architectures.
• Experience integrating structured and unstructured enterprise data sources for AI-driven applications.
• Strong understanding of AI governance, prompt engineering concepts, model evaluation, and responsible AI practices.
• Experience with modern AI frameworks and services including Claude, Cursor, Snowflake Cortex AI, Databricks Mosaic AI, Amazon Bedrock, or equivalent technologies.
• Experience implementing metadata-driven architectures that improve data discoverability and AI consumption.
• Experience supporting BI and analytics platforms such as Power BI, Tableau, or similar tools.
• Familiarity with data governance, metadata management, and data quality frameworks.
• Ability to collaborate effectively across product teams, engineering disciplines, and business stakeholders.
• Strong analytical thinking, problem-solving capability, and communication skills

Responsibilities

• Design, build, and optimize scalable data pipelines and integration frameworks within the existing DXT ecosystem in line with DXT data standards
• Support multiple B2B data products and source systems, plus enterprise reporting requirements
• Architect and implement ingestion, transformation, and storage patterns across cloud and hybrid data environments
• Define reusable data engineering standards and best practices for consistent, scalable delivery across product domains
• Create curated enterprise datasets that act as trusted sources for dashboards, analytics, and AI initiatives
• Design data architectures that enable enterprise AI applications, conversational agents, and intelligent self-service experiences
• Develop and optimize datasets, metadata structures, semantic layers, and knowledge repositories for natural language access to enterprise information
• Build and maintain Retrieval-Augmented Generation (RAG) frameworks and semantic search capabilities for AI-powered data discovery
• Engineer solutions integrating structured and unstructured data into AI-ready environments
• Partner with business stakeholders to convert data accessibility challenges into AI-enabled solutions
• Enable enterprise users to understand and consume trusted data assets through conversational and self-service interfaces
• Design and implement vectorized data architectures and embedding strategies for LLM-based applications
• Collaborate with AI and analytics teams to operationalize AI-driven use cases while maintaining governance, security, and compliance standards
• Evaluate emerging AI technologies and recommend approaches that improve enterprise data accessibility, usability, and business value
• Design and implement scalable AI-ready data pipelines for machine learning, generative AI, predictive analytics, intelligent automation, and agentic AI solutions
• Create data products optimized for LLM consumption, semantic search, AI-assisted analytics, and natural language querying
• Develop reusable frameworks for AI model training, inference, orchestration, monitoring, and lifecycle management
• Integrate cloud AI services, large language models, vector databases, and enterprise knowledge platforms into the data ecosystem
• Enable real-time and event-driven data architectures that support AI-powered decision making
• Design and maintain data layers for executive dashboards, operational KPIs, and enterprise reporting
• Ensure data quality, lineage, and performance standards for datasets used by BI platforms, AI tools, and downstream analytics
• Collaborate with analytics teams to optimize data structures for AI enablement, visualization, self-service analytics, and advanced modeling
• Implement data validation, monitoring, and observability processes to support reliable and trusted data delivery
• Maintain documentation, metadata standards, and data definitions to support enterprise governance and compliance requirements
• Identify opportunities to improve pipeline performance, data usability, and architectural efficiency
• Support modernization initiatives such as cloud data platform expansion, automation, and AI readiness
• Evaluate and implement modern technologies that improve data scalability, resilience, and time-to-insight
• Contribute to evolving enterprise data strategy and operating model maturity

Skills

Analytical thinking

Problem-solving

Communication skills

Collaboration across teams

Tools

SQL

Python

Snowflake

AWS

Azure

ETL/ELT

RAG

Vector databases

Tableau

Power BI

Job description

Software Resources, Inc. in Orlando, FL is seeking a Senior Data Engineer for an onsite contract role focused on B2B AI and data products enablement. You will design scalable data pipelines and enterprise datasets powering dashboards, analytics, and AI initiatives.

We expect 7+ years in data engineering, strong SQL and Python, and hands-on experience with Snowflake/AWS/Azure, ETL/ELT, and AI-ready architectures including RAG and vector search. Collaboration with stakeholders is essential.