Data Platform Engineer

First Orion; North Little Rock (AR); On-site; USD 120,000 - 170,000; Full time

Benefits offered by this job

Flexible work arrangements

Health and dental/vision options

Generous PTO

Job summary

First Orion is seeking a Data Platform Engineer to implement and operate a robust Databricks platform on AWS. You will build Terraform modules, manage Unity Catalog governance, and develop data pipelines using Python, SQL, and Spark.

You will partner with the Data Platform Architect to validate designs, ensure production readiness, and optimize security, cost, and performance across environments. This role emphasizes collaboration and reliable, scalable data solutions.

Qualifications

• Requires 5+ years in data or platform engineering.
• 3+ years with Databricks and Apache Spark in production environments.
• Strong Terraform experience with modules/state management.
• AWS experience including IAM, S3, networking, monitoring, and security.
• Experience with Databricks Asset Bundles, Git-based development, automated testing, and deployments.
• Strong Python and SQL skills; working knowledge of PySpark and Delta Lake.
• Experience with identity/access management, service principals, groups, least privilege, and SSO/SCIM.
• Ability to translate architecture/governance requirements into maintainable code and procedures.
• Strong communication and collaboration across architecture, engineering, security, and business teams.

Responsibilities

• Implement, operate, and improve the Databricks platform on AWS.
• Build and maintain Terraform modules for Databricks, AWS infra, Unity Catalog, permissions, and integrations.
• Configure and support workspaces, compute policies, SQL warehouses, workflows, jobs, service principals, and platform permissions.
• Implement Unity Catalog governance (catalogs, schemas, storage credentials, external locations, ownership, group-based access).
• Develop pipelines using Python, SQL, Spark, Delta Lake, and Databricks workflows.
• Create lightweight internal apps and governed user-input solutions using approved platform services.
• Monitor platform health, reliability, performance, security, and cost; troubleshoot incidents.

Skills

Communication

Collaboration

Problem solving

Architecture translation

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Terraform

Unity Catalog

AWS

Python

SQL

PySpark

Delta Lake

Apache Spark

Git

CI/CD

Job description

This is an opportunity for a Data Platform Engineer within First Orion’s Data Engineering organization. This hands-on role is responsible for implementing, automating, operating, and improving our enterprise data platform, with a primary focus on Databricks running on AWS. The engineer will translate platform architecture and governance standards into reliable infrastructure, deployments, access controls, pipelines, and internal data solutions.You will work closely with the Data Platform Architect, who sets platform direction, architecture, and company process alignment. The Data Platform Engineer provides implementation expertise, builds according to those designs, and owns the operational quality of the platform. We are looking for a collaborative, self-motivated engineer with strong technical judgment and a commitment to secure, reliable, and maintainable solutions.What you’ll be doing:Implement, operate, and continuously improve the Databricks platform on AWSBuild and maintain Terraform modules for Databricks, AWS infrastructure, Unity Catalog, permissions, and supporting integrationsDevelop and maintain Databricks Asset Bundles and CI/CD pipelines for repeatable deployments across environmentsConfigure and support workspaces, compute policies, SQL warehouses, workflows, jobs, service principals, and platform permissionsImplement Unity Catalog governance, including catalogs, schemas, storage credentials, external locations, ownership, and group-based accessBuild and support foundational data pipelines using Python, SQL, Apache Spark, Delta Lake, and Databricks workflowsDevelop lightweight internal applications and governed user-input solutions using approved platform servicesMonitor platform health, reliability, performance, security, and cost; troubleshoot incidents and complete root-cause analysisCreate reusable patterns, automation, runbooks, and self-service capabilities for engineering teamsPartner with the Data Platform Architect to validate designs, identify risks, and support production-readiness reviewsWhat you’ll need:Bachelor’s degree in Computer Science or a related field, or equivalent practical experience5+ years of experience in data engineering, platform engineering, cloud infrastructure, DevOps, or a related discipline3+ years of hands-on experience with Databricks and Apache Spark in production environmentsStrong Terraform experience, including modules, state management, provider configuration, and CI/CDStrong knowledge of Unity Catalog, including securable objects, ownership, privilege inheritance, and governance modelsStrong AWS experience, particularly IAM, S3, networking, encryption, monitoring, and secure service integrationExperience with Databricks Asset Bundles, Git-based development, automated testing, and deployment pipelinesStrong Python and SQL skills with working knowledge of PySpark, Delta Lake, and distributed data processingExperience with identity and access management, service principals, groups, least privilege, and SSO/SCIMExperience with platform observability, troubleshooting, incident response, performance tuning, and cost optimizationAbility to translate architecture and governance requirements into maintainable code, automation, and operating proceduresStrong communication and collaboration skills across architecture, engineering, security, and business teamsBonus Points:Experience migrating Hive Metastore or DBFS-based workloads to Unity CatalogExperience with Databricks Apps, Streamlit, REST APIs, or lightweight Python applicationsDatabricks or AWS certificationsExperience with FinOps, Delta Sharing, AI/ML platforms, or high-scale telecom data systemsCompany Benefits:Balancing the work-life flow is key to health and happiness! That is why we offer one of the most competitive packages in our industry with open PTO, company paid holidays, Flex Fridays and flexible work arrangements. We strongly value the health and wellness of our teammates and through our state-of-the-art fitness center we’re helping our teammates reach their wellness goals while at work. Add on generous health and dental/vision options, retirement plans, learning and development programs, career path frameworks, tuition reimbursement, company options and bonus potential you have many ways to take advantage of a comprehensive benefits package that means the most to you!Learn More About First Orion:First Orion helps businesses generate more revenue, increase efficiency, and improve the customer experience by empowering them to brand their phone calls with their name, logo and reason for calling. We are the market leader in branded communications technology, and a trusted partner to Fortune 500 companies and the largest U.S. mobile carriers.First Orion has been voted a Great Place to Work with top rankings in every category.Learn more about what our employees have to say on our First Orion Glassdoor page and watch our People First Diversity Statement/Video.First Orion Culture Cornerstones are at the core of everything we do here.Disclosure:First Orion is an Affirmative Action and Equal Opportunity Employer. This job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Activities, duties, and responsibilities may change at any time with or without notice, based on the changing needs of our business.This position is not eligible for employment-based immigration visa/status sponsorship. Employees are required to demonstrate proper work authorization as required by I-9 compliance.First Orion is interested in every qualified candidate who is eligible to work in the United States. First Orion’s immigration sponsorship policy is applied in a nondiscriminatory fashion regardless of race, gender, ethnic origin, or any other classification protected by law.