Python developer

Brilliant Infotech Inc.; Fort Worth (TX); Híbrido; USD 120.000 - 180.000; Jornada completa

Descripción de la vacante

Brilliant Infotech Inc. invites applications for a Senior Python/Azure Data Engineer in Fort Worth, TX.

The role requires 7–10 years in Python development, data engineering, ETL/ELT, Databricks, Spark, and Azure Cloud, with strong application development skills for scalable, secure data solutions. Responsibilities include end-to-end data pipeline design, CI/CD implementation, and collaboration with data scientists and product teams.

Formación

• 7-10 years of experience in software development, data engineering, or a related field.
• 7+ years of hands-on Python, SQL, ETL, and data processing.
• Strong experience with Databricks and Apache Spark.
• Approx. 5 years of Spark/Databricks development experience.
• Strong knowledge of Azure Cloud services and Azure ML.
• Experience designing scalable data pipelines and components.
• Advanced proficiency in Python, Scala, and/or SQL.
• Strong SDLC practices.
• Experience CI/CD via GitHub Actions, Azure DevOps, Jenkins, or similar.
• Experience deploying code across environments (dev, QA, prod).
• Approximately 5 years of production troubleshooting (logging, monitoring, alerting).
• Experience with data governance, access control, security, compliance, and data lineage.

Responsabilidades

• Participate in design and implementation of scalable data and app solutions using Python, Azure, Databricks, Spark, and Azure ML.
• Develop complex ETL/ELT pipelines from multiple sources.
• Use Python, Scala, SQL, Spark, and Databricks for data processing and app development.
• Optimize jobs for performance and cost via partitioning, caching, and tuning.
• Collaborate with data scientists, analysts, product teams, and stakeholders.
• Implement data security, access controls, encryption, compliance, and Unity Catalog governance.
• Establish data lineage and ensure security/governance compliance.
• Design and maintain CI/CD pipelines using Azure DevOps, GitHub Actions, Jenkins, etc.
• Automate deployment of code, data pipelines, infra, and assets across environments.
• Develop monitoring, logging, and alerting for production pipelines and apps.
• Troubleshoot performance and production issues.
• Follow SDLC best practices including reviews, testing, docs, releases, and support.
• Support Agile planning and cross-pod coordination.

Conocimientos

Python development

SQL

ETL/ELT

Azure Cloud

Databricks

Apache Spark

CI/CD

Logging/Monitoring

Security/Compliance

Agile methodologies

Herramientas

Databricks

Apache Spark

GitHub Actions

Azure DevOps

Jenkins

Descripción del empleo

Fort Worth, TX 76155 - Hybrid

6-12+ Months with possible extension and conversions

Interview Process: Two rounds first virtual, second onsite

Note: Need Local and W2 Candidates Only

Job Overview

We are seeking a Senior Python/Azure Data Engineer with 7 10 years of experience in Python development, data engineering, ETL/ELT, Databricks, Spark, and Azure Cloud. The ideal candidate will have strong application development skills and experience building scalable, secure, and production-ready data solutions.This role will support multiple project pods and help teams follow Agile methodologies, plan projects, track deliverables, and deliver high-quality solutions across development and production environments.

Role: Sr. Python Developer

Location: Fort Worth, TX 76155 - Hybrid

Duration: 6-12+ Months with possible extension and conversions

Interview Process: Two rounds first virtual, second onsite

Note: Need Local and W2 Candidates Only

Job Overview

We are seeking a Senior Python/Azure Data Engineer with 7 10 years of experience in Python development, data engineering, ETL/ELT, Databricks, Spark, and Azure Cloud. The ideal candidate will have strong application development skills and experience building scalable, secure, and production-ready data solutions.This role will support multiple project pods and help teams follow Agile methodologies, plan projects, track deliverables, and deliver high-quality solutions across development and production environments.

Required

• 7 10 years of experience in software development, data engineering, or a related technical field.
• 7+ years of hands-on experience with Python, SQL, ETL, and data processing.
• Strong experience with Databricks and Apache Spark.
• Approximately 5 years of experience developing Spark and Databricks solutions.
• Strong knowledge of Azure Cloud services and Azure ML.
• Experience designing and developing scalable data pipelines and application components.
• Advanced proficiency in Python, Scala, and/or SQL.
• Strong understanding of software development lifecycle practices.
• Experience designing and implementing CI/CD pipelines using GitHub Actions, Azure DevOps, Jenkins, or similar tools.
• Experience deploying code across multiple environments, including development, QA, and production.
• Approximately 5 years of experience with logging, monitoring, alerting, and production troubleshooting.
• Experience with data governance, access control, security, compliance, and data lineage.

Preferred

• Experience with Java and Spring.
• Knowledge of additional Azure services.
• Experience with Unity Catalog.
• Experience working with Azure DevOps and GitHub Actions.
• Experience using AI tools to improve software development productivity.
• Experience supporting enterprise-scale data or application platforms.

Responsibilities

• Participate in the end-to-end design and implementation of scalable data and application solutions using Python, Azure, Databricks, Spark, and Azure ML.
• Develop complex ETL/ELT pipelines to process and transform large-scale datasets from multiple sources.
• Use Python, Scala, SQL, Spark, and Databricks for data processing and application development.
• Optimize Python and Spark jobs for performance and cost efficiency through partitioning, caching, cluster tuning, and bottleneck analysis.
• Collaborate with data scientists, analysts, product teams, and business stakeholders to convert business requirements into technical solutions.
• Implement data security, access controls, encryption, compliance standards, and governance frameworks such as Unity Catalog.
• Establish data lineage and ensure data assets meet organizational security and governance requirements.
• Design and maintain CI/CD pipelines using Azure DevOps, GitHub Actions, Jenkins, or similar tools.
• Automate the deployment of code, data pipelines, infrastructure, and other data assets across development, test, and production environments.
• Develop monitoring, logging, and alerting solutions for production-grade data pipelines and applications.
• Troubleshoot performance, reliability, deployment, and production issues.
• Follow software development lifecycle best practices, including code reviews, testing, documentation, release management, and production support.
• Support Agile planning and help coordinate project deliverables across multiple project pods.

Use approved AI tools to improve productivity, development efficiency, testing, documentation, and troubleshooting