ETL Developer/ Architect

Cloud Hybrid Technologies, LLC; Tallahassee (FL); On-site; USD 120,000 - 150,000; Full time

Job summary

A leading tech company in Florida seeks a seasoned Data Engineer to lead the design and optimization of ETL processes in a cloud environment. Candidates must have extensive experience with Azure tools and a strong background in data governance. Responsibilities include delivering reliable data workflows, collaborating with cross-functional teams, and ensuring compliance with security protocols. A commitment to mentoring junior staff is essential, making this role ideal for someone eager to lead and innovate in the data engineering sphere.

Qualifications

• 10+ years of experience in ETL development and data engineering.
• 5+ years of experience working with ADF, Azure Cloud, Azure Databricks, Azure Synapse Analytics.
• Proven track record of building and optimizing large-scale ETL pipelines.

Responsibilities

• Lead the design of high-performing ETL processes.
• Deliver reliable pipelines meeting security standards.
• Optimize ETL jobs to minimize latency and maximize throughput.

Skills

Large and complex database management systems

ETL development and data engineering

Spark, Python, and/or Scala

Strong SQL proficiency

Data governance and security protocols

Tools

Azure Databricks

Azure Synapse Analytics

Azure Purview

Azure Data Factory (ADF)

Job description

• Microsoft Office Certification as an Azure Data Engineer Associate, Azure Solutions Architect Expert, and Azure Fundamentals is must
• Azure Databricks Certification as a Data Engineer Associate is must.

Required Experience:

• Experience with large and complex database management systems.
• Experience in Service-Oriented Architecture (SOA) and Microsoft Azure Cloud Solutions
• 10+ years of experience in ETL development and data engineering;
• 5+ years of experience working with ADF, Azure Cloud, Azure Databricks, Azure Synapse Analytics, and Azure Purview;
• Proven track record of building and optimizing large-scale ETL pipelines for high-performance, high-availability environments; Extensive expertise in Spark, Python, and/or Scala for large-scale data transformations;
• Strong Structured Query Language (SQL) proficiency and experience working with complex data structures;
• In-depth knowledge of data governance, security protocols, and role-based access control (RBAC) within the Azure ecosystem; and
• Ability to design ETL processes that are resilient, efficient, and fully compliant with regulatory standards.

Responsibilities:

ETL Pipeline Design and Development

• Lead the design and development of high-performing ETL processes to integrate and transform data across disparate sources;
• Deliver efficient, reliable pipelines that meet business needs and maintain the highest standards of security; and
• Utilize ADF to automate and streamline data workflows, ensuring smooth transitions from source to target.

Data Integration and Transformation:

• Build and manage complex ETL workflows that extract, transform, and load data for downstream analytics and reporting, ensuring data is accurate, timely, and secure; and
• Take ownership of data quality and validation, creating resilient ETL processes that ensure only trusted data reaches its destination.
• Leverage the full power of the Azure ecosystem ADF, Databricks, Synapse, and Purview to manage and process high volumes of structured and unstructured data, delivering solutions that are scalable and performance-optimized; and
• Integrate large datasets into Azure Synapse Analytics, enabling analytics teams to deliver data-driven insights that support the Department s mission.

Performance Optimization:

• Continuously optimize ETL jobs to minimize latency and maximize throughput; and
• Ensure the architecture supports fast, reliable data access for end-users and systems, meeting stringent performance metrics

Security and compliance:

• Embed security and compliance best practices in every step of the ETL process;.
• Protect sensitive data by adhering to industry standards and ensuring compliance with the Department s data governance policies; and
• Use Azure Purview to enforce data governance, track data lineage, and ensure that data handling meets the highest standards of integrity

Collaboration and Stakeholder engagement:

• Partner with cross-functional teams (e.g., data engineers, analysts, business stakeholders, and security experts) to design and implement ETL solutions that meet the Department s evolving needs; and
• Act as a technical leader and mentor, helping guide junior team members and providing expert guidance on data processing and transformation best practices

Documentation and Best Practices:

• Develop and maintain clear, detailed documentation for ETL processes, ensuring the team can consistently deliver high-quality, reliable solutions; and
• Establish and enforce best practices for data handling, ETL development, and security, driving a culture of excellence and accountability.

Cloud Hybrid is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. Cloud Hybrid will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will Cloud Hybrid require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract