Remote Data Platform Engineer (Azure/Databricks)

Livestock Information Ltd; United States; Remote; USD 46,000 - 62,000; Full time

Benefits offered by this job

Remote work

25 days annual leave

Life Assurance 4x salary

Pension scheme

Job summary

Livestock Information Ltd. is seeking a Data Development & Support Analyst to enhance our data platform and reporting services.

You will ensure data pipelines run efficiently and data is accurately delivered into Azure Data Lake, Data Warehouse, and Power BI environments, while collaborating in an Agile team. You’ll support CI/CD release processes, manage deployments, and drive automation and reliability across the platform, including data extracts for stakeholders and improvements to

Qualifications

• Strong experience in querying and manipulating databases using SQL.
• Good working knowledge of Databricks and Python.
• Experience of data ingestion processes and data warehousing principles.
• A solid understanding of cloud computing technologies and environments.
• Strong analytical and problem-solving skills with excellent attention to detail.
• Excellent communication and collaboration skills, with the ability to work effectively across teams and stakeholders.
• The ability to work independently while also contributing positively within a team environment.
• Adaptability and flexibility in responding to changing business needs and priorities.
• Experience working within Agile delivery environments and SCRUM teams.
• Experience using Azure DevOps to manage tasks, workloads, and delivery activities.
• Familiarity with the Azure Cloud Platform and associated services.

Responsibilities

• Supporting and maintaining efficient and effective data collection and reporting processes.
• Carrying out vigorous testing and quality assurance to ensure any improvements to existing systems or new systems produce accurate information to a high quality.
• Using Azure DevOps to build and deploy code to different environments.
• Managing ad hoc data requests to support stakeholder needs.
• Actively investigating ways of utilising the Azure stack and Databricks platforms to present data in clear, concise, and innovative ways and using this knowledge to benefit both internal and external stakeholders.
• Working closely with Business Analysts and Data Engineers to develop innovative data solutions.
• Using the Service Now ITSM tool to manage tickets, service requests, incidents and problems to a timely conclusion.
• Complying with Data Protection Act and security and confidentiality rules.
• Keeping abreast of appropriate industry and technological developments and applying to LI’s technical capability.

Skills

SQL

Databricks

Python

Data pipelines

Agile / SCRUM

Cloud computing

Tools

Azure DevOps

Azure

Power BI

Job description

Livestock Information Ltd. is seeking a Data Development & Support Analyst to enhance our data platform and reporting services.

You will ensure data pipelines run efficiently and data is accurately delivered into Azure Data Lake, Data Warehouse, and Power BI environments, while collaborating in an Agile team. You’ll support CI/CD release processes, manage deployments, and drive automation and reliability across the platform, including data extracts for stakeholders and improvements to