Data Engineer - Remote - W2/ own corporation - CT preferred -

Cyber Sphere LLC; United States; Remote; USD 83.000 - 96.000; Vollzeit

Zusammenfassung

Cyber Sphere LLC is seeking a Data Engineer to design, build, and maintain scalable data pipelines for analysis and product use cases. This remote role requires strong SQL and Python skills, data modeling expertise, and experience with cloud platforms.

You will collaborate with cross-functional teams, implement data quality controls, and contribute to design decisions, pipelines, and documentation, while operating with growing independence.

Qualifikationen

• 7 years of experience in data engineering, data modeling, and ETL pipelines.
• Proficient in SQL and Python for creating, improving, and fixing data pipelines.
• Experience with cloud data platforms, especially Azure and Databricks (Delta Live Tables and Unity Catalog).
• Strong understanding of data integration and orchestration tools like SnapLogic, Azure Data Factory, and Jenkins.
• Practical experience with Terraform for infrastructure as code and deployment pipelines.
• Experience integrating with APIs and data quality/monitoring tools.
• Proficient in version control and CI/CD workflows using GitHub.
• Solid understanding of data modeling principles and dimensional modeling.

Aufgaben

• Develop and maintain batch and streaming data pipelines using modern tools and frameworks.
• Design and implement scalable data models and storage solutions for efficient querying and integration.
• Collaborate in agile teams, refine stories, identify dependencies, and raise risks when needed.
• Implement data quality controls, validation, and compliance standards across pipelines.
• Support deployment, scheduling, and monitoring of data pipelines for reliable execution.
• Maintain documentation and promote coding standards and reusable components.
• Communicate requirements clearly in stand-ups and design discussions and participate in code reviews.

Kenntnisse

7 years exp

SQL & Python

Data modeling

ETL pipelines

Agile collaboration

Tools

Azure

Databricks

Delta Live Tables

Unity Catalog

SnapLogic

Azure Data Factory

Jenkins

Terraform

GitHub

Jobbeschreibung

Data Engineer

Remote

$60/hr on W2

Profile Summary:

The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and systems that deliver trusted data for analysis and product use cases. This role partners with cross-functional teams to understand data needs and implement solutions that support both near-term and long-term objectives. This role requires the ability to contribute to technical design, ensure data quality, and operate with increasing independent and accountability.

Profile Description:

• Develop and maintain batch and streaming data pipelines using modern tools and frameworks. Design transformations, optimize performance, and ensure reliable data delivery.
• Design and implement scalable and maintainable data models and storage solutions that align with business needs and support efficient querying, analysis, and data integration efforts.
• Engage in agile best practices, help refine stories, identify dependencies, and proactively raise risks or concerns to ensure work is completed on time or escalated when needed.
• Implement and enforce data quality controls, validation, and compliance standards across pipelines.
• Support the deployment, scheduling, and monitoring of data pipelines and workflows to ensure consistent, reliable execution.
• Maintain comprehensive documentation and advocate for coding standards, best practices, and reusable components.
• Collaborate regularly with cross-functional teams to clarify data requirements, document assumptions, and deliver high-quality solutions. Communicate clearly during stand-ups, design discussion, and retrospectives. Actively contribute to team code reviews and sharing learnings with peers.

Knowledge & Experience:

• 7 years of experience in data engineering, data modeling, and ETL pipelines
• Proficient in SQL and Python for creating, improving, and fixing data pipelines
• Experience with cloud and data platforms, especially Azure and Databricks (Delta Live Tables and Unity Catalog)
• Strong understanding of tools like SnapLogic, Azure Data Factory, and Jenkins for data integration and orchestration
• Practical experience with Terraform for infrastructure as code and managing deployment pipelines
• Experience integrating with APIs.
• Knowledge of data quality and monitoring tools, particularly Soda or similar
• Proficient in version control and CI/CD workflows, using tools like GitHub
• Solid understanding of data modeling principles (e.g., dimensional modeling, normalization)
• Comfortable working in agile teams, with a proactive approach to planning, organizing tasks, and collaborating