Job Description

Data Engineer – Azure Data Platform

About the Opportunity

We are looking for an experienced Data Engineer to join a growing data and analytics team focused on building modern, cloud-based data solutions. This role will be responsible for designing, developing, and optimizing scalable data platforms that support enterprise reporting, analytics, and data-driven decision making.

The ideal candidate has hands-on experience with Microsoft's Azure Data Platform and a strong understanding of data engineering best practices, including data governance, data quality, and data management.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT processes.
• Build and optimize data solutions using Azure cloud technologies.
• Develop data ingestion, transformation, and integration processes from multiple data sources.
• Create and maintain data models that support reporting, analytics, and business intelligence initiatives.
• Develop reusable and high-performance data workflows using SQL and Python.
• Collaborate with Data Analysts, Data Scientists, Software Engineers, and business stakeholders to translate requirements into technical solutions.
• Enhance data architecture through automation, optimization, and performance improvements.
• Support CI/CD processes and deployment pipelines for data engineering solutions.
• Build and maintain datasets that support enterprise reporting and analytics platforms.
• Troubleshoot production data issues and perform root cause analysis.
• Participate in code reviews and contribute to engineering best practices.

Required Qualifications

• Strong experience with SQL development.
• Experience building and maintaining enterprise-scale data pipelines.
• Hands-on experience with Microsoft Azure. (MUST)
• Experience with:
  • Azure Synapse Analytics
  • Azure Databricks
  • Azure Data Factory
  • Azure Data Lake
• Strong Python programming skills.
• Experience with source control and CI/CD methodologies.
• Experience working with large datasets and distributed data processing.
• Understanding of data modeling and modern data architecture principles.
• Experience with data integration and transformation processes.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.
• Experience with Azure cloud services and data platform technologies.
• Experience with Azure Kubernetes Service (AKS).
• Experience with Kubernetes.
• Experience using Ansible for infrastructure automation and configuration management.
• Experience creating and maintaining technical documentation using Markdown.
• Experience with Azure DevOps (ADO) for source control, work item management, and CI/CD pipelines.
• Experience with GitHub and Git-based development workflows.
• Experience with Microsoft Power Platform (Power BI, Power Apps, Power Automate, and Power Pages).
• Experience with Ontology Engineering and semantic data modeling.
• Experience writing queries using SPARQL.
• Experience writing queries using Cypher.
• Experience developing and consuming GraphQL APIs.
• Experience designing and working with graph databases and knowledge graph solutions.

Preferred Qualifications

• Experience with Power BI datasets and reporting solutions.
• Experience with data governance frameworks and data quality initiatives.
• Understanding of enterprise data management practices.
• Exposure to Big Data technologies.
• Experience working within Agile environments.
• Ability to collaborate effectively with both technical and business teams