Job Description

Job Details

Job Overview

Title: Data and DevOps Engineer Technical Specialist 

Resume Due Date: September 2nd, 2026 (5:00PM EST)                               

Number of Vacancies: 1

Level: MP5 , $90 - $100/hr INC

Duration: 12 Months

Hours of work: 35 Hours  

Location:  CHQ – 1908 Colonel Sam Dr.(Hybrid – 3 days remote)

We are seeking an experienced Azure & Databricks DevOps Engineer to design, automate, secure, and support cloud-based data platforms and DevOps capabilities across Microsoft Azure and Databricks. This role will be responsible for building scalable infrastructure, implementing CI/CD pipelines, managing platform reliability, and enabling data engineering teams to deliver high-quality analytics and data products efficiently.

The ideal candidate has strong hands-on experience with Azure cloud services, Azure DevOps or GitHub Actions, Terraform, Databricks workspace administration, Unity Catalog, CI/CD automation, security controls, monitoring, and production support.

•    Design, deploy, and manage cloud infrastructure on Microsoft Azure using Infrastructure as Code.

•    Build and maintain CI/CD pipelines for data engineering, analytics, and platform services.

•    Administer and support Azure Databricks workspaces, clusters, jobs, repos, workflows, and permissions.

•    Implement and manage Databricks Unity Catalog, including catalogs, schemas, external locations, storage credentials, and access controls.

•    Automate deployment of Databricks notebooks, jobs, workflows, libraries, clusters, policies, and workspace configurations.

•    Develop reusable DevOps frameworks and deployment templates for data platform teams.

•    Manage Azure services such as:

•    Azure Data Lake Storage Gen2

•    Azure Key Vault

•    Azure Synapse Analytics

•    Azure Data Factory

•    Azure Monitor / Log Analytics

•    Azure Functions

•    Implement security best practices including RBAC, managed identities, service principals, secrets management, private endpoints, network security, and least-privilege access.

•    Support production operations, incident response, troubleshooting, monitoring, alerting, and performance optimization.

•    Collaborate with data engineers, architects, security teams, product owners, and application teams.

•    Manage environment promotion across development, UAT, and production environments.

•    Support cost monitoring and optimization for Azure and Databricks workloads.

•    Create and maintain technical documentation, runbooks, deployment guides, and operational procedures.

Key Accountabilities

Qualifications

Qualifications

• Proven experience as a DevOps Engineer, Cloud Engineer, Data Platform Engineer.

• Strong hands-on experience with Microsoft Azure cloud services.
• Understanding of cloud identity and access management, including Azure AD / Microsoft Entra ID, RBAC, service principals, managed identities, and group-based access control
• Experience with monitoring and logging tools such as Azure Monitor, Log Analytics, Application Insights, or Databricks system tables.
• Familiarity with Git branching strategies, pull requests, code reviews, and release management.
• Strong troubleshooting, communication, and documentation skills.
• Hands-on experience with Azure Databricks administration and deployment automation.
• Experience building CI/CD pipelines using one or more of:
  o    Azure DevOps Pipelines
  o    GitHub Actions
  o    Jenkins
• Strong Infrastructure as Code experience using:
  o    Terraform
• Experience with Databricks platform components, including:
  o    Workspaces
  o    Clusters
  o    Jobs / Workflows
  o    Repos
  o    Libraries
  o    Secret scopes
  o    Cluster policies
  o    Unity Catalog
• Strong scripting or programming skills using:
  o    Python
  o    PowerShell
  o    Bash
  o    SQL