Job Description

QUALIFICATIONS

• Minimum of eight (8) years of experience with the following:
  • Administering Databricks workspaces in a cloud environment - AWS
  • Databricks cluster configuration, job scheduling, and workspace management.
  • Managing user access, roles, and permissions using IAM, SCIM, and role-based access control (RBAC).
  • Apache Spark concepts, including performance tuning and troubleshooting.
  • Integrating Databricks with cloud storage services (e.g., S3,)
  • Implementing and enforcing cluster policies and workspace governance standards.
  • Databricks SQL, notebooks, and job orchestration.
  • Monitoring platform health, performance, and availability.
  • Data security, encryption, and compliance requirements.
  • DevOps or automation tools (Terraform, CI/CD pipelines, scripting).

PREFERRED

• Minimum of four (4) years of experience with the following:
  • Administering Databricks in an enterprise or government environment.
  • Databricks Unity Catalog for data governance and access control.
  • Cost management and optimization for Databricks workloads.
  • Supporting AI/ML workloads using Databricks ML and MLflow.
  • Data lake and lakehouse architectures.
  • Python, SQL, or Scala for administration and troubleshooting.

RESPONSIBILITIES

• Responsible for administering, configuring, and supporting the Databricks platform to enable scalable data engineering, analytics, and AI/ML workloads; this role ensures platform reliability, security, cost optimization, and compliance while supporting data engineers, analysts, and data scientists across the organization.
• Manage workspace configuration, cluster policies, user access, integrations with cloud services, and ongoing platform monitoring to support enterprise data and analytics initiatives.
• Understands business objectives and problems, identifies alternative solutions, performs studies and cost/benefit analysis of alternatives.
• Analyzes user requirements, procedures, and problems to automate processing or to improve existing computer system.
• Confers with personnel of organizational units involved to analyze current operational procedures, identify problems, and learn specific input and output requirements, such as forms of data input, how data is to be; summarized, and formats for reports.
• Writes detailed description of user needs, program functions, and steps required to develop or modify computer program.
• Reviews computer system capabilities, specifications, and scheduling limitations to determine if requested program or program change is possible within existing system.

Link Technologies is an equal opportunity employer. All qualified applicants will receive consideration for employment without discrimination based on race, color, religion, sex, gender identity/expression, sexual orientation, national origin, protected veteran status, disability, or any other factors protected by law.