Azure Platform & Database Administrator

Position Summary:

The Azure Platform & Database Administrator is responsible for the administration, reliability, security, and operational excellence of CAQH’s Azure data platforms, including Databricks, Azure SQL, the Enterprise Data Warehouse (EDW), and Azure Data Factory. This role will design and manage the technical foundations that support data engineering, analytics, and product delivery ensuring our platforms are stable, scalable, and aligned with CAQH’s modernization strategy.

The ideal candidate brings deep expertise in Azure cloud infrastructure, Databricks platform administration, SQL database management, and automated DevOps practices. This individual will own platform governance, manage schema/catalog structures, oversee data access and security, optimize performance, and partner closely with data engineers and product teams to enable smooth development and deployment workflows.

This is a full-time, remote, exempt position reporting to the Sr. Director, Data Engineering & Architecture.

Base Salary: $110,000 - $120,000 annually.

Specific Responsibilities:

Databricks Platform Administration

• Manage and maintain all Databricks workspaces across development, test, and production environments.
• Administer Unity Catalog / Hive Metastore, including schema design, permissions, external locations, mounts, and data governance configurations.
• Manage clusters, cluster policies, job clusters, cluster performance, auto-scaling, and cost optimization.
• Oversee Databricks Jobs, workflows, task orchestration, alerting, and SLAs.
• Configure and maintain external data sources and connectors (ADLS Gen2, Delta tables, SQL MI, Snowflake, APIs).
• Implement and maintain CI/CD pipelines for Databricks notebooks, SQL, and infrastructure using Azure DevOps/GitHub Actions.
• Develop, maintain, and enforce platform security standards including RBAC, service principals, secrets, key vault integration, and audit logging.

Azure Platform & SQL Database Administration

• Administer Azure SQL Managed Instance and other SQL environments supporting the CAQH EDW.
• Perform database performance tuning, indexing, partitioning, storage management, and query optimization.
• Oversee backup/restore operations, failover strategies, and high availability configurations.
• Manage schema changes, deployments, and environment synchronization across dev, test, and prod.
• Partner with the Data Engineering team on efficient ingestion and transformation patterns to SQL-based systems.
• Monitor capacity, costs, and system health for all SQL and storage resources in Azure.

ADF & Integration Platform Operations

• Administer Azure Data Factory including linked services, integration runtimes, pipelines, triggers, and parameterized workflows.
• Implement enterprise standards for logging, error handling, retries, alerting, and operational monitoring.
• Ensure secure configuration and compliance for all data movement operations, including PII/PHI safeguards.

Platform Governance & Standards

• Establish and enforce standards for data access, identity management, secrets rotation, key management, and auditability.
• Participate in Data Governance initiatives including metadata management, lineage tracking, and catalog standardization.
• Build documentation for platform configurations, processes, and operational playbooks.
• Evaluate new Azure features and provide recommendations for modernization and cost efficiency.

Operational Excellence & Support

• Monitor platform reliability, SLAs, performance, and uptime across all Azure data services.
• Troubleshoot and resolve platform-wide issues including job failures, performance bottlenecks, and connectivity disruptions.
• Partner with InfoSec to ensure compliance with CAQH security policies and healthcare data regulations, including but not limited to HITRUST security access reviews.
• Support agile development teams by managing environments, access, and deployment pipelines.

Supervisory Responsibilities:

This position does not have direct reports. However, the Sr. Data Engineer may collaborate with contractors or external vendors on specific initiatives and is encouraged to provide technical guidance to interns or newer team members when appropriate.

Skills: 

• Deep experience administering Databricks (clusters, UC, jobs, external tables, secrets, governance).
• Strong SQL database administration skills including performance tuning, HA/DR, and security.
• Expertise with Azure cloud services including ADF, ADLS, Azure SQL MI/SQL Server, Key Vault, Monitor/Log Analytics.
• Strong understanding of CI/CD and DevOps practices (Azure DevOps/GitHub Actions, YAML pipelines, infrastructure-as-code).
• Experience supporting enterprise-scale data platforms and implementing platform usage standards.
• Knowledge of data governance, metadata, lineage, RBAC, and PHI/PII compliance requirements.
• Familiarity with Snowflake, Synapse, and Fabric concepts preferred.
• Excellent communication skills in a remote, cross-functional environment.
• Experience troubleshooting complex platform/service issues and improving operational resiliency.

Experience:

• 5–8 years of experience as an Azure Platform Administrator, Cloud Engineer, or Database Administrator.
• Hands-on experience managing Databricks environments at scale.
• Experience supporting EDW or analytics platforms in Azure or hybrid environments.
• Experience building and managing CI/CD pipelines for data workloads.
• Healthcare or regulated data experience strongly preferred.

Education:

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or equivalent experience.
• Azure Administrator Associate, Azure Database Administrator, or Databricks Administrator certifications preferred.

WHO WE ARE

The Council for Affordable Quality Healthcare (CAQH) was formed by health plans who came together nearly 25 years ago with the desire to make healthcare work better. Today, we are trusted by stakeholders from across the healthcare ecosystem to improve business processes and offer the most comprehensive provider and member data in the United States.

WHAT YOU GET

CAQH recognizes that its most important asset is its growing team of smart, creative, collaborative, forward-thinking and passionate professionals – and that a comprehensive employee benefits package is an important factor for them in choosing where to work. CAQH offers competitive compensation along with an extensive benefits package for all full-time employees, including medical, dental and vision coverage, tuition assistance and a 401k. We offer full-time remote work to all staff from any location and maintain a physical office in downtown Washington, DC.

At CAQH, we are proud of our active commitment to equal opportunities for all. Our teams work diligently to foster a workplace where all individuals are valued, respected, and empowered. We embrace different perspectives and are dedicated to providing equal opportunities for everyone to thrive. Join us in our mission to transform healthcare through innovative technology solutions while making a positive impact on the lives of diverse communities.

CAQH is an equal opportunity employer. It is our policy to recruit, hire, train, and promote individuals, as well as administer any and all personnel actions, without regard to race, color, religion, sex, national origin or ancestry, age, marital status, disability, protected veteran status, personal appearance, sexual orientation, gender identity or expression, familial status, family responsibilities, matriculation, political affiliation, genetic information, source of income, place of residence, or any other characteristic protected by law. CAQH will not tolerate any unlawful discrimination, and any such conduct is strictly prohibited.

Applicants have rights under the Family Medical Leave Act (FMLA), Equal Employment Opportunity (EEO), and the Employee Polygraph Protection Act (EPPA). If you are interested in applying for employment with CAQH and need an accommodation to apply for a posted position, contact CAQH Human Resources at 202-517-0436.

#LI-Remote