Skip to content

feat: Add adb-coding-assistants-cluster module - #241

Open
dgokeeffe wants to merge 3 commits into
databricks:mainfrom
dgokeeffe:pr/add-coding-assistants-cluster
Open

feat: Add adb-coding-assistants-cluster module#241
dgokeeffe wants to merge 3 commits into
databricks:mainfrom
dgokeeffe:pr/add-coding-assistants-cluster

Conversation

@dgokeeffe

Copy link
Copy Markdown

Summary

This PR adds a new Terraform module for deploying Claude Code CLI on Databricks clusters with MLflow tracing integration.

Key Features

  • Claude Code CLI Installation: Automated installation with Node.js runtime
  • Databricks Authentication: Integration via proxy endpoints using DATABRICKS_TOKEN
  • MLflow Tracing: Native tracing support for Claude Code sessions
  • Remote Development: VS Code/Cursor Remote SSH support
  • Token Management: Helper functions and optional cron automation for token refresh
  • Databricks Skills: Pre-installed patterns and best practices
  • Network Validation: Script to validate connectivity to required dependencies
  • Minimal Installation: Lightweight option for resource-constrained environments

Module Structure

  • modules/adb-coding-assistants-cluster/ - Main module with full features
  • examples/adb-coding-assistants-cluster/ - Example deployment configuration

Init Scripts

  1. install-claude.sh - Full installation with MLflow, token management, and Databricks skills
  2. install-claude-minimal.sh - Minimal installation with basic configuration
  3. vscode-setup.sh - VS Code/Cursor Remote SSH configuration
  4. check-network-deps.sh - Network dependency validation

Authentication

The module configures Claude Code to use Databricks as the model provider:

  • Uses DATABRICKS_TOKEN for authentication
  • Routes requests through Databricks serving endpoints
  • Supports both service principal and profile-based authentication
  • Disables experimental betas for stability

Helper Commands

The init scripts add several helper commands to the cluster:

  • check-claude - Verify installation status
  • claude-refresh-token - Regenerate authentication settings
  • claude-token-status - Check token freshness
  • claude-tracing-enable/disable/status - Manage MLflow tracing
  • claude-vscode-setup - Remote SSH setup guide

Test Plan

  • Terraform module validates successfully
  • Init scripts execute without errors on Databricks clusters
  • Claude Code CLI authenticates correctly with Databricks
  • MLflow tracing captures sessions
  • Token refresh helpers work as expected
  • VS Code Remote SSH connects successfully
  • Network dependency checker identifies connectivity issues
  • Minimal installation works in constrained environments

Made with Cursor

dgokeeffe and others added 3 commits February 4, 2026 15:07
Add Terraform module for deploying Claude Code CLI on Databricks
clusters with MLflow tracing integration.

Features:
- Claude Code CLI installation with Node.js runtime
- Databricks authentication integration via proxy endpoints
- MLflow tracing for Claude Code sessions
- VS Code/Cursor Remote SSH support
- Token refresh helpers and cron automation
- Databricks skills for common patterns
- Network dependency validation script
- Minimal installation option for constrained environments

The module includes init scripts that:
- Install Claude Code CLI and dependencies
- Configure authentication via DATABRICKS_TOKEN
- Set up bashrc helpers for token management
- Support profile-based Azure authentication
- Disable experimental betas for stability

Co-authored-by: Cursor <cursoragent@cursor.com>
- Add safe expansion for DATABRICKS_HOST to prevent crash under set -u
- Remove unused local variables in claude-setup-token-refresh()
- Fix broken $? check in claude-vscode-config() by capturing exit code
- Use python3 -m pip instead of bare pip for safer execution
- Add supply-chain verification comment to minimal installer
- Fix node_type_id description to match actual default value
- Update scripts README with all available scripts
- Remove wget from system tools list (not installed)
- Remove OpenCode references throughout documentation

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Per review feedback, not every example needs a corresponding module.
Inlined all resources from modules/adb-coding-assistants-cluster/ directly
into examples/adb-coding-assistants-cluster/ to make it self-contained.
Copied scripts into the example directory and updated all references.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@dgokeeffe
dgokeeffe requested review from a team as code owners September 1, 2026 06:45
@dgokeeffe
dgokeeffe requested a review from rauchy September 1, 2026 06:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant