graflag.docker_ops

Docker operations for GraFlag using Docker SDK.

class graflag.docker_ops.ReservedEnvVars(*values)

Bases: Enum

Reserved environment variable names that should not be overridden by method parameters.

DATA = 'DATA'

EXP = 'EXP'

METHOD_NAME = 'METHOD_NAME'

COMMAND = 'COMMAND'

MONITOR_INTERVAL = 'MONITOR_INTERVAL'

classmethod get_names()

class graflag.docker_ops.DockerManager(ssh_manager, config, hosts_file: str = 'hosts.yml')

Bases: object

Handle Docker Swarm operations via Docker SDK with SSH tunnel.

property client: DockerClient

Lazy-initialize Docker client via SSH tunnel.

close()

Close Docker client and SSH tunnel.

setup_swarm_manager()

Initialize Docker Swarm on manager node.

get_swarm_token() → str

Get Docker Swarm worker join token.

setup_workers(token: str)

Setup worker nodes to join the swarm (requires SSH to each worker).

get_nodes() → List[Dict]

Get list of swarm nodes.

setup_local_registry()

Setup local Docker registry service on manager.

build_method_image(method_name: str, tag: str = 'latest') → str

Build method Docker image and push to local registry.

Uses SSH because the build context resides on the remote host.

Returns:

Combined build and push log output.

build_evaluator_image() → str

Build graflag-evaluator image and push to registry.

Returns:

Registry image path.

create_service(exp_name: str, method_name: str, dataset: str, tag: str = 'latest', gpu_required: bool = True, method_params: dict = None) → str

Create Docker service for experiment.

create_evaluation_service(experiment_name: str) → str

Create Docker service to run evaluation.

list_services() → List[Dict]

List all Docker services.

get_service_names() → set

Get set of all service names.

stop_service(service_name: str)

Stop and remove a service.

cleanup_finished_service(service_name: str)

Remove a finished service (safe if it doesn’t exist).

remove_evaluation_service(experiment_name: str)

Remove evaluation service for an experiment.

get_service_logs(service_name: str, tail: int = 100) → List[str]

Get recent logs for a service.

Uses SSH + Docker CLI because the Docker SDK log streaming is unreliable for swarm services.

follow_service_logs(service_name: str)

Follow service logs in real-time until task finishes.

Uses SSH + Docker CLI subprocess because the Docker SDK’s follow mode does not stream reliably for swarm services.

service_exists(service_name: str) → bool

Check if a Docker service exists.

is_service_failed(service_name: str) → bool

Check if a service exists but all its tasks have failed.

get_cluster_status() → Dict

Get Docker Swarm cluster status.