GraFlag Documentation

Distributed benchmarking framework for Graph Anomaly Detection.

GraFlag runs graph anomaly detection (GAD) methods on a Docker Swarm cluster and collects their results in one standard form. Each method is a containerised image built from a pinned upstream commit, each experiment is a one-shot Swarm service that writes its scores to shared NFS storage, and graflag evaluate computes the same metrics and plots for every method. The distribution ships 33 methods – 17 PyGOD detectors on one shared image and 16 dedicated integrations – and 43 dataset descriptors whose files are downloaded on first use. Everything is driven from the client machine, through a CLI, a Python API, a web dashboard or, for AI agents, an MCP server; graflag verify checks that a run’s published scores reproduce the AUC the method reported, and an agent skill lets coding agents integrate new methods under the same checks.