| Conversational annotation & labels | ML backends support interactive predictions. Commercial offerings document Prompts for LLM-assisted labeling/evaluation and an AI Assistant that creates/refines labeling interfaces and answers setup questions. These are different workflows, not an absence of conversational AI. Label Studio AI Assistant | Chat and batch image annotation → editable boxes, polygons or image classes → standard Accept / Reject. Auto-annotate supports a shared instruction, up to 2 concurrent API image requests, progress, cancellation and resume in Pending AI Review. Desktop Codex and Claude Code run sequentially. Chat also manages project labels with confirmation. |
|---|
| Scope | Any data type — text, audio, documents, time series, conversations, images and video — template-driven Label Studio templates · Label Studio edition comparison | Computer vision: detection, instance segmentation, keypoints, classification and experimental point-cloud semantic segmentation |
|---|
| Runs as | Community: a server you start with pip or Docker. Starter Cloud and Enterprise provide other hosted/self-hosted choices; UI in the browser Label Studio install guide · Label Studio edition comparison | An app — browser, Windows, macOS, iPhone & iPad; no server |
|---|
| Accounts | Yes, even self-hosted Label Studio install guide | None |
|---|
| Where images live | Depends on deployment: your self-hosted environment or managed cloud, with local-file and storage integrations Label Studio install guide · Label Studio edition comparison | On your device. Only the optional ChatGPT or Claude and ML-runner features send what you explicitly submit |
|---|
| Labeling interface | Ready-made templates and configurable tags; commercial editions also document an AI Assistant for creating and refining interfaces Label Studio templates · Label Studio AI Assistant | Fixed per project type — the tools for that type are already the right ones, and there is nothing to configure |
|---|
| Project types | One project shape; the template decides what it labels Label Studio templates | Detection, instance segmentation, keypoints and three classification types, plus experimental point-cloud semantic segmentation |
|---|
| Shapes | Boxes, ellipses, polygons, brush masks, keypoints and vector tools; availability varies by tag and edition Label Studio templates · Label Studio VideoVector availability | Boxes, circles, polygons, open polylines, brush-painted pixel masks and skeletons — polygons, polylines and skeletons rotate with a handle, and imported rotated boxes stay editable |
|---|
| Video | Video classification, timeline segments and rectangle tracking. Enterprise and Starter Cloud also have VideoVector paths/skeletons with keyframe interpolation and a SAM 2 backend workflow Label Studio VideoVector availability | Keyframe box tracks for detection, object-mask tracks for instance segmentation, frame-by-frame keypoints, classification frame ranges, in-canvas playback, and local frame extraction |
|---|
| AI assistance | Connect an ML backend for predictions and interactive labeling; examples include SAM and Grounding DINO. Commercial offerings also include Prompts and AI-assisted interface setup Label Studio ML backend guide · HumanSignal Prompts · Label Studio AI Assistant | Built in, on your hardware: MobileSAM working on first launch, SAM 2.1 in three sizes, SAM 3 Tracker, Grounding DINO text prompts, CLIP and SigLIP 2, RTMPose pose in three sizes, and a visual-prompt assistant that learns from annotations you already made |
|---|
| Ready-made detectors | Whatever model your backend serves Label Studio ML backend guide | Eight curated auto-annotation families — D-FINE, RT-DETR, RT-DETRv2, DEIM, RF-DETR, EdgeCrafter ECDet, plus RF-DETR Seg and EdgeCrafter ECSeg for masks — downloaded once, verified on your device, run on your CPU |
|---|
| Custom models | Connect a compatible ML backend, use a provided example or implement the SDK; precomputed predictions can also be imported Label Studio ML backend guide | Guided ONNX import inside the project — YOLOv8 detection, segmentation and pose, RT-DETR, DETR, segmenters and classifiers (experimental) — gated by a mandatory test run |
|---|
| Batch pre-labelling | Backend predictions imported into the task stream as pre-annotations Label Studio ML backend guide | Local batch runs from a text prompt, visual examples or a set-up model — drafts wait in a Pending AI Review queue you can sort by model score, held out of exports and versions until accepted |
|---|
| Finding images | Data Manager filters over task metadata Label Studio edition comparison | Metadata filters plus on-device semantic search — rank the dataset against a plain-language query, see where it matched, turn the result into a batch run |
|---|
| Attributes | Per-region choices and text fields, defined in the template Label Studio templates | CVAT-style attributes — text, number, select, checkbox, radio — kept through import and export |
|---|
| Versions & history | Exports and server backups; annotation history is documented in commercial editions. This is different from an immutable dataset-version store with restore/diff Label Studio edition comparison · Label Studio export format and geometry limits | Immutable dataset versions with diff and safe restore, plus a per-dataset activity history — free on every tier |
|---|
| Dataset quality | Enterprise has reviewer workflows, ground-truth comparison, annotator agreement and quality dashboards. These assess label quality; they are not the same as a media-integrity scan Label Studio Enterprise review and quality | On-device quality scan: unannotated media, broken or out-of-bounds shapes, label and attribute problems, exact duplicates, tiny objects, class imbalance, video coverage |
|---|
| Train/val/test | Use exported data or a connected training pipeline for train/validation/test preparation; no equivalent built-in split planner was established in the reviewed docs Label Studio ML backend guide · Label Studio export format and geometry limits | Deterministic train/val/test splits with split-aware exports and a manifest |
|---|
| CV export formats | JSON plus task-dependent COCO, YOLO, Pascal VOC and other exports; supported geometries differ by format. Brush-mask conversion has separate requirements Label Studio export format and geometry limits | COCO, YOLO, Pascal VOC, Datumaro, MOT, MOTS, KITTI, Supervisely Video and plain ZIP, with the standard formats auto-detected on import |
|---|
| Collecting the data | Import files, or sync from connected cloud storage Label Studio install guide · Label Studio edition comparison | Upload files, capture photos manually or automatically (timelapse, motion or Smart), or record silent video clips — all staged locally until Accept |
|---|
| Editing the images | Image display and annotation tools are documented. A comparable pixel-saving crop/redaction editor was not established; external preprocessing remains possible Label Studio templates | Built-in image editor: crop, resize, rotate, flip, colour and region redaction, opened from the dataset |
|---|
| Portability | The server database, plus the export files you keep Label Studio install guide · Label Studio export format and geometry limits | One-file project archive that recreates the project on another install, plus a whole-profile backup; media deduplicated by content hash |
|---|
| Automation | Full REST API and SDK on the server Label Studio ML backend guide | A loopback REST API on the desktop builds, with access tokens — local automation, not a network service |
|---|
| Price | Open-source core; hosted and enterprise tiers exist Label Studio edition comparison | Currently free with unlimited projects; no paid upgrade |
|---|