Computers and templates

Computers

A computer (an Env in the SDK, a slot in the HTTP API) is one running desktop: the OSWorld Ubuntu image's GNOME session on display :0, restored from a checkpoint, in its own namespaces and cgroup on your workspace's worker host. You create computers from the SDK or the HTTP API with an API key, or from the console under Computers > Launch computer. Both kinds appear in the console with the same id.

Inside a desktop, nproc and free report the host's CPUs and memory, not the desktop's: the per-desktop view of /proc is an opt-in runtime feature that is not enabled on the current host. The cgroup limits above are what apply.

States

The console shows the state the runtime reports, never an optimistic one. The SDK and HTTP API report the runtime's own record:

The console also shows states that exist before a desktop does (Requested, Queued) and No heartbeat when the host stopped reporting.

Episodes

Each create, reset and fork child starts a new episode (env.episode counts them). An episode is what a reward belongs to: verify() scores the current episode, and the episode's gate report says whether that reward can be used. See Tasks and verifiers.

Actions

env.step(action) (HTTP POST /v1/slots/{id}/step) runs one action inside the desktop as user:

import drums

with drums.connect() as client:
    with client.create(ttl=600) as env:
        env.step("pyautogui.moveTo(960, 540)")
        r = env.step({"type": "execute", "command": ["ls", "/home/user"]})
        print(r.result["returncode"], r.result["output"].split())
        r = env.step({"type": "execute", "shell": True, "command": "test -d /nope"},
                     check=False)
        print("exit code", r.result["returncode"])

An action that exits non-zero raises ActionFailed unless you pass check=False. If you train a GUI agent, do not give the policy execute: it is a shell and can solve file tasks without touching the GUI. Use it from your own harness for setup and probes.

Observations

env.screenshot() returns PNG bytes (1920 x 1080, 8-bit RGB, about 1.7 MB). env.observe() returns an Observation with .png, .width, .height and .meta (episode, state, verdict, task id, instruction, steps). Resize in your code if your model wants a smaller image.

Templates

A template is a reproducible launch definition. Each published version is an immutable manifest pinned to one image digest:

Every workspace sees the platform template OSWorld Ubuntu (base checkpoint osworld-ubuntu, 4 vCPU, 4096 MiB, no swap). Owners and admins can create workspace templates under Templates and publish a draft version; a published version cannot change. Through the API you choose a template by its base checkpoint name (image="osworld-ubuntu"); GET /v1/checkpoints and client.images() list what your workspace may launch on its host.

Console actions