qp.backline.Node¶
- class Node(*, name=None, hardware='cpu', backend=None, remote=False, executor_options=None, executor=None, init_args=<factory>)[source]¶
Bases:
objectA node in a backline fabric.
Base class for
ControllerandCoprocessor. It carries the node’s name and hardware, how its code is deployed, and any backend-specific initialization arguments. Nodes are assembled into a device withBackline.Warning
Backlineis experimental and only usable through the Catalyst compiler.- Keyword Arguments:
name (str, None) – A name identifying this node. Defaults to
None, letting the compiler derive one from the node’s role.hardware (str) – The hardware this node executes on. Defaults to
"cpu"; other allowed values aregpuand ``fpga`. The compiler combines this with the placement’sTransportto select the runtime backend.backend (str, None) – The name of the transport backend to run this node on. Defaults to
None, letting the compiler pick the default backend for the transport and hardware.remote (bool) – Whether this node runs on another machine. Defaults to
False.executor_options (dict, None) – Options for the executor to launch for this node. Defaults to
None, which runs the node in this process. See theexecutor_optionsattribute below for every option it accepts.executor (object, None) – An already-launched executor to attach. Defaults to
None, in which case the compiler builds one fromexecutor_options.init_args (dict) – Backend-specific initialization arguments. Empty by default. See the
init_argsattribute below for the keys it accepts.
See also
Attributes
The name of the transport backend to run this node on, out of those in Catalyst's transport backend registry that implement the placement's transport on this node's hardware.
The launched executor this node runs on.
Options for the executor to launch for this node, passed to it as keyword arguments.
The hardware this node executes on.
An optional name used to reference this node.
Whether this node runs on another machine, so that the libraries it loads are the ones installed beside it there rather than the ones in this installation.
Backend-specific initialization arguments, forwarded to the transport backend.
- backend = None¶
The name of the transport backend to run this node on, out of those in Catalyst’s transport backend registry that implement the placement’s transport on this node’s hardware. Defaults to
None, letting the compiler pick the default one. Naming one selects a backend that is not a default, such as"fpga_verbs", or one installed by a backend package.
- executor = None¶
The launched executor this node runs on. Created automatically by the compiler from
executor_options; set it directly to attach one that is already launched, in which caseexecutor_optionsis ignored.
- executor_options = None¶
Options for the executor to launch for this node, passed to it as keyword arguments.
None(the default) requests no executor, leaving the node in this process.Which machine, and how it is reached
"host"(str) - deploy the executor to this host over ssh. Requires"port", so that the address is known without having to reach the host at compile time."address"(str) -"host:port"of an executor whose lifetime is managed elsewhere. Attach to it rather than launching one."port"(int) - the port the executor binds on the target, and the local end of the ssh tunnel reaching it. Omit it for a local executor and the compiler picks a free port."user"(str) - the ssh account on the remote host. Defaults to the local username.
Naming neither
"host"nor"address"runs the executor as a subprocess on this machine.What is placed on the target
"workspace"(str) - the directory the executor runs in. Defaults to a generatedcatalyst-exec-*directory removed on teardown; one named here is left in place."deploy"(list[str]) - files and directories copied into the workspace before the executor starts. A directory contributes the files inside it, which is how a cross-built set of artifacts travels."plugins"(list[str]) - shared libraries the executor loads at startup, in order. They share one symbol namespace, so the first definition wins. The compiler appends the libraries this node implies - a coprocessor’s decode function, a controller’s device runtime - if they are not already listed."executor_bin"(str) - the command that starts the executor, for wrapping it in something likenumactl.
How the process runs
"env"(dict[str, str]) - environment variables for the executor process."sudo"(bool) - run it as root, for a target whose devices are not world-accessible. Defaults toFalse."sudo_password_env"(str) - name of the environment variable holding the password to pipe tosudo -S, e.g."MY_HOST_SUDO_PW". If unset and sudo is required, a prompt will launch for the password; unnecessary with passwordless sudo."ready_timeout"(float) - seconds to wait for the executor to report that it bound its port. Defaults to60.0."verbose"(int) - how much the launcher logs:0quiet,1normal,2per-command detail.
Code generation and identity
"triple"(str) - the LLVM target triple to compile this node’s code for. Omit it and the executor detects it from the target’suname, which requires reaching the host."name"(str) - the executor’s own label, used in its log filenames. Defaults to this node’sname.
Note that
"port"here is the executor’s, on the channel that ships compiled code. It is unrelated toport, which is the transport’s handshake port. An unrecognized key raises.Warning
These options are defined by the Catalyst compiler, and may not be stable.
- hardware = 'cpu'¶
The hardware this node executes on. The compiler combines this with the placement’s
Transportto select the runtime backend.
- name = None¶
An optional name used to reference this node.
- remote = False¶
Whether this node runs on another machine, so that the libraries it loads are the ones installed beside it there rather than the ones in this installation. Defaults to
False.This is about the machine, not the process: it says where the node’s libraries are resolved, and
executor_optionsindependently says whether its code runs in a process of its own. The three valid combinations are:remote=Truewithexecutor_options: out-of-process on another machine, reached by deploying an executor there. A remote node cannot be reached without one.remote=Falsewithexecutor_options: out-of-process on this machine, in an executor subprocess whose libraries still resolve from this installation.remote=Falsewith noexecutor_options: in-process, the default.
- init_args = <dataclasses._MISSING_TYPE object>¶
Backend-specific initialization arguments, forwarded to the transport backend. Empty by default (never
None). The keys the compiler forwards are"backend_lib"(str) - explicit path to the transport backend library, taking precedence overhardwareand overlib_path."config"(str) - a;-separatedkey=valuestring configuring the backend on this machine, e.g."dev=mlx5_0;gid=3".devandgidselect the RDMA device and GID index; the remaining keys are backend-specific (a GPU backend takesgpu=, an FPGA engine takessq_mem=/data_mem=/reply_mem=).
Keys outside this set are rejected when the program is compiled.