fi_fabric(3) Libfabric v1.21.0 fi_fabric(3)

fi_fabric - Fabric network operations

fi_fabric / fi_close
Open / close a fabric network
Convert fabric attributes, flags, and capabilities to printable string

#include <rdma/fabric.h>
int fi_fabric(struct fi_fabric_attr *attr,
    struct fid_fabric **fabric, void *context);
int fi_close(struct fid *fabric);
char * fi_tostr(const void *data, enum fi_type datatype);
char * fi_tostr_r(char *buf, size_t len, const void *data,
    enum fi_type datatype);

Attributes of fabric to open.
Fabric network
User specified context associated with the opened object. This context is returned as part of any associated asynchronous event.
Output buffer to write string.
Size in bytes of memory referenced by buf.
Input data to convert into a string. The format of data is determined by the datatype parameter.
Indicates the data to convert to a printable string.

A fabric identifier is used to reference opened fabric resources and library related objects.

The fabric network represents a collection of hardware and software resources that access a single physical or virtual network. All network ports on a system that can communicate with each other through their attached networks belong to the same fabric. A fabric network shares network addresses and can span multiple providers. An application must open a fabric network prior to allocating other network resources, such as communication endpoints.

Opens a fabric network provider. The attributes of the fabric provider are specified through the open call, and may be obtained by calling fi_getinfo.

The fi_close call is used to release all resources associated with a fabric object. All items associated with the opened fabric must be released prior to calling fi_close.

Converts fabric interface attributes, capabilities, flags, and enum values into a printable string. The data parameter accepts a pointer to the attribute or value(s) to display, with the datatype parameter indicating the type of data referenced by the data parameter. Valid values for the datatype are listed below, along with the corresponding datatype or field value.

struct fi_info, including all substructures and fields
struct fi_info::type field
struct fi_info::ep_cap field
struct fi_info::op_flags field, or general uint64_t flags
struct fi_info::addr_format field
struct fi_tx_attr
struct fi_rx_attr
struct fi_ep_attr
struct fi_domain_attr
struct fi_fabric_attr
enum fi_threading
enum fi_progress
struct fi_ep_attr::protocol field
struct fi_ep_attr::msg_order field
struct fi_info::mode field
enum fi_av_type
enum fi_datatype
enum fi_op
Returns the library version of libfabric in string form. The data parameter is ignored.
uint32_t event parameter returned from fi_eq_read(). See fi_eq(3) for a list of known values.
uint64_t flags field in fi_cq_xxx_entry structures. See fi_cq(3) for valid flags.
struct fi_domain_attr::mr_mode flags
enum fi_op_type
struct fid *
enum fi_hmem_iface *
enum fi_cq_format
enum fi_log_level
enum fi_log_subsys

fi_tostr() will return a pointer to an internal libfabric buffer that should not be modified, and will be overwritten the next time fi_tostr() is invoked. fi_tostr() is not thread safe.

The fi_tostr_r() function is a re-entrant and thread safe version of fi_tostr(). It writes the string into a buffer provided by the caller. fi_tostr_r() returns the start of the caller’s buffer.

The following resources are associated with fabric domains: access domains, passive endpoints, and CM event queues.

The fi_fabric_attr structure defines the set of attributes associated with a fabric and a fabric provider.

struct fi_fabric_attr {
    struct fid_fabric *fabric;
    char              *name;
    char              *prov_name;
    uint32_t          prov_version;
    uint32_t          api_version;

On input to fi_getinfo, a user may set this to an opened fabric instance to restrict output to the given fabric. On output from fi_getinfo, if no fabric was specified, but the user has an opened instance of the named fabric, this will reference the first opened instance. If no instance has been opened, this field will be NULL.

The fabric instance returned by fi_getinfo should only be considered valid if the application does not close any fabric instances from another thread while fi_getinfo is being processed.

A fabric identifier.

The name of the underlying fabric provider.

To request an utility provider layered over a specific core provider, both the provider names have to be specified using “;” as delimiter.

e.g. “ofi_rxm;verbs” or “verbs;ofi_rxm”

For debugging and administrative purposes, environment variables can be used to control which fabric providers will be registered with libfabric. Specifying “FI_PROVIDER=foo,bar” will allow any providers with the names “foo” or “bar” to be registered. Similarly, specifying “FI_PROVIDER=^foo,bar” will prevent any providers with the names “foo” or “bar” from being registered. Providers which are not registered will not appear in fi_getinfo results. Applications which need a specific set of providers should implement their own filtering of fi_getinfo’s results rather than relying on these environment variables in a production setting.

Version information for the fabric provider, in a major.minor format. The use of the FI_MAJOR() and FI_MINOR() version macros may be used to extract the major and minor version data. See fi_version(3).

In case of an utility provider layered over a core provider, the version would always refer to that of the utility provider.

The interface version requested by the application. This value corresponds to the version parameter passed into fi_getinfo(3).

Returns FI_SUCCESS on success. On error, a negative value corresponding to fabric errno is returned. Fabric errno values are defined in rdma/fi_errno.h.

fabric(7), fi_getinfo(3), fi_domain(3), fi_eq(3), fi_endpoint(3)


2023-09-13 Libfabric Programmer’s Manual