Struct Stream

pub struct Stream { /* private fields */ }

Wrapper around a CUDA stream.

A CUDA stream is a linear sequence of execution that belongs to a specific device, independent from other streams. See the documentation for torch.cuda.Stream for more details.

Implementations

impl Stream

pub fn new() -> Self

Create a new stream on the current device, at priority 0.

pub fn new_with_device(device: CudaDevice) -> Self

Create a new stream on the specified device, at priority 0.

pub fn get_current_stream() -> Self

Get the current stream on the current device.

pub fn get_current_stream_on_device(device: CudaDevice) -> Self

Get the current stream on the specified device.

pub fn set_current_stream(stream: &Stream)

Set the provided stream as the current stream. Also sets the current device to be the same as the stream’s device.

pub fn wait_event(&self, event: &mut Event)

Make all future work submitted to this stream wait for an event.

pub fn wait_stream(&self, stream: &Stream)

Synchronize with another stream.

All future work submitted to this stream will wait until all kernels submitted to a given stream at the time of call entry complete.

pub fn record_event(&self, event: Option<Event>) -> Event

Record an event on this stream. If no event is provided one will be created.

pub fn query(&self) -> bool

Check if all work submitted to this stream has completed.

pub fn synchronize(&self)

Wait for all kernels in this stream to complete.

pub fn stream(&self) -> cudaStream_t

Trait Implementations

impl Clone for Stream

fn clone(&self) -> Stream

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Stream

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'__derive_more_into> From<&'__derive_more_into Stream> for &'__derive_more_into SharedPtr<CUDAStream>

fn from(value: &'__derive_more_into Stream) -> Self

Converts to this type from the input type.

impl PartialEq for Stream

fn eq(&self, other: &Self) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Send for Stream

impl Sync for Stream