garage.replay_buffer.path_buffer module

A replay buffer that efficiently stores and can sample whole paths.

class PathBuffer(capacity_in_transitions)

Bases: object

A replay buffer that stores and can sample whole paths.

This buffer only stores valid steps, and doesn’t require paths to have a maximum length. :param capacity_in_steps: total memory allocated for the buffer :type capacity_in_steps: int

add_path(path)

Add a path to the buffer.

Parameters:path (dict) – A dict of array of shape (path_len, flat_dim)

sample_path()

Sample a single path from the buffer.

Returns:A dict of arrays of shape (path_len, flat_dim)

sample_transitions(batch_size)

Sample a batch of transitions from the buffer.

Returns:A dict of arrays of shape (batch_size, flat_dim)