Enable streaming between components
SciPipe can stream the output via UNIX named pipes (or "FIFO files").
Streaming can be turned on, on out-ports when creating processes with
NewProc()
, by using {os:outport_name}
as placeholder, instead of the
normal {o:outport_name}
(note the addisional "s")
You can see how this is used in this example on GitHub.
Note that when streaming, you will not get an output file for the output in question.
Note also that you still have to provide a path formatting strategy (via some
of the Process.SetOut...()
functions, or by manually adding one to
Process.PathFuncs
. This is because a uniqe file name is needed in
order to create any audit files, as well as to give a unique name for the named
pipe.