parkour.io.dsink documentation
->DSink
(->DSink meta dseq step)
Positional factory function for class parkour.io.dsink.DSink.
dsink
(dsink step)
(dsink dseq step)
Return distributed sink represented by job configuration step `step` and
producing the distributed sequence `dseq` once generated. Result is a config
step which returns `dseq` when called as a zero-argument function. When `dseq`
is not provided, and `step` is not already a distributed sink, the resulting
sink produces the `nil` dseq.
dsink-dseq
(dsink-dseq step)
Force `step` to a dsink, then return its corresponding dseq.
dsink?
(dsink? x)
True iff `x` is a distributed sink.
output-paths
(output-paths step)
Vector of output-paths produced by job or configuration step `step`.
output-paths*
(output-paths* job)
Internal implementation multimethod for `output-paths`.
set-default-shape!
(set-default-shape! conf shape)
Set default sink shape for `conf` to `shape`.
sink-for
(sink-for dsink)
Local sink for writing tuples as written via `dsink`. Must `.close` to
flush, as via `with-open`.
with-dseq
macro
(with-dseq dsink & body)
Evaluate `body` forms, write tuples from resulting collection to the local
sink produced from `dsink`, and return `dsink`'s associated dseq.
with-dseq*
(with-dseq* dsink f)
Function form of `with-dseq`.