pipeline is just a simple data processor that will pass the results from the
top node down to the bottom.
If you have 3 nodes for instance:
A B C
Then pipeline
A(opts) -> B(opts) -> C(opts) -> opts
Any changes A adds will be passed to B , and so on. Finally, the opts are
returned
Any node can call StopProcessing and the opts will be returned immediately
pipeline can load function modules from a list of dotted module strings
from pipeline import Pipeline
def A(**kwargs):
# ...
return kwargs
def B(**kwargs):
# ...
return kwargs
def C(**kwargs):
# ...
return kwargs
p = Pipeline([A, B, C])
print(p.process())