Pipeline Module

Pipeline module.

class pepperpy.pipeline.PipelineConfig(name='pipeline_manager', metadata=<factory>)

Bases: ModuleConfig

Pipeline configuration.

Parameters:

• name (str)

• metadata (Dict[str, Any])

name: str = 'pipeline_manager'

metadata: Dict[str, Any]

exception pepperpy.pipeline.PipelineError(message, details=None, cause=None)

Bases: PepperpyError

Pipeline error.

Parameters:

• message (str)

• details (Dict[str, Any] | None)

• cause (Exception | None)

Return type:

None

class pepperpy.pipeline.PipelineManager(config=None)

Bases: BaseModule[PipelineConfig]

Pipeline manager.

Parameters:

config (PipelineConfig | None)

__init__(config=None)

Initialize pipeline manager.

Parameters:

config (Optional[PipelineConfig]) – Pipeline configuration

Return type:

None

create_pipeline(name, steps, metadata=None)

Create pipeline.

Parameters:

• name (str) – Pipeline name

• steps (Dict[str, Any]) – Pipeline steps

• metadata (Optional[Dict[str, Any]]) – Pipeline metadata

Raises:

PipelineError – If pipeline cannot be created

Return type:

None

delete_pipeline(name)

Delete pipeline.

Parameters:

name (str) – Pipeline name

Raises:

PipelineError – If pipeline cannot be deleted

Return type:

None

execute_pipeline(name, input_data, metadata=None)

Execute pipeline.

Parameters:

• name (str) – Pipeline name

• input_data (Dict[str, Any]) – Pipeline input data

• metadata (Optional[Dict[str, Any]]) – Pipeline metadata

Return type:

Dict[str, Any]

Returns:

Pipeline output data

Raises:

PipelineError – If pipeline cannot be executed