Skip to main content

ArrayNode

This class represents a node that executes a target Flyte entity, such as a launch plan or task, over a collection of inputs in parallel. It provides configurable controls for execution concurrency and success thresholds, allowing for partial failures based on a minimum success count or ratio. The class automatically transforms the target's interface to handle list-based inputs and outputs during workflow compilation and local execution.

Attributes

AttributeTypeDescription
targetUnion[LaunchPlan, ReferenceTask, FlyteLaunchPlan]The target Flyte entity to map over
idstringUnique identifier for the node, derived from the target entity's name.
metadata_workflow_model.NodeMetadata = nullThe metadata for the underlying node
concurrencyinteger = nullIf specified, this limits the number of mapped tasks than can run in parallel to the given batch size.
min_successesinteger = nullThe minimum number of successful executions. If set, this takes precedence over min_success_ratio
min_success_ratiofloat = 1.0The minimum ratio of successful executions.
bindingsList[_literal_models.Binding] = []A list of input bindings that define how data is passed to the mapped tasks.
python_interfaceflyte_interface.InterfaceThe transformed Python interface representing the collection-based inputs and outputs of the array node.
interface_interface_models.TypedInterfaceThe transformed system-level typed interface used for serialization and remote execution.
data_mode_core_workflow.ArrayNode.DataModeDetermines how input data is partitioned, such as using a single input file or individual files per map instance.
execution_mode_core_workflow.ArrayNode.ExecutionModeDefines the state management strategy for the execution, such as full state or minimal state.

Constructor

Signature

def ArrayNode(
self,
target: Union[LaunchPlan, ReferenceTask, "FlyteLaunchPlan"],
bindings: Optional[List[_literal_models.Binding]] = None,
concurrency: Optional[int] = None,
min_successes: Optional[int] = None,
min_success_ratio: Optional[float] = None,
metadata: Optional[_workflow_model.NodeMetadata] = None,
): ...

Parameters

NameTypeDescription
targetUnion[LaunchPlan, ReferenceTask, FlyteLaunchPlan]The target Flyte entity to map over.
bindingsOptional[List[_literal_models.Binding]] = NoneA list of input bindings for the node.
concurrencyOptional[int] = NoneLimits the number of mapped tasks that can run in parallel. Set to 0 for unbounded concurrency.
min_successesOptional[int] = NoneThe minimum number of successful executions required. Takes precedence over min_success_ratio.
min_success_ratioOptional[float] = NoneThe minimum ratio of successful executions required (defaults to 1.0 if min_successes is not set).
metadataOptional[_workflow_model.NodeMetadata] = NoneThe metadata for the underlying node.

Methods


construct_node_metadata()

def construct_node_metadata(self) -> _workflow_model.NodeMetadata: ...

Constructs and returns the metadata for the node, defaulting to the target entity's name if no specific metadata is provided.

Returns

TypeDescription
_workflow_model.NodeMetadataThe metadata object containing configuration for the workflow node.

name()

@property
def name(self) -> str: ...

Retrieves the name of the target Flyte entity associated with this node.

Returns

TypeDescription
strThe identifier string of the target entity.

python_interface()

@property
def python_interface(self) -> flyte_interface.Interface: ...

Provides the Python-native interface definition for the array node, which typically involves list-transformed inputs and outputs.

Returns

TypeDescription
flyte_interface.InterfaceThe Python interface object defining the expected input and output types.

interface()

@property
def interface(self) -> _interface_models.TypedInterface: ...

Retrieves the typed interface for remote entities; raises an AttributeError if the interface is not available.

Returns

TypeDescription
_interface_models.TypedInterfaceThe serialized interface model for the remote entity.

bindings()

@property
def bindings(self) -> List[_literal_models.Binding]: ...

Returns the list of input bindings that map workflow data to the node's inputs.

Returns

TypeDescription
List[_literal_models.Binding]A list of binding models representing input connections.

upstream_nodes()

@property
def upstream_nodes(self) -> List[Node]: ...

Returns a list of nodes that must execute before this node; currently returns an empty list for ArrayNodes.

Returns

TypeDescription
List[Node]An empty list as upstream dependencies are managed differently for array nodes.

flyte_entity()

@property
def flyte_entity(self) -> Any: ...

Returns the underlying Flyte entity (e.g., LaunchPlan or Task) that this node is mapping over.

Returns

TypeDescription
AnyThe target Flyte entity object.

data_mode()

@property
def data_mode(self) -> _core_workflow.ArrayNode.DataMode: ...

Indicates how data is handled for the array node, such as whether it uses single or individual input files.

Returns

TypeDescription
_core_workflow.ArrayNode.DataModeThe data mode enum value determining input file structure.

local_execute()

def local_execute(self, ctx: FlyteContext, **kwargs) -> Union[Tuple[Promise], Promise, VoidPromise]: ...

Executes the array node locally by iterating over input collections and invoking the target entity for each element. It validates success ratios and handles translation between Python types and Flyte literals.

Parameters

NameTypeDescription
ctxFlyteContextThe execution context providing environment configuration and state.

Returns

TypeDescription
Union[Tuple[Promise], Promise, VoidPromise]A promise containing a collection of results, or a void promise if no outputs are expected.

local_execution_mode()

def local_execution_mode(self): ...

Returns the execution mode for local processing.

Returns

TypeDescription
ExecutionState.ModeThe mode indicating local task execution.

min_success_ratio()

@property
def min_success_ratio(self) -> Optional[float]: ...

Returns the minimum ratio of successful sub-task executions required for the node to be considered successful.

Returns

TypeDescription
Optional[float]A float between 0 and 1, or None if min_successes is used instead.

min_successes()

@property
def min_successes(self) -> Optional[int]: ...

Returns the absolute minimum number of successful sub-task executions required.

Returns

TypeDescription
Optional[int]The integer count of required successes.

concurrency()

@property
def concurrency(self) -> Optional[int]: ...

Returns the maximum number of sub-tasks allowed to run in parallel.

Returns

TypeDescription
Optional[int]The batch size for parallel execution, or None for default behavior.

execution_mode()

@property
def execution_mode(self) -> _core_workflow.ArrayNode.ExecutionMode: ...

Indicates the execution strategy, such as FULL_STATE or MINIMAL_STATE, based on the target entity type.

Returns

TypeDescription
_core_workflow.ArrayNode.ExecutionModeThe execution mode enum value.

is_original_sub_node_interface()

@property
def is_original_sub_node_interface(self) -> bool: ...

Returns a boolean indicating if the node uses the original sub-node interface.

Returns

TypeDescription
boolAlways returns True for this implementation.

bound_inputs()

@property
def bound_inputs(self) -> Set[str]: ...

Returns the set of input names that are already bound to specific values.

Returns

TypeDescription
Set[str]An empty set of strings representing bound input identifiers.