0.0.0+develop
flytekitplugins.dask.models
Directory
Classes
| Class | Description |
|---|---|
DaskJob |
Configuration for the custom dask job to run. |
Scheduler |
Configuration for the scheduler pod. |
WorkerGroup |
Configuration for a dask worker group. |
flytekitplugins.dask.models.DaskJob
Configuration for the custom dask job to run
class DaskJob(
scheduler: flytekitplugins.dask.models.Scheduler,
workers: flytekitplugins.dask.models.WorkerGroup,
)| Parameter | Type |
|---|---|
scheduler |
flytekitplugins.dask.models.Scheduler |
workers |
flytekitplugins.dask.models.WorkerGroup |
Methods
| Method | Description |
|---|---|
serialize_to_string() |
|
short_string() |
:rtype: Text. |
to_flyte_idl() |
:return: The dask job serialized to protobuf. |
verbose_string() |
:rtype: Text. |
serialize_to_string()
def serialize_to_string()short_string()
def short_string():rtype: Text
to_flyte_idl()
def to_flyte_idl():return: The dask job serialized to protobuf
verbose_string()
def verbose_string():rtype: Text
Properties
| Property | Type | Description |
|---|---|---|
is_empty |
||
scheduler |
:return: Configuration for the scheduler pod |
|
workers |
:return: Configuration of the default worker group |
flytekitplugins.dask.models.Scheduler
Configuration for the scheduler pod
class Scheduler(
image: typing.Optional[str],
resources: typing.Optional[flytekit.models.task.Resources],
)| Parameter | Type |
|---|---|
image |
typing.Optional[str] |
resources |
typing.Optional[flytekit.models.task.Resources] |
Methods
| Method | Description |
|---|---|
serialize_to_string() |
|
short_string() |
:rtype: Text. |
to_flyte_idl() |
:return: The scheduler spec serialized to protobuf. |
verbose_string() |
:rtype: Text. |
serialize_to_string()
def serialize_to_string()short_string()
def short_string():rtype: Text
to_flyte_idl()
def to_flyte_idl():return: The scheduler spec serialized to protobuf
verbose_string()
def verbose_string():rtype: Text
Properties
| Property | Type | Description |
|---|---|---|
image |
:return: The optional image for the scheduler pod |
|
is_empty |
||
resources |
:return: Optional resources for the scheduler pod |
flytekitplugins.dask.models.WorkerGroup
Configuration for a dask worker group
class WorkerGroup(
number_of_workers: int,
image: typing.Optional[str],
resources: typing.Optional[flytekit.models.task.Resources],
)| Parameter | Type |
|---|---|
number_of_workers |
int |
image |
typing.Optional[str] |
resources |
typing.Optional[flytekit.models.task.Resources] |
Methods
| Method | Description |
|---|---|
serialize_to_string() |
|
short_string() |
:rtype: Text. |
to_flyte_idl() |
:return: The dask cluster serialized to protobuf. |
verbose_string() |
:rtype: Text. |
serialize_to_string()
def serialize_to_string()short_string()
def short_string():rtype: Text
to_flyte_idl()
def to_flyte_idl():return: The dask cluster serialized to protobuf
verbose_string()
def verbose_string():rtype: Text
Properties
| Property | Type | Description |
|---|---|---|
image |
:return: The optional image to use for the worker pods |
|
is_empty |
||
number_of_workers |
:return: Optional number of workers for the worker group |
|
resources |
:return: Optional resources to use for the worker pods |