Helper function to iterate through a series of different environment variables. This function exists because for
some settings reference multiple environment variables for legacy reasons.
Parameter
Type
Description
args
*args
List of environment variables to look for. :return: The first defined value in the environment, or an empty string if nothing is found.
Where to write offloaded data (files, directories, dataframes).
output_metadata_prefix
typing.Optional[str]
Where to write primitive outputs.
checkpoint_path
typing.Optional[str]
prev_checkpoint
typing.Optional[str]
dynamic_addl_distro
typing.Optional[str]
Works in concert with the other dynamic arg. If present, indicates that if a dynamic task were to run, it should set fast serialize to true and use these values in FastSerializationSettings