1.15.4.dev2+g3e3ce2426

flytekit.tools.script_mode

Directory

Classes

Class Description
CopyFileDetection Create a collection of name/value pairs.
IgnoreGroup Groups multiple Ignores and checks a path against them.
ModuleType Create a module object.
Path PurePath subclass that can make system calls.
datetime datetime(year, month, day[, hour[, minute[, second[, microsecond[,tzinfo]]]]]).
timezone Fixed offset from UTC implementation of tzinfo.

flytekit.tools.script_mode.CopyFileDetection

Create a collection of name/value pairs.

Example enumeration:

class Color(Enum): … RED = 1 … BLUE = 2 … GREEN = 3

Access them by:

  • attribute access:

Color.RED <Color.RED: 1>

  • value lookup:

Color(1) <Color.RED: 1>

  • name lookup:

Color[‘RED’] <Color.RED: 1>

Enumerations can be iterated over, and know how many members they have:

len(Color) 3

list(Color) [<Color.RED: 1>, <Color.BLUE: 2>, <Color.GREEN: 3>]

Methods can be added to enumerations, and members can have their own attributes – see the documentation for details.

flytekit.tools.script_mode.IgnoreGroup

Groups multiple Ignores and checks a path against them. A file is ignored if any Ignore considers it ignored.

def IgnoreGroup(
    root: str,
    ignores: typing.List[typing.Type[flytekit.tools.ignore.Ignore]],
):
Parameter Type
root str
ignores typing.List[typing.Type[flytekit.tools.ignore.Ignore]]

Methods

Method Description
is_ignored() None
list_ignored() None
tar_filter() None

is_ignored()

def is_ignored(
    path: str,
):
Parameter Type
path str

list_ignored()

def list_ignored()

tar_filter()

def tar_filter(
    tarinfo: tarfile.TarInfo,
):
Parameter Type
tarinfo tarfile.TarInfo

flytekit.tools.script_mode.ModuleType

Create a module object.

The name must be a string; the optional doc argument can have any type.

flytekit.tools.script_mode.Path

PurePath subclass that can make system calls.

Path represents a filesystem path but unlike PurePath, also offers methods to do system calls on path objects. Depending on your system, instantiating a Path will return either a PosixPath or a WindowsPath object. You can also instantiate a PosixPath or WindowsPath directly, but cannot instantiate a WindowsPath on a POSIX system or vice versa.

def Path(
    args,
    kwargs,
):
Parameter Type
args *args
kwargs **kwargs

Methods

Method Description
absolute() Return an absolute version of this path by prepending the current
as_posix() Return the string representation of the path with forward (/)
as_uri() Return the path as a ‘file’ URI
chmod() Change the permissions of the path, like os
cwd() Return a new path pointing to the current working directory
exists() Whether this path exists
expanduser() Return a new path with expanded ~ and ~user constructs
glob() Iterate over this subtree and yield all existing files (of any
group() Return the group name of the file gid
hardlink_to() Make this path a hard link pointing to the same file as target
home() Return a new path pointing to the user’s home directory (as
is_absolute() True if the path is absolute (has both a root and, if applicable,
is_block_device() Whether this path is a block device
is_char_device() Whether this path is a character device
is_dir() Whether this path is a directory
is_fifo() Whether this path is a FIFO
is_file() Whether this path is a regular file (also True for symlinks pointing
is_junction() Whether this path is a junction
is_mount() Check if this path is a mount point
is_relative_to() Return True if the path is relative to another path or False
is_reserved() Return True if the path contains one of the special names reserved
is_socket() Whether this path is a socket
is_symlink() Whether this path is a symbolic link
iterdir() Yield path objects of the directory contents
joinpath() Combine this path with one or several arguments, and return a
lchmod() Like chmod(), except if the path points to a symlink, the symlink’s
lstat() Like stat(), except if the path points to a symlink, the symlink’s
match() Return True if this path matches the given pattern
mkdir() Create a new directory at this given path
open() Open the file pointed to by this path and return a file object, as
owner() Return the login name of the file owner
read_bytes() Open the file in bytes mode, read it, and close the file
read_text() Open the file in text mode, read it, and close the file
readlink() Return the path to which the symbolic link points
relative_to() Return the relative path to another path identified by the passed
rename() Rename this path to the target path
replace() Rename this path to the target path, overwriting if that path exists
resolve() Make the path absolute, resolving all symlinks on the way and also
rglob() Recursively yield all existing files (of any kind, including
rmdir() Remove this directory
samefile() Return whether other_path is the same or not as this file
stat() Return the result of the stat() system call on this path, like
symlink_to() Make this path a symlink pointing to the target path
touch() Create this file with the given access mode, if it doesn’t exist
unlink() Remove this file or link
walk() Walk the directory tree from this directory, similar to os
with_name() Return a new path with the file name changed
with_segments() Construct a new path object from any number of path-like objects
with_stem() Return a new path with the stem changed
with_suffix() Return a new path with the file suffix changed
write_bytes() Open the file in bytes mode, write to it, and close the file
write_text() Open the file in text mode, write to it, and close the file

absolute()

def absolute()

Return an absolute version of this path by prepending the current working directory. No normalization or symlink resolution is performed.

Use resolve() to get the canonical path to a file.

as_posix()

def as_posix()

Return the string representation of the path with forward (/) slashes.

as_uri()

def as_uri()

Return the path as a ‘file’ URI.

chmod()

def chmod(
    mode,
    follow_symlinks,
):

Change the permissions of the path, like os.chmod().

Parameter Type
mode
follow_symlinks

cwd()

def cwd()

Return a new path pointing to the current working directory.

exists()

def exists(
    follow_symlinks,
):

Whether this path exists.

This method normally follows symlinks; to check whether a symlink exists, add the argument follow_symlinks=False.

Parameter Type
follow_symlinks

expanduser()

def expanduser()

Return a new path with expanded ~ and ~user constructs (as returned by os.path.expanduser)

glob()

def glob(
    pattern,
    case_sensitive,
):

Iterate over this subtree and yield all existing files (of any kind, including directories) matching the given relative pattern.

Parameter Type
pattern
case_sensitive

group()

def group()

Return the group name of the file gid.

def hardlink_to(
    target,
):

Make this path a hard link pointing to the same file as target.

Note the order of arguments (self, target) is the reverse of os.link’s.

Parameter Type
target

home()

def home()

Return a new path pointing to the user’s home directory (as returned by os.path.expanduser(’~’)).

is_absolute()

def is_absolute()

True if the path is absolute (has both a root and, if applicable, a drive).

is_block_device()

def is_block_device()

Whether this path is a block device.

is_char_device()

def is_char_device()

Whether this path is a character device.

is_dir()

def is_dir()

Whether this path is a directory.

is_fifo()

def is_fifo()

Whether this path is a FIFO.

is_file()

def is_file()

Whether this path is a regular file (also True for symlinks pointing to regular files).

is_junction()

def is_junction()

Whether this path is a junction.

is_mount()

def is_mount()

Check if this path is a mount point

is_relative_to()

def is_relative_to(
    other,
    _deprecated,
):

Return True if the path is relative to another path or False.

Parameter Type
other
_deprecated

is_reserved()

def is_reserved()

Return True if the path contains one of the special names reserved by the system, if any.

is_socket()

def is_socket()

Whether this path is a socket.

def is_symlink()

Whether this path is a symbolic link.

iterdir()

def iterdir()

Yield path objects of the directory contents.

The children are yielded in arbitrary order, and the special entries ‘.’ and ‘..’ are not included.

joinpath()

def joinpath(
    pathsegments,
):

Combine this path with one or several arguments, and return a new path representing either a subpath (if all arguments are relative paths) or a totally different path (if one of the arguments is anchored).

Parameter Type
pathsegments

lchmod()

def lchmod(
    mode,
):

Like chmod(), except if the path points to a symlink, the symlink’s permissions are changed, rather than its target’s.

Parameter Type
mode

lstat()

def lstat()

Like stat(), except if the path points to a symlink, the symlink’s status information is returned, rather than its target’s.

match()

def match(
    path_pattern,
    case_sensitive,
):

Return True if this path matches the given pattern.

Parameter Type
path_pattern
case_sensitive

mkdir()

def mkdir(
    mode,
    parents,
    exist_ok,
):

Create a new directory at this given path.

Parameter Type
mode
parents
exist_ok

open()

def open(
    mode,
    buffering,
    encoding,
    errors,
    newline,
):

Open the file pointed to by this path and return a file object, as the built-in open() function does.

Parameter Type
mode
buffering
encoding
errors
newline

owner()

def owner()

Return the login name of the file owner.

read_bytes()

def read_bytes()

Open the file in bytes mode, read it, and close the file.

read_text()

def read_text(
    encoding,
    errors,
):

Open the file in text mode, read it, and close the file.

Parameter Type
encoding
errors
def readlink()

Return the path to which the symbolic link points.

relative_to()

def relative_to(
    other,
    _deprecated,
    walk_up,
):

Return the relative path to another path identified by the passed arguments. If the operation is not possible (because this is not related to the other path), raise ValueError.

The walk_up parameter controls whether .. may be used to resolve the path.

Parameter Type
other
_deprecated
walk_up

rename()

def rename(
    target,
):

Rename this path to the target path.

The target path may be absolute or relative. Relative paths are interpreted relative to the current working directory, not the directory of the Path object.

Returns the new Path instance pointing to the target path.

Parameter Type
target

replace()

def replace(
    target,
):

Rename this path to the target path, overwriting if that path exists.

The target path may be absolute or relative. Relative paths are interpreted relative to the current working directory, not the directory of the Path object.

Returns the new Path instance pointing to the target path.

Parameter Type
target

resolve()

def resolve(
    strict,
):

Make the path absolute, resolving all symlinks on the way and also normalizing it.

Parameter Type
strict

rglob()

def rglob(
    pattern,
    case_sensitive,
):

Recursively yield all existing files (of any kind, including directories) matching the given relative pattern, anywhere in this subtree.

Parameter Type
pattern
case_sensitive

rmdir()

def rmdir()

Remove this directory. The directory must be empty.

samefile()

def samefile(
    other_path,
):

Return whether other_path is the same or not as this file (as returned by os.path.samefile()).

Parameter Type
other_path

stat()

def stat(
    follow_symlinks,
):

Return the result of the stat() system call on this path, like os.stat() does.

Parameter Type
follow_symlinks
def symlink_to(
    target,
    target_is_directory,
):

Make this path a symlink pointing to the target path. Note the order of arguments (link, target) is the reverse of os.symlink.

Parameter Type
target
target_is_directory

touch()

def touch(
    mode,
    exist_ok,
):

Create this file with the given access mode, if it doesn’t exist.

Parameter Type
mode
exist_ok
def unlink(
    missing_ok,
):

Remove this file or link. If the path is a directory, use rmdir() instead.

Parameter Type
missing_ok

walk()

def walk(
    top_down,
    on_error,
    follow_symlinks,
):

Walk the directory tree from this directory, similar to os.walk().

Parameter Type
top_down
on_error
follow_symlinks

with_name()

def with_name(
    name,
):

Return a new path with the file name changed.

Parameter Type
name

with_segments()

def with_segments(
    pathsegments,
):

Construct a new path object from any number of path-like objects. Subclasses may override this method to customize how new path objects are created from methods like iterdir().

Parameter Type
pathsegments

with_stem()

def with_stem(
    stem,
):

Return a new path with the stem changed.

Parameter Type
stem

with_suffix()

def with_suffix(
    suffix,
):

Return a new path with the file suffix changed. If the path has no suffix, add given suffix. If the given suffix is an empty string, remove the suffix from the path.

Parameter Type
suffix

write_bytes()

def write_bytes(
    data,
):

Open the file in bytes mode, write to it, and close the file.

Parameter Type
data

write_text()

def write_text(
    data,
    encoding,
    errors,
    newline,
):

Open the file in text mode, write to it, and close the file.

Parameter Type
data
encoding
errors
newline

Properties

Property Type Description
anchor
drive
name
parent
parents
parts
root
stem
suffix
suffixes

flytekit.tools.script_mode.datetime

datetime(year, month, day[, hour[, minute[, second[, microsecond[,tzinfo]]]]])

The year, month and day arguments are required. tzinfo may be None, or an instance of a tzinfo subclass. The remaining arguments may be ints.

flytekit.tools.script_mode.timezone

Fixed offset from UTC implementation of tzinfo.