Upload

type: "io.kestra.plugin.minio.Upload"

Upload a file to a bucket.

Examples

id: minio_upload
namespace: company.team

inputs:
  id: file
  type: FILE

tasks:
  - id: upload_to_storage
    type: io.kestra.plugin.minio.Upload
    accessKeyId: "<access-key>"
    secretKeyId: "<secret-key>"
    region: "eu-central-1"
    from: "{{ inputs.file }}"
    bucket: "my-bucket"
    key: "path/to/file"

Upload file to an S3-compatible storage — here, Spaces Object Storage from Digital Ocean.

id: s3_compatible_upload
namespace: company.team

tasks:
  - id: http_download
    type: io.kestra.plugin.core.http.Download
    uri: https://huggingface.co/datasets/kestra/datasets/raw/main/csv/orders.csv
  - id: upload_to_storage
    type: io.kestra.plugin.minio.Upload
    accessKeyId: "<access-key>"
    secretKeyId: "<secret-key>"
    endpoint: https://<region>.digitaloceanspaces.com  #example regions: nyc3, tor1
    bucket: "kestra-test-bucket"
    from: "{{ outputs.http_download.uri }}"
    key: "data/orders.csv"

Properties

accessKeyId

• Type: string
• Dynamic: ✔️
• Required: ❌

Access Key Id for authentication.

bucket

• Type: string
• Dynamic: ✔️
• Required: ❌

The bucket name.

contentType

• Type: string
• Dynamic: ✔️
• Required: ❌

A standard MIME type describing the format of the contents.

endpoint

• Type: string
• Dynamic: ✔️
• Required: ❌

URL to the MinIO endpoint.

from

• Type:
  • List
  • string
• Dynamic: ✔️
• Required: ❌

The file(s) to upload.

Can be a single file, a list of files or json array.

key

• Type: string
• Dynamic: ✔️
• Required: ❌

The key where to upload the file.

a full key (with filename) or the directory path if from is multiple files.

metadata

• Type: object
• SubType: string
• Dynamic: ✔️
• Required: ❌

A map of metadata to store with the object.

region

• Type: string
• Dynamic: ✔️
• Required: ❌

MinIO region with which the SDK should communicate.

secretKeyId

• Type: string
• Dynamic: ✔️
• Required: ❌

Secret Key Id for authentication.

Outputs

bucket

• Type: string
• Required: ❌

key

• Type: string
• Required: ❌

versionId

• Type: string
• Required: ❌

The version of the object.

Definitions

io.kestra.plugin.minio.List

Properties

accessKeyId

• Type: string
• Dynamic: ✔️
• Required: ❌

Access Key Id for authentication.

bucket

• Type: string
• Dynamic: ✔️
• Required: ❌

The bucket name.

delimiter

• Type: string
• Dynamic: ✔️
• Required: ❌

A delimiter is a character you use to group keys.

endpoint

• Type: string
• Dynamic: ✔️
• Required: ❌

URL to the MinIO endpoint.

filter

• Type: string
• Dynamic: ❌
• Required: ❌
• Default: BOTH
• Possible Values:
  • FILES
  • DIRECTORY
  • BOTH

The type of objects to filter: files, directory, or both.

includeVersions

• Type: boolean
• Dynamic: ❌
• Required: ❌
• Default: true

Indicates whether task should include versions in output.

marker

• Type: string
• Dynamic: ✔️
• Required: ❌

Marker is where you want to start listing from.

Start listing after this specified key. Marker can be any key in the bucket.

maxKeys

• Type: integer
• Dynamic: ✔️
• Required: ❌
• Default: 1000

Sets the maximum number of keys returned in the response.

By default, the action returns up to 1,000 key names. The response might contain fewer keys but will never contain more.

prefix

• Type: string
• Dynamic: ✔️
• Required: ❌

Limits the response to keys that begin with the specified prefix.

recursive

• Type: boolean
• Dynamic: ❌
• Required: ❌
• Default: true

Indicates whether it should look into subfolders.

regexp

• Type: string
• Dynamic: ✔️
• Required: ❌

A regexp to filter on full key.

ex: regExp: .* to match all files regExp: .*2020-01-0.\\.csv to match files between 01 and 09 of january ending with .csv

region

• Type: string
• Dynamic: ✔️
• Required: ❌

MinIO region with which the SDK should communicate.

secretKeyId

• Type: string
• Dynamic: ✔️
• Required: ❌

Secret Key Id for authentication.

startAfter

• Type: string
• Dynamic: ✔️
• Required: ❌

Limits the response to keys that ends with the specified string.