MinIO

MinIO is an S3-compatible object store. The MinIO connector lets you read files from a MinIO bucket/prefix and load them into Extract destinations.

Prerequisites

• A reachable MinIO endpoint URL (e.g. https://minio.example.com or http://localhost:9000)
• A MinIO access key + secret key with read access to the bucket

Setup

1. Create a MinIO user/access key that has at least:
   • s3:ListBucket on the bucket
   • s3:GetObject on the target prefix
2. In Extract, configure the connector:
   • Endpoint URL: MinIO server URL
   • Access Key ID / Secret Access Key
   • Bucket Name
   • Key Prefix: the folder/prefix to scan
   • File Format + File Pattern

TLS / self-signed certificates

If your MinIO uses HTTPS with a self-signed/invalid certificate, enable Insecure TLS (Skip Certificate Verification).

This disables TLS certificate verification and should only be used in trusted networks.

Configuration

Provide the following configuration values when creating a MinIO source:

• endpoint_url: The MinIO/S3-compatible endpoint URL (for example, https://minio.example.com).
• access_key_id: Access key for the MinIO user.
• secret_access_key: Secret key for the MinIO user.
• region: Region to use for the S3 client (use the value required by your MinIO deployment).
• bucket: The bucket name to read from.
• key: The prefix (folder) within the bucket to scan. A leading / is ignored, and the connector will normalize the value to end with / (unless empty).
• file_pattern: A regular expression used to match files under the selected prefix.
• partition_key_pattern (optional): A regular expression used to extract variables from the object key path for partitioning and stream naming.
• stream_name_pattern: A pattern used to build stream names. If partition_key_pattern defines named capture groups, you can reference them here as {group_name}.
• file_format (optional): File format hint (for example, csv). If omitted, the connector uses its default behavior.
• csv_headers (optional): Comma-separated list of column names to use as headers when reading CSV files (for example, id,created_at,total).