Set minio upload part size to 100MB

isikhar · isikhar · commit 18545f2f9122 · 2024-10-14T13:11:56.000+01:00
diff --git a/src/dlstbx/util/iris.py b/src/dlstbx/util/iris.py
@@ -201,6 +201,7 @@ def get_presigned_urls(minio_client, bucket_name, pid, files, logger):
                 bucket_name,
                 filename,
                 filepath,
+                part_size=100 * 1024 * 1024,
                 num_parallel_uploads=10,
             )
             timestamp = time.perf_counter() - timestamp

Original file line number	Diff line number	Diff line change
`@@ -201,6 +201,7 @@ def get_presigned_urls(minio_client, bucket_name, pid, files, logger):`
`201`	`201`	`bucket_name,`
`202`	`202`	`filename,`
`203`	`203`	`filepath,`
	`204`	`+ part_size=100 * 1024 * 1024,`
`204`	`205`	`num_parallel_uploads=10,`
`205`	`206`	`)`
`206`	`207`	`timestamp = time.perf_counter() - timestamp`