Set minio upload part size to 20MB

isikhar · isikhar · commit 8e0a35a462fa · 2024-10-14T15:03:44.000+01:00
diff --git a/src/dlstbx/util/iris.py b/src/dlstbx/util/iris.py
@@ -201,7 +201,7 @@ def get_presigned_urls(minio_client, bucket_name, pid, files, logger):
                 bucket_name,
                 filename,
                 filepath,
-                part_size=10 * 1024 * 1024,
+                part_size=20 * 1024 * 1024,
                 num_parallel_uploads=10,
             )
             timestamp = time.perf_counter() - timestamp

Original file line number	Diff line number	Diff line change
`@@ -201,7 +201,7 @@ def get_presigned_urls(minio_client, bucket_name, pid, files, logger):`
`201`	`201`	`bucket_name,`
`202`	`202`	`filename,`
`203`	`203`	`filepath,`
`204`		`- part_size=10 * 1024 * 1024,`
	`204`	`+ part_size=20 * 1024 * 1024,`
`205`	`205`	`num_parallel_uploads=10,`
`206`	`206`	`)`
`207`	`207`	`timestamp = time.perf_counter() - timestamp`