When users need to upload files via the node data store (e.g. into an S3 bucket), the ingress/gateway default settings for the respective Nginx controllers limit the max upload size to 1MB which is too small for a lot of datasets. This limit seems to be specific for Nginx, other popular alternatives (Traefik, Envoy, Cilium) do not impose a default limit. In either case, a page should be added that describes how to modify the Nginx components to allow for larger uploads:
- Nginx Ingress Controller: add to ingress annotations:
nginx.ingress.kubernetes.io/proxy-body-size: 500m
- Nginx Gateway Fabric: custom
ClientSettingsPolicy (will be included with flame-node helm chart)
When users need to upload files via the node data store (e.g. into an S3 bucket), the ingress/gateway default settings for the respective Nginx controllers limit the max upload size to 1MB which is too small for a lot of datasets. This limit seems to be specific for Nginx, other popular alternatives (Traefik, Envoy, Cilium) do not impose a default limit. In either case, a page should be added that describes how to modify the Nginx components to allow for larger uploads:
nginx.ingress.kubernetes.io/proxy-body-size: 500mClientSettingsPolicy(will be included with flame-node helm chart)