SeaweedFS integration

[lucaspar]

Integration of SeaweedFS as additional storage backend.

• Gateway Django app changes
  • Custom storage backend that uses both SFS (primary) and MinIO (secondary).
  • Writes to both in strict mode; reads from primary and, on failure, from secondary.
• Compose stack updates
  • Added healthchecks to compose files, covering more services.
• Security
  • Reviewed and improved Nginx server config.
  • chmod-ing .env files to 600 upon (re-)generation.
• CI/CD
  • Expanded automated secret generation to cover SFS setup.
• Others
  • Sample-based integrity check script to run against object stores.

[semanticdiff-com]

Review changes with  

Changed Files

File	Status
gateway/sds_gateway/monitoring/services.py	41% smaller
gateway/config/settings/base.py	17% smaller
gateway/compose.ci.yaml	9% smaller
gateway/compose.production.yaml	7% smaller
gateway/sds_gateway/api_methods/utils/minio_client.py	3% smaller
gateway/compose.local.yaml	2% smaller
gateway/.envs/example/minio.env	Unsupported file format
gateway/.envs/example/sfs.env	Unsupported file format
gateway/compose/production/nginx/nginx-default.conf	Unsupported file format
gateway/justfile	Unsupported file format
gateway/scripts/deploy.sh	Unsupported file format
gateway/scripts/env-selection.sh	Unsupported file format
gateway/scripts/generate-secrets.sh	Unsupported file format
gateway/sds_gateway/api_methods/tests/test_object_store_migration.py	0% smaller
gateway/sds_gateway/api_methods/utils/dual_object_store_storage.py	0% smaller
sdk/config/nginx/nginx.conf	Unsupported file format
sds-code.code-workspace	Unsupported file format
seaweedfs/.envs/example/sfs.env	Unsupported file format
seaweedfs/.gitignore	Unsupported file format
seaweedfs/compose.ci.yaml	0% smaller
seaweedfs/compose.local.yaml	0% smaller
seaweedfs/compose.production.yaml	0% smaller
seaweedfs/compose.yaml	0% smaller
seaweedfs/config/credential.toml	Unsupported file format
seaweedfs/config/filer.toml	Unsupported file format
seaweedfs/config/master.toml	Unsupported file format
seaweedfs/config/notification.toml	Unsupported file format
seaweedfs/config/replication.toml	Unsupported file format
seaweedfs/config/security.toml	Unsupported file format
seaweedfs/config/shell.toml	Unsupported file format
seaweedfs/data/filer/.gitkeep	Unsupported file format
seaweedfs/data/volumes/.gitkeep	Unsupported file format
seaweedfs/docs/.gitignore	Unsupported file format
seaweedfs/docs/operations.md	Unsupported file format
seaweedfs/docs/readme.md	Unsupported file format
seaweedfs/justfile	Unsupported file format
seaweedfs/prometheus/prometheus.yaml	0% smaller
seaweedfs/scripts/.gitignore	Unsupported file format
seaweedfs/scripts/checksum-audit.sh	Unsupported file format
seaweedfs/scripts/common.sh	Unsupported file format
seaweedfs/scripts/deploy.sh	Unsupported file format
seaweedfs/scripts/env-selection.sh	Unsupported file format
seaweedfs/scripts/prod-hostnames.example.env	Unsupported file format