rschnei87
c4525dc6e2
Fix dataDirs.maxVolumes default value when not included in a values.yaml ( #6119 )
2024-10-13 15:14:03 -07:00
chrislu
6845e25318
set proxied request content length
2024-10-10 13:55:32 -07:00
chrislu
35fd1e1c9a
optimize memory usage for large number of volumes
...
1. unwrap the map to avoid extra map object creation
2. fix ec shard counting in UpdateEcShards
2024-10-10 10:00:30 -07:00
chrislu
b28b1a3402
3.77
2024-10-10 01:28:06 -07:00
chrislu
07df5c53de
avoid nil
...
I1010 03:10:25.220345 mount_std.go:281 This is SeaweedFS version 30GB 3.76 82ed61c655
linux amd64
^[OR^[OR2024/10/10 03:12:56 Unimplemented opcode POLL
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x28 pc=0x3983b41]
goroutine 112 [running]:
github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.SubscribeMetaEvents.func2.mergeProceesors.1(0xc000513540)
/github/workspace/weed/mount/meta_cache/meta_cache_subscribe.go:30 +0x41
github.com/seaweedfs/seaweedfs/weed/pb.WithFilerClientFollowMetadata.makeSubscribeMetadataFunc.func1({0x514a560, 0xc0009b06d0})
/github/workspace/weed/pb/filer_pb_tail.go:87 +0x293
github.com/seaweedfs/seaweedfs/weed/mount.(*WFS).WithFilerClient.func1.1(0xc000d9e008)
/github/workspace/weed/mount/wfs_filer_client.go:27 +0x68
github.com/seaweedfs/seaweedfs/weed/pb.WithGrpcClient(0xa9?, 0x9d1f90fb?, 0xc00098fbe0, {0xc000e1c078, 0x15}, 0x0?, {0xc000a76bd0?, 0x1?, 0x1?
})
/github/workspace/weed/pb/grpc_client_server.go:155 +0x33a
github.com/seaweedfs/seaweedfs/weed/mount.(*WFS).WithFilerClient.func1()
/github/workspace/weed/mount/wfs_filer_client.go:25 +0x14c
github.com/seaweedfs/seaweedfs/weed/util.Retry({0x489a10c, 0xa}, 0xc00098fcf8)
/github/workspace/weed/util/retry.go:16 +0xa7
github.com/seaweedfs/seaweedfs/weed/mount.(*WFS).WithFilerClient(0x0?, 0x30?, 0xc00056a568?)
/github/workspace/weed/mount/wfs_filer_client.go:18 +0x65
github.com/seaweedfs/seaweedfs/weed/pb.WithFilerClientFollowMetadata({0x50f5898, 0xc000e2c180}, 0xc00101e000, 0xc000d22030)
/github/workspace/weed/pb/filer_pb_tail.go:51 +0x87
github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.SubscribeMetaEvents.func2()
/github/workspace/weed/mount/meta_cache/meta_cache_subscribe.go:115 +0xcb
github.com/seaweedfs/seaweedfs/weed/util.RetryUntil({0x48b8b35, 0x11}, 0xc00098fef0, 0x4af0048)
/github/workspace/weed/util/retry.go:64 +0x4e
github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.SubscribeMetaEvents(0xc000d1d980, 0x9d1f90fb, {0x50f5898, 0xc000e2c180}, {0x7ffdf6f98dca,
0x4}, 0x17fcf8b7c7ecf8cf, {0xc0000ac208, 0x1, 0x1})
/github/workspace/weed/mount/meta_cache/meta_cache_subscribe.go:113 +0x39b
created by github.com/seaweedfs/seaweedfs/weed/mount.(*WFS).StartBackgroundTasks in goroutine 1
/github/workspace/weed/mount/weedfs.go:150 +0x146
2024-10-09 22:46:00 -07:00
Spencer Hachmeister
1cf433abf2
feat: Add support for "custom" dataDirs type for volume server in kubernetes helm chart ( #6094 )
2024-10-08 18:53:53 -07:00
dependabot[bot]
4534976c31
chore(deps): bump golang.org/x/image from 0.18.0 to 0.21.0 ( #6099 )
...
Bumps [golang.org/x/image](https://github.com/golang/image ) from 0.18.0 to 0.21.0.
- [Commits](https://github.com/golang/image/compare/v0.18.0...v0.21.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/image
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-07 10:52:25 -07:00
dependabot[bot]
460e637244
chore(deps): bump github.com/prometheus/client_golang from 1.20.3 to 1.20.4 ( #6097 )
...
chore(deps): bump github.com/prometheus/client_golang
Bumps [github.com/prometheus/client_golang](https://github.com/prometheus/client_golang ) from 1.20.3 to 1.20.4.
- [Release notes](https://github.com/prometheus/client_golang/releases )
- [Changelog](https://github.com/prometheus/client_golang/blob/main/CHANGELOG.md )
- [Commits](https://github.com/prometheus/client_golang/compare/v1.20.3...v1.20.4 )
---
updated-dependencies:
- dependency-name: github.com/prometheus/client_golang
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-07 10:33:51 -07:00
dependabot[bot]
559cfc1fe0
chore(deps): bump docker/setup-buildx-action from 3.6.1 to 3.7.1 ( #6103 )
...
Bumps [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action ) from 3.6.1 to 3.7.1.
- [Release notes](https://github.com/docker/setup-buildx-action/releases )
- [Commits](988b5a0280...c47758b77c
)
---
updated-dependencies:
- dependency-name: docker/setup-buildx-action
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-07 10:32:57 -07:00
dependabot[bot]
13501cacd1
chore(deps): bump wangyoucao577/go-release-action from 1.51 to 1.52 ( #6102 )
...
Bumps [wangyoucao577/go-release-action](https://github.com/wangyoucao577/go-release-action ) from 1.51 to 1.52.
- [Release notes](https://github.com/wangyoucao577/go-release-action/releases )
- [Commits](6ac7dba1f9...2aa2977ad6
)
---
updated-dependencies:
- dependency-name: wangyoucao577/go-release-action
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-07 10:32:48 -07:00
dependabot[bot]
7a23784473
chore(deps): bump github.com/arangodb/go-driver from 1.6.2 to 1.6.4 ( #6100 )
...
Bumps [github.com/arangodb/go-driver](https://github.com/arangodb/go-driver ) from 1.6.2 to 1.6.4.
- [Release notes](https://github.com/arangodb/go-driver/releases )
- [Changelog](https://github.com/arangodb/go-driver/blob/master/CHANGELOG.md )
- [Commits](https://github.com/arangodb/go-driver/compare/v1.6.2...v1.6.4 )
---
updated-dependencies:
- dependency-name: github.com/arangodb/go-driver
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-07 10:32:29 -07:00
dependabot[bot]
e845218d7c
chore(deps): bump golang.org/x/net from 0.29.0 to 0.30.0 ( #6098 )
...
Bumps [golang.org/x/net](https://github.com/golang/net ) from 0.29.0 to 0.30.0.
- [Commits](https://github.com/golang/net/compare/v0.29.0...v0.30.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/net
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-07 10:32:14 -07:00
chrislu
82ed61c655
3.76
2024-10-06 19:37:03 -07:00
chrislu
c0e36231ad
use only one metadata follow process
2024-10-06 12:55:19 -07:00
Konstantin Lebedev
44b275879b
[s3] add {Get,Put,Delete}BucketTagging and PublicAccessBlock Handlers ( #6088 )
...
* add {Get,Put,Delete}BucketTagging Handlers
* s3 add skip bucket PublicAccessBlock handlers
---------
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2024-10-04 10:59:14 -07:00
chrislu
a3a8f6217e
fix
2024-10-03 09:03:17 -07:00
chrislu
117c3aebda
3.75
2024-10-03 08:33:35 -07:00
Konstantin Lebedev
a3556acd98
[s3] add skip bucket encryption handlers ( #6091 )
...
s3 add skip bucket encryption handlers
2024-10-03 08:10:43 -07:00
Er2
5644bc8f01
s3api: Fix signature v4 with reverse proxy at sub-path ( #6092 )
2024-10-03 08:08:19 -07:00
ayzatziko
416cc58cce
k8s/charts/seaweedfs/templates: s3 deployment: rm blocking matchLabel ( #6090 )
2024-10-03 06:33:32 -07:00
chrislu
ff47956530
add helper functions
2024-10-03 00:13:46 -07:00
chrislu
11e53dd8ef
skip error if conf file is not created
2024-10-01 22:46:48 -07:00
chrislu
f747767aa1
support load balancer in front of s3
2024-10-01 12:57:45 -07:00
chrislu
7dd480acad
handle missing leading zero padding in replica
2024-10-01 10:16:21 -07:00
chrislu
e3fa87bcc1
3.74
2024-09-30 11:29:01 -07:00
dependabot[bot]
35028818af
chore(deps): bump github.com/rclone/rclone from 1.68.0 to 1.68.1 ( #6084 )
...
Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone ) from 1.68.0 to 1.68.1.
- [Release notes](https://github.com/rclone/rclone/releases )
- [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md )
- [Commits](https://github.com/rclone/rclone/compare/v1.68.0...v1.68.1 )
---
updated-dependencies:
- dependency-name: github.com/rclone/rclone
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-30 11:18:38 -07:00
dependabot[bot]
e4c27de1ec
chore(deps): bump google.golang.org/api from 0.198.0 to 0.199.0 ( #6083 )
...
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client ) from 0.198.0 to 0.199.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases )
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md )
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.198.0...v0.199.0 )
---
updated-dependencies:
- dependency-name: google.golang.org/api
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-30 11:18:26 -07:00
dependabot[bot]
15f062d20f
chore(deps): bump github.com/hanwen/go-fuse/v2 from 2.5.1 to 2.6.1 ( #6082 )
...
Bumps [github.com/hanwen/go-fuse/v2](https://github.com/hanwen/go-fuse ) from 2.5.1 to 2.6.1.
- [Commits](https://github.com/hanwen/go-fuse/compare/v2.5.1...v2.6.1 )
---
updated-dependencies:
- dependency-name: github.com/hanwen/go-fuse/v2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-30 11:18:14 -07:00
dependabot[bot]
989b1a8bba
chore(deps): bump github.com/schollz/progressbar/v3 from 3.14.4 to 3.16.0 ( #6081 )
...
chore(deps): bump github.com/schollz/progressbar/v3
Bumps [github.com/schollz/progressbar/v3](https://github.com/schollz/progressbar ) from 3.14.4 to 3.16.0.
- [Release notes](https://github.com/schollz/progressbar/releases )
- [Commits](https://github.com/schollz/progressbar/compare/v3.14.4...v3.16.0 )
---
updated-dependencies:
- dependency-name: github.com/schollz/progressbar/v3
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-30 11:17:36 -07:00
dependabot[bot]
ff20e1dfbb
chore(deps): bump google.golang.org/grpc from 1.66.2 to 1.67.0 ( #6080 )
...
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go ) from 1.66.2 to 1.67.0.
- [Release notes](https://github.com/grpc/grpc-go/releases )
- [Commits](https://github.com/grpc/grpc-go/compare/v1.66.2...v1.67.0 )
---
updated-dependencies:
- dependency-name: google.golang.org/grpc
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-30 11:17:24 -07:00
dependabot[bot]
53ea035aea
chore(deps): bump docker/build-push-action from 6.7.0 to 6.9.0 ( #6079 )
...
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 6.7.0 to 6.9.0.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](5cd11c3a4c...4f58ea7922
)
---
updated-dependencies:
- dependency-name: docker/build-push-action
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-30 11:17:13 -07:00
chrislu
cdd7fa81ab
fix help message
2024-09-29 21:53:07 -07:00
chrislu
20929f2a57
adjust resource heavy for volume.fix.replication
2024-09-29 11:32:18 -07:00
chrislu
6564ceda91
skip resource heavy commands from running on master nodes
2024-09-29 10:51:17 -07:00
chrislu
ec30a504ba
refactor
2024-09-29 10:38:22 -07:00
chrislu
9cd263b2ce
refactor
2024-09-29 10:35:53 -07:00
chrislu
701abbb9df
add IsResourceHeavy() to command interface
2024-09-28 20:23:01 -07:00
coffeecloudgit
dad3a26fb6
Update volume_grpc_erasure_coding.go , fix no space left bug ( #6077 )
2024-09-27 12:04:27 -07:00
Konstantin Lebedev
bae93e611d
[filer] avoid 500 if table doesn't exist ( #6075 )
2024-09-27 07:15:54 -07:00
Andrei Kvapil
3ef716409e
Bump COSI-driver version v0.1.2 ( #6074 )
2024-09-27 07:03:26 -07:00
coffeecloudgit
6cbce110d5
Update volume_grpc_erasure_coding.go ( #6073 )
2024-09-27 07:02:30 -07:00
Neo
aa61824442
master:fix empty target in Build() ( #6069 )
2024-09-27 00:45:18 -07:00
Max Denushev
f1e700ce2f
Fix/copy before delete replication ( #6064 )
...
* fix(shell): volume.fix.replication misplaced volumes unsatisfying replication factor
* fix(shell): simplify replication check
* fix(shell): add test for satisfyReplicaCurrentLocation
2024-09-26 08:34:13 -07:00
steve.wei
ae8c6d95a6
fix: Prevent potential metadata change events from being lost. ( #6066 )
2024-09-26 08:31:57 -07:00
LHHDZ
4dc33cc143
fix unclaimed spaces calculation when volumePreallocate is enabled ( #6063 )
...
the calculation of `unclaimedSpaces` only needs to subtract `unusedSpace` when `preallocate` is not enabled.
Signed-off-by: LHHDZ <shichanglin5@qq.com>
2024-09-24 23:04:18 -07:00
Max Denushev
d056c0ddf2
fix(volume): don't persist RO state in specific cases ( #6058 )
...
* fix(volume): don't persist RO state in specific cases
* fix(volume): writable always persist
2024-09-24 16:15:54 -07:00
dependabot[bot]
c96b2ce8e5
chore(deps): bump cloud.google.com/go/pubsub from 1.42.0 to 1.43.0 ( #6053 )
...
Bumps [cloud.google.com/go/pubsub](https://github.com/googleapis/google-cloud-go ) from 1.42.0 to 1.43.0.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases )
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md )
- [Commits](https://github.com/googleapis/google-cloud-go/compare/pubsub/v1.42.0...pubsub/v1.43.0 )
---
updated-dependencies:
- dependency-name: cloud.google.com/go/pubsub
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-23 08:51:21 -07:00
zemul
028ebb1d0d
Feat:merge small chunk ( #6049 )
...
* fix:mount deadlock
* feat: merge small chunk
* adjust MergeChunkMinCount
* fix
---------
Co-authored-by: zemul <zhouzemiao@ihuman.com>
2024-09-23 08:51:03 -07:00
dependabot[bot]
4c1e23ad00
chore(deps): bump golang.org/x/tools from 0.24.0 to 0.25.0 ( #6054 )
...
Bumps [golang.org/x/tools](https://github.com/golang/tools ) from 0.24.0 to 0.25.0.
- [Release notes](https://github.com/golang/tools/releases )
- [Commits](https://github.com/golang/tools/compare/v0.24.0...v0.25.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/tools
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-23 08:42:29 -07:00
dependabot[bot]
a3fc985c90
chore(deps): bump github.com/aws/aws-sdk-go-v2 from 1.30.5 to 1.31.0 ( #6052 )
...
Bumps [github.com/aws/aws-sdk-go-v2](https://github.com/aws/aws-sdk-go-v2 ) from 1.30.5 to 1.31.0.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases )
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/v1.30.5...v1.31.0 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-23 08:42:16 -07:00