Lisandro Pin
559a1fd0f4
Improve EC shards rebalancing logic across nodes ( #6297 )
...
* Improve EC shards rebalancing logic across nodes.
- Favor target nodes with less preexisting shards, to ensure a fair distribution.
- Randomize selection when multiple possible target nodes are available.
- Add logic to account for replication settings when selecting target nodes (currently disabled).
* Fix minor test typo.
* Clarify internal error messages for `pickEcNodeToBalanceShardsInto()`.
2024-11-27 11:51:57 -08:00
steve.wei
88fa64a01a
change comment for expect header ( #6289 )
...
* remove case of expect
* Set the default value of the Expect header for compatibility.
2024-11-26 08:35:41 -08:00
Konstantin Lebedev
e2e97db917
[master] avoid timeout when assigning for main request with filter by DC or rack ( #6291 )
...
* avoid timeout when assigning for main request with filter by DC or rack
https://github.com/seaweedfs/seaweedfs/issues/6290
* use constant NoWritableVolumes
2024-11-26 08:33:31 -08:00
Konstantin Lebedev
fec88e64eb
[master] update LastLeaderChangeTime for hashicorp raft ( #6292 )
2024-11-26 08:02:45 -08:00
Trim21
d43fa07f06
use readable bytes size string in shell output ( #6288 )
2024-11-25 17:25:17 -08:00
dependabot[bot]
f965af51b7
chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.66.3 to 1.69.0 ( #6287 )
...
chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3
Bumps [github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2 ) from 1.66.3 to 1.69.0.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases )
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/service/s3/v1.66.3...service/s3/v1.69.0 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/service/s3
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-25 14:35:21 -08:00
dependabot[bot]
11042ddb71
chore(deps): bump docker/metadata-action from 5.5.1 to 5.6.1 ( #6281 )
...
Bumps [docker/metadata-action](https://github.com/docker/metadata-action ) from 5.5.1 to 5.6.1.
- [Release notes](https://github.com/docker/metadata-action/releases )
- [Commits](8e5442c4ef...369eb591f4
2024-11-25 14:27:46 -08:00
dependabot[bot]
e4abb6cbea
chore(deps): bump github.com/hanwen/go-fuse/v2 from 2.6.1 to 2.7.1 ( #6283 )
...
Bumps [github.com/hanwen/go-fuse/v2](https://github.com/hanwen/go-fuse ) from 2.6.1 to 2.7.1.
- [Commits](https://github.com/hanwen/go-fuse/compare/v2.6.1...v2.7.1 )
---
updated-dependencies:
- dependency-name: github.com/hanwen/go-fuse/v2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-25 14:26:51 -08:00
dependabot[bot]
19d01c02c6
chore(deps): bump github.com/stretchr/testify from 1.9.0 to 1.10.0 ( #6284 )
...
Bumps [github.com/stretchr/testify](https://github.com/stretchr/testify ) from 1.9.0 to 1.10.0.
- [Release notes](https://github.com/stretchr/testify/releases )
- [Commits](https://github.com/stretchr/testify/compare/v1.9.0...v1.10.0 )
---
updated-dependencies:
- dependency-name: github.com/stretchr/testify
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-25 14:26:44 -08:00
dependabot[bot]
d54fbca481
chore(deps): bump github.com/aws/aws-sdk-go-v2/credentials from 1.17.45 to 1.17.46 ( #6285 )
...
chore(deps): bump github.com/aws/aws-sdk-go-v2/credentials
Bumps [github.com/aws/aws-sdk-go-v2/credentials](https://github.com/aws/aws-sdk-go-v2 ) from 1.17.45 to 1.17.46.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases )
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/credentials/v1.17.45...credentials/v1.17.46 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/credentials
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-25 14:26:37 -08:00
dependabot[bot]
29aaf3e68e
chore(deps): bump google.golang.org/protobuf from 1.35.1 to 1.35.2 ( #6286 )
...
Bumps google.golang.org/protobuf from 1.35.1 to 1.35.2.
---
updated-dependencies:
- dependency-name: google.golang.org/protobuf
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-25 14:26:29 -08:00
Konstantin Lebedev
8836fa19b6
use ShouldGrowVolumesByDcAndRack ( #6280 )
2024-11-25 09:30:37 -08:00
Konstantin Lebedev
167b50be88
fix missing register master metric MasterPickForWriteErrorCounter ( #6277 )
2024-11-25 08:59:11 -08:00
Trim21
fd6c787c02
fix EcVolumes sorting in volume UI ( #6275 )
...
* Update store_ec.go
* fix: EcVolume sorting not work
* use stdlib
* revert
2024-11-23 22:43:08 -08:00
chrislu
ccf1795e6f
wait a bit before getting the next volume id if the leader is recently elected
2024-11-23 19:58:45 -08:00
chrislu
04081128a9
use math rand v2
2024-11-21 08:54:03 -08:00
chrislu
54204bc89b
format error
2024-11-21 08:52:39 -08:00
Lisandro Pin
ca499de1cb
Improve EC shards rebalancing logic across racks ( #6270 )
...
Improve EC shards rebalancing logic across racks.
- Favor target shards with less preexisting shards, to ensure a fair distribution.
- Randomize selection when multiple possible target shards are available.
- Add logic to account for replication settings when selecting target shards (currently disabled).
2024-11-21 08:46:24 -08:00
Numblgw
e56327e3b0
ExclusiveLocker only create one renew goroutine ( #6269 )
...
Co-authored-by: liguowei <liguowei@xinye.com>
2024-11-21 08:27:12 -08:00
Numblgw
aebf3952b7
filer sync: source path and exclude path support dir suffix ( #6268 )
...
filer sync: source path and exclude paht support dir suffix
Co-authored-by: liguowei <liguowei@xinye.com>
2024-11-21 08:25:12 -08:00
Konstantin Lebedev
7fa4e5c2a1
[master] Revert back automatic volume grow in case of compensate for crowded volumes ( #6267 )
...
brought back the Automatic Volume Grow to compensate for crowded volumes
2024-11-21 08:19:19 -08:00
Konstantin Lebedev
a143c888e5
[shell] don't require lock when there are no changes for volume.fix.replication ( #6266 )
...
* don't require lock when there are no changes
* revert takeAction
2024-11-21 08:17:25 -08:00
Konstantin Lebedev
a49d9e020c
[master] avoid crowded more writable for auto grow ( #6214 )
...
avoid crowded more writable
https://github.com/seaweedfs/seaweedfs/issues/6121
2024-11-21 00:57:42 -08:00
chrislu
75f5afa571
fix compilation
2024-11-21 00:41:22 -08:00
chrislu
1c143cfcea
display actual offset value
2024-11-21 00:38:03 -08:00
chrislu
c9f3448692
ReadAt may return io.EOF t end of file
...
related to https://github.com/seaweedfs/seaweedfs/issues/6219
2024-11-21 00:37:38 -08:00
chrislu
be09d08eb6
adjust error message
2024-11-20 23:49:01 -08:00
chrislu
6b2612690b
consistent error message if auth is not setup
...
fix https://github.com/seaweedfs/seaweedfs/issues/6262
2024-11-20 23:11:18 -08:00
Konstantin Lebedev
254ed8897e
[shell] add noLock param for volume.move ( #6261 )
2024-11-20 08:35:24 -08:00
chrislu
96f1a2e01a
adjust error message
2024-11-19 14:16:06 -08:00
dependabot[bot]
bb37886f6a
chore(deps): bump github.com/rclone/rclone from 1.68.1 to 1.68.2 ( #6260 )
...
Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone ) from 1.68.1 to 1.68.2.
- [Release notes](https://github.com/rclone/rclone/releases )
- [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md )
- [Commits](https://github.com/rclone/rclone/compare/v1.68.1...v1.68.2 )
---
updated-dependencies:
- dependency-name: github.com/rclone/rclone
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-19 13:44:32 -08:00
chrislu
e28f55eb08
typo
2024-11-19 08:32:31 -08:00
chrislu
98f03862aa
rename
2024-11-19 08:31:54 -08:00
chrislu
07cf8cf22d
minor
2024-11-19 08:31:33 -08:00
Lisandro Pin
0d5393641e
Unify usage of shell.EcNode.dc as DataCenterId. ( #6258 )
2024-11-19 06:33:18 -08:00
chrislu
2caa0e3741
java 3.80
2024-11-18 22:41:59 -08:00
chrislu
bc7650bd61
adds more info on skipped volumes
2024-11-18 18:25:44 -08:00
Lisandro Pin
f2db746690
Introduce logic to resolve volume replica placement within EC rebalancing. ( #6254 )
...
* Rename `command_ec_encode_test.go` to `command_ec_common_test.go`.
All tests defined in this file are now for `command_ec_common.go`.
* Minor code cleanups.
- Fix broken `ec.balance` test.
- Rework integer ceiling division to not use floats, which can introduce precision errors.
* Introduce logic to resolve volume replica placement within EC rebalancing.
This will be used to make rebalancing logic topology-aware.
* Give shell.EcNode.dc a dedicated DataCenterId type.
2024-11-18 18:05:06 -08:00
chrislu
7b3c0e937f
3.80
2024-11-18 09:48:33 -08:00
dependabot[bot]
180f267867
chore(deps): bump github.com/linxGnu/grocksdb from 1.9.5 to 1.9.7 ( #6249 )
...
Bumps [github.com/linxGnu/grocksdb](https://github.com/linxGnu/grocksdb ) from 1.9.5 to 1.9.7.
- [Release notes](https://github.com/linxGnu/grocksdb/releases )
- [Commits](https://github.com/linxGnu/grocksdb/compare/v1.9.5...v1.9.7 )
---
updated-dependencies:
- dependency-name: github.com/linxGnu/grocksdb
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-18 09:37:06 -08:00
dependabot[bot]
b21f599cde
chore(deps): bump modernc.org/sqlite from 1.33.1 to 1.34.1 ( #6251 )
...
Bumps [modernc.org/sqlite](https://gitlab.com/cznic/sqlite ) from 1.33.1 to 1.34.1.
- [Commits](https://gitlab.com/cznic/sqlite/compare/v1.33.1...v1.34.1 )
---
updated-dependencies:
- dependency-name: modernc.org/sqlite
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-18 09:36:52 -08:00
dependabot[bot]
3fba0adc9d
chore(deps): bump github.com/aws/aws-sdk-go-v2/config from 1.28.0 to 1.28.4 ( #6252 )
...
chore(deps): bump github.com/aws/aws-sdk-go-v2/config
Bumps [github.com/aws/aws-sdk-go-v2/config](https://github.com/aws/aws-sdk-go-v2 ) from 1.28.0 to 1.28.4.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases )
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/v1.28.0...config/v1.28.4 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/config
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-18 09:36:43 -08:00
dependabot[bot]
f8f162aa72
chore(deps): bump go.etcd.io/etcd/client/v3 from 3.5.16 to 3.5.17 ( #6253 )
...
Bumps [go.etcd.io/etcd/client/v3](https://github.com/etcd-io/etcd ) from 3.5.16 to 3.5.17.
- [Release notes](https://github.com/etcd-io/etcd/releases )
- [Commits](https://github.com/etcd-io/etcd/compare/v3.5.16...v3.5.17 )
---
updated-dependencies:
- dependency-name: go.etcd.io/etcd/client/v3
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-18 09:36:31 -08:00
zemul
6d3e38f439
Adjust threshold config ( #6246 )
...
* fix:mount deadlock
* fix
---------
Co-authored-by: zemul <zhouzemiao@ihuman.com>
2024-11-17 20:51:26 -08:00
Kevin Bulteel
4a0dc883cf
Fix/parse upload filename ( #6241 )
...
* fix: parse filename in PUT + refactor
* fix: master iu public url with http
* fix: better parsing and handle disposition header
* fix: take mime type from file extension if not set
2024-11-15 11:25:18 -08:00
Omar Hamadeh
8ebbf37e8e
Add a loop to wait for master and filer services in post-install-bucket-hook ( #6240 )
...
Add a loop to wait for master and filer services before creating buckets
2024-11-15 11:15:33 -08:00
fo40225
008ac38ebc
fix java.lang.IllegalArgumentException: Comparison method violates its general contract! ( #6239 )
2024-11-14 17:26:50 -08:00
Max Denushev
a5fe6e21bc
feat(filer.backup): add ignore errors option ( #6235 )
...
* feat(filer.backup): add ignore errors option
* feat(filer.backup): fix 404 error wrap
* feat(filer.backup): fix wrapping function
* feat(filer.backup): fix wrapping errors in genProcessFunction
* Update weed/command/filer_backup.go
* Update weed/command/filer_backup.go
* Update weed/command/filer_backup.go
---------
Co-authored-by: Max Denushev <denushev@tochka.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2024-11-14 08:40:55 -08:00
Eugeniy E. Mikhailov
3003c9e17e
added backward compatible CRC check and extra explanatory comments ( #6233 )
2024-11-12 13:56:14 -08:00
dependabot[bot]
31d8907e77
chore(deps): bump github.com/golang-jwt/jwt/v4 from 4.5.0 to 4.5.1 ( #6231 )
...
Bumps [github.com/golang-jwt/jwt/v4](https://github.com/golang-jwt/jwt ) from 4.5.0 to 4.5.1.
- [Release notes](https://github.com/golang-jwt/jwt/releases )
- [Changelog](https://github.com/golang-jwt/jwt/blob/main/VERSION_HISTORY.md )
- [Commits](https://github.com/golang-jwt/jwt/compare/v4.5.0...v4.5.1 )
---
updated-dependencies:
- dependency-name: github.com/golang-jwt/jwt/v4
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-11 11:54:07 -08:00
