chrislu
f07875e8e1
send flush message to follower before shutting down logBuffer
2024-04-01 16:01:26 -07:00
Nikita Borzykh
df9031e19a
fix: ensure complete gRPC stream consumption in doListFilerEntries to prevent context canceled errors. ( #5441 )
2024-04-01 15:55:16 -07:00
chrislu
e568e742c9
renaming
2024-04-01 15:02:52 -07:00
dependabot[bot]
94008a84a4
chore(deps): bump github.com/schollz/progressbar/v3 from 3.14.1 to 3.14.2 ( #5453 )
2024-04-01 09:56:07 -07:00
dependabot[bot]
2fc37db77e
chore(deps): bump go.etcd.io/etcd/client/pkg/v3 from 3.5.12 to 3.5.13 ( #5452 )
2024-04-01 09:55:28 -07:00
dependabot[bot]
53fdda82f0
chore(deps): bump github.com/aws/aws-sdk-go-v2 from 1.26.0 to 1.26.1 ( #5451 )
2024-04-01 09:55:11 -07:00
dependabot[bot]
fab5f66a95
chore(deps): bump github.com/linxGnu/grocksdb from 1.8.12 to 1.8.14 ( #5450 )
2024-04-01 09:02:26 -07:00
dependabot[bot]
c18a4c6911
chore(deps): bump github.com/go-sql-driver/mysql from 1.8.0 to 1.8.1 ( #5449 )
2024-04-01 09:01:57 -07:00
dependabot[bot]
d41c1c2956
chore(deps): bump github.com/viant/ptrie from 0.3.0 to 0.3.1 ( #5447 )
2024-04-01 09:01:36 -07:00
dependabot[bot]
d6149f87a3
chore(deps): bump github.com/cenkalti/backoff/v4 from 4.2.1 to 4.3.0 ( #5446 )
2024-04-01 09:01:18 -07:00
dependabot[bot]
ef06d6f074
chore(deps): bump google.golang.org/api from 0.169.0 to 0.172.0 ( #5448 )
2024-04-01 08:59:56 -07:00
dependabot[bot]
2e5aa8d03b
chore(deps): bump actions/dependency-review-action from 4.2.4 to 4.2.5 ( #5445 )
2024-04-01 08:27:33 -07:00
chrislu
47975e75bf
purge old code
2024-03-31 17:49:34 -07:00
chrislu
237e68059d
shutdown follower if no clients, not only publishers
...
to avoid overhead when a publisher repeatedly send one message and close
2024-03-31 17:45:26 -07:00
chrislu
66a878af39
add control message to data message
2024-03-31 16:35:46 -07:00
chrislu
546ae87c39
send is_close message to broker
2024-03-31 01:28:40 -07:00
chrislu
c9df613b6b
add publisher name for debugging
2024-03-31 00:19:16 -07:00
chrislu
ca4f89a6f6
simplify
2024-03-30 20:37:57 -07:00
chrislu
0d55bddc75
logs
2024-03-30 20:37:46 -07:00
Nikita Borzykh
829c0da381
fix: adjust condition in prefixFilterEntries prevent infinite loop ( #5440 )
2024-03-30 14:47:00 -07:00
Konstantin Lebedev
f9ec92dd83
[tests] add action s3 tests ( #5427 )
2024-03-29 07:57:27 -07:00
Konstantin Lebedev
9c1e0f5811
[master] grow volumes if no writable volumes in current dataCenter ( #5434 )
...
* grow volumes if no writable volumes in current dataCenter
https://github.com/seaweedfs/seaweedfs/issues/3886
* fix tests with volume grow
* automatic volume grow one volume
* add ErrorChunkAssign metrics
2024-03-29 00:38:27 -07:00
Konstantin Lebedev
df40908e57
fix panic 5435 ( #5436 )
2024-03-28 16:17:59 -07:00
chrislu
13b7c7b366
Merge branch 'master' into mq-subscribe
2024-03-27 23:57:00 -07:00
chrislu
e3c8be7f89
LocalPartition shutdown
2024-03-27 23:55:06 -07:00
chrislu
ab9fc0ad70
simplify
2024-03-27 23:42:19 -07:00
chrislu
7463058299
change visibility
2024-03-27 23:11:35 -07:00
chrislu
dab5454332
publish and send to follower
2024-03-27 23:10:24 -07:00
chrislu
f249f831b1
MaybeShutdownLocalPartition refactor
2024-03-27 23:02:51 -07:00
chrislu
2a0ab7e90d
fix
2024-03-27 22:59:50 -07:00
chrislu
059a120708
refactor
2024-03-27 22:58:20 -07:00
chrislu
7d87c1d2bb
refactor
2024-03-27 22:48:37 -07:00
chrislu
6aa804b368
lock instead of RLock, to prevent racing condition
...
https://github.com/seaweedfs/seaweedfs/discussions/5432#discussioncomment-8933608
2024-03-27 16:05:11 -07:00
chrislu
5cc94a05b9
separate goroutine to send ack to publisher
2024-03-27 10:27:08 -07:00
chrislu
17806cde2a
separate context
...
If using the same context, the downstream grpc would be cancelled when the parent grpc is cancelled.
2024-03-27 10:24:57 -07:00
chrislu
f67c8309d8
rename
2024-03-26 21:52:12 -07:00
chrislu
7d69552974
log server list
2024-03-26 21:51:28 -07:00
chrislu
36fec34c47
print only adapted url
...
fix https://github.com/seaweedfs/seaweedfs/issues/5424
2024-03-25 12:50:43 -07:00
chrislu
707ff536a3
Merge branch 'master' into mq-subscribe
2024-03-25 11:21:19 -07:00
dependabot[bot]
8b3756b815
chore(deps): bump github.com/aws/aws-sdk-go-v2 from 1.25.3 to 1.26.0 ( #5422 )
...
Bumps [github.com/aws/aws-sdk-go-v2](https://github.com/aws/aws-sdk-go-v2 ) from 1.25.3 to 1.26.0.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases )
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/v1.25.3...v1.26.0 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-25 10:10:35 -07:00
dependabot[bot]
14775a42f0
chore(deps): bump github.com/hashicorp/raft from 1.6.0 to 1.6.1 ( #5420 )
...
Bumps [github.com/hashicorp/raft](https://github.com/hashicorp/raft ) from 1.6.0 to 1.6.1.
- [Release notes](https://github.com/hashicorp/raft/releases )
- [Changelog](https://github.com/hashicorp/raft/blob/main/CHANGELOG.md )
- [Commits](https://github.com/hashicorp/raft/compare/v1.6.0...v1.6.1 )
---
updated-dependencies:
- dependency-name: github.com/hashicorp/raft
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-25 10:10:24 -07:00
dependabot[bot]
d48043be09
chore(deps): bump gocloud.dev from 0.36.0 to 0.37.0 ( #5423 )
...
Bumps [gocloud.dev](https://github.com/google/go-cloud ) from 0.36.0 to 0.37.0.
- [Release notes](https://github.com/google/go-cloud/releases )
- [Commits](https://github.com/google/go-cloud/compare/v0.36.0...v0.37.0 )
---
updated-dependencies:
- dependency-name: gocloud.dev
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-25 09:52:04 -07:00
dependabot[bot]
f3599c9252
chore(deps): bump actions/dependency-review-action from 4.1.3 to 4.2.4 ( #5418 )
...
Bumps [actions/dependency-review-action](https://github.com/actions/dependency-review-action ) from 4.1.3 to 4.2.4.
- [Release notes](https://github.com/actions/dependency-review-action/releases )
- [Commits](9129d7d40b...733dd5d4a5
)
---
updated-dependencies:
- dependency-name: actions/dependency-review-action
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-25 08:27:45 -07:00
chrislu
aed6fdffd2
fix nil volume data backend
...
fix https://github.com/seaweedfs/seaweedfs/issues/5417
2024-03-25 08:19:31 -07:00
chrislu
d6a066495b
adjust logs
2024-03-25 08:15:47 -07:00
chrislu
1b1b96ea1e
close local partition if no more publishers and subscribers
2024-03-24 21:10:02 -07:00
Nikita Borzykh
9ca871af53
Move ListDirectoryEntries logic to ListDirectoryPrefixedEntries in etcd meta storage backend ( #5416 )
...
Move ListDirectoryEntries logic to ListDirectoryPrefixedEntries
2024-03-24 14:08:54 -07:00
chrislu
4f5c4c3388
refactor
2024-03-24 13:07:51 -07:00
chrislu
d558a58946
refactor
2024-03-24 13:04:59 -07:00
chrislu
205d2285f3
setup follower by publisher
...
* the subscriber would getOrGen a local partition and wait
* the publisher would getOrGen a local partition. If localPartition follower is not setup, and init message has follower info, it would create followers based on init.Messages.
2024-03-24 12:57:09 -07:00