mirror/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-12-12 16:49:03 +08:00
Code Issues Packages Projects Releases Wiki Activity
9,963 Commits 32 Branches 296 Tags 150 MiB
580940bf82
Commit Graph

9963 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Chris Lu
580940bf82
Merge accumulated changes related to message queue (#5098) 
* balance partitions on brokers

* prepare topic partition first and then publish, move partition

* purge unused APIs

* clean up

* adjust logs

* add BalanceTopics() grpc API

* configure topic

* configure topic command

* refactor

* repair missing partitions

* sequence of operations to ensure ordering

* proto to close publishers and consumers

* rename file

* topic partition versioned by unixTimeNs

* create local topic partition

* close publishers

* randomize the client name

* wait until no publishers

* logs

* close stop publisher channel

* send last ack

* comments

* comment

* comments

* support list of brokers

* add cli options

* Update .gitignore

* logs

* return io.eof directly

* refactor

* optionally create topic

* refactoring

* detect consumer disconnection

* sub client wait for more messages

* subscribe by time stamp

* rename

* rename to sub_balancer

* rename

* adjust comments

* rename

* fix compilation

* rename

* rename

* SubscriberToSubCoordinator

* sticky rebalance

* go fmt

* add tests

* balance partitions on brokers

* prepare topic partition first and then publish, move partition

* purge unused APIs

* clean up

* adjust logs

* add BalanceTopics() grpc API

* configure topic

* configure topic command

* refactor

* repair missing partitions

* sequence of operations to ensure ordering

* proto to close publishers and consumers

* rename file

* topic partition versioned by unixTimeNs

* create local topic partition

* close publishers

* randomize the client name

* wait until no publishers

* logs

* close stop publisher channel

* send last ack

* comments

* comment

* comments

* support list of brokers

* add cli options

* Update .gitignore

* logs

* return io.eof directly

* refactor

* optionally create topic

* refactoring

* detect consumer disconnection

* sub client wait for more messages

* subscribe by time stamp

* rename

* rename to sub_balancer

* rename

* adjust comments

* rename

* fix compilation

* rename

* rename

* SubscriberToSubCoordinator

* sticky rebalance

* go fmt

* add tests

* tracking topic=>broker

* merge

* comment
 2023-12-11 12:05:54 -08:00
dependabot[bot]
8784553501 Bump github.com/rclone/rclone from 1.64.2 to 1.65.0 
Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone) from 1.64.2 to 1.65.0.
- [Release notes](https://github.com/rclone/rclone/releases)
- [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md)
- [Commits](https://github.com/rclone/rclone/compare/v1.64.2...v1.65.0)

---
updated-dependencies:
- dependency-name: github.com/rclone/rclone
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-11 11:32:04 -08:00
dependabot[bot]
157b36d59d Bump com.google.guava:guava in /other/java/client 
Bumps [com.google.guava:guava](https://github.com/google/guava) from 30.0-jre to 32.0.0-jre.
- [Release notes](https://github.com/google/guava/releases)
- [Commits](https://github.com/google/guava/commits)

---
updated-dependencies:
- dependency-name: com.google.guava:guava
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-11 11:14:02 -08:00
dependabot[bot]
70c735f6bb Bump actions/dependency-review-action from 3.1.3 to 3.1.4 
Bumps [actions/dependency-review-action](https://github.com/actions/dependency-review-action) from 3.1.3 to 3.1.4.
- [Release notes](https://github.com/actions/dependency-review-action/releases)
- [Commits](7bbfa034e7...01bc87099b)

---
updated-dependencies:
- dependency-name: actions/dependency-review-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-11 11:13:41 -08:00
dependabot[bot]
c68220af7e Bump actions/setup-python from 4 to 5 
Bumps [actions/setup-python](https://github.com/actions/setup-python) from 4 to 5.
- [Release notes](https://github.com/actions/setup-python/releases)
- [Commits](https://github.com/actions/setup-python/compare/v4...v5)

---
updated-dependencies:
- dependency-name: actions/setup-python
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-11 11:13:33 -08:00
dependabot[bot]
dc51d9a9a9 Bump actions/setup-go from 4.1.0 to 5.0.0 
Bumps [actions/setup-go](https://github.com/actions/setup-go) from 4.1.0 to 5.0.0.
- [Release notes](https://github.com/actions/setup-go/releases)
- [Commits](93397bea11...0c52d547c9)

---
updated-dependencies:
- dependency-name: actions/setup-go
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-11 11:13:24 -08:00
dependabot[bot]
1a6842c477 Bump gocloud.dev/pubsub/rabbitpubsub from 0.34.0 to 0.35.0 
Bumps [gocloud.dev/pubsub/rabbitpubsub](https://github.com/google/go-cloud) from 0.34.0 to 0.35.0.
- [Release notes](https://github.com/google/go-cloud/releases)
- [Commits](https://github.com/google/go-cloud/compare/v0.34.0...v0.35.0)

---
updated-dependencies:
- dependency-name: gocloud.dev/pubsub/rabbitpubsub
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-11 11:13:15 -08:00
dependabot[bot]
21af8d8778 Bump github.com/shirou/gopsutil/v3 from 3.23.9 to 3.23.11 
Bumps [github.com/shirou/gopsutil/v3](https://github.com/shirou/gopsutil) from 3.23.9 to 3.23.11.
- [Release notes](https://github.com/shirou/gopsutil/releases)
- [Commits](https://github.com/shirou/gopsutil/compare/v3.23.9...v3.23.11)

---
updated-dependencies:
- dependency-name: github.com/shirou/gopsutil/v3
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-11 11:13:06 -08:00
dependabot[bot]
f743df0f0b Bump go.mongodb.org/mongo-driver from 1.12.1 to 1.13.1 
Bumps [go.mongodb.org/mongo-driver](https://github.com/mongodb/mongo-go-driver) from 1.12.1 to 1.13.1.
- [Release notes](https://github.com/mongodb/mongo-go-driver/releases)
- [Commits](https://github.com/mongodb/mongo-go-driver/compare/v1.12.1...v1.13.1)

---
updated-dependencies:
- dependency-name: go.mongodb.org/mongo-driver
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-11 11:12:56 -08:00
dependabot[bot]
3407e28a78 Bump github.com/hanwen/go-fuse/v2 from 2.4.0 to 2.4.2 
Bumps [github.com/hanwen/go-fuse/v2](https://github.com/hanwen/go-fuse) from 2.4.0 to 2.4.2.
- [Commits](https://github.com/hanwen/go-fuse/compare/v2.4.0...v2.4.2)

---
updated-dependencies:
- dependency-name: github.com/hanwen/go-fuse/v2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-11 11:12:38 -08:00
Konstantin Lebedev
125ad8fe63 falls back to update only if error contains msg "duplicate entry" 
https://github.com/seaweedfs/seaweedfs/issues/5062
 2023-12-09 10:18:18 -08:00
chrislu
c1a6e624e5 Merge branch 'master' of https://github.com/seaweedfs/seaweedfs 2023-12-07 08:13:46 -08:00
chrislu
5fe4c04a1a add missing error in the log 
related to https://github.com/seaweedfs/seaweedfs/issues/5084
 2023-12-07 08:13:42 -08:00
Lars Lehtonen
43a5973a66 weed/storage: fix dropped test errors 2023-12-06 12:05:22 -08:00
Bálint József Jánvári
43a6b60375 Always include volumes in statefulsets 2023-12-05 22:39:01 -08:00
jerebear12
d5d9fbb8aa Add a way to use a JWT in an HTTP only cookie 
If a JWT is not included in the Authorization header or a query string, attempt to get a JWT from an HTTP only cookie.
 2023-12-05 08:57:01 -08:00
dependabot[bot]
4aeca48b6d Bump golang.org/x/image from 0.12.0 to 0.14.0 
Bumps [golang.org/x/image](https://github.com/golang/image) from 0.12.0 to 0.14.0.
- [Commits](https://github.com/golang/image/compare/v0.12.0...v0.14.0)

---
updated-dependencies:
- dependency-name: golang.org/x/image
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-04 11:00:02 -08:00
dependabot[bot]
fd6de32b53 Bump golang.org/x/tools from 0.14.0 to 0.16.0 
Bumps [golang.org/x/tools](https://github.com/golang/tools) from 0.14.0 to 0.16.0.
- [Release notes](https://github.com/golang/tools/releases)
- [Commits](https://github.com/golang/tools/compare/v0.14.0...v0.16.0)

---
updated-dependencies:
- dependency-name: golang.org/x/tools
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-04 10:51:51 -08:00
dependabot[bot]
31ca7bacea Bump docker/metadata-action from 5.0.0 to 5.3.0 
Bumps [docker/metadata-action](https://github.com/docker/metadata-action) from 5.0.0 to 5.3.0.
- [Release notes](https://github.com/docker/metadata-action/releases)
- [Commits](96383f4557...31cebacef4)

---
updated-dependencies:
- dependency-name: docker/metadata-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-04 10:50:55 -08:00
dependabot[bot]
14a4d5c24d Bump wangyoucao577/go-release-action from 1.40 to 1.41 
Bumps [wangyoucao577/go-release-action](https://github.com/wangyoucao577/go-release-action) from 1.40 to 1.41.
- [Release notes](https://github.com/wangyoucao577/go-release-action/releases)
- [Commits](2ac3035fa4...0a0935d79e)

---
updated-dependencies:
- dependency-name: wangyoucao577/go-release-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-04 10:50:47 -08:00
dependabot[bot]
e47ec67dd8 Bump github.com/go-redsync/redsync/v4 from 4.10.0 to 4.11.0 
Bumps [github.com/go-redsync/redsync/v4](https://github.com/go-redsync/redsync) from 4.10.0 to 4.11.0.
- [Release notes](https://github.com/go-redsync/redsync/releases)
- [Commits](https://github.com/go-redsync/redsync/compare/v4.10.0...v4.11.0)

---
updated-dependencies:
- dependency-name: github.com/go-redsync/redsync/v4
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-04 10:50:31 -08:00
dependabot[bot]
e792eadf13 Bump golang.org/x/sys from 0.14.0 to 0.15.0 
Bumps [golang.org/x/sys](https://github.com/golang/sys) from 0.14.0 to 0.15.0.
- [Commits](https://github.com/golang/sys/compare/v0.14.0...v0.15.0)

---
updated-dependencies:
- dependency-name: golang.org/x/sys
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-04 10:50:11 -08:00
chrislu
556a242acf remove unused file 2023-11-30 08:20:01 -08:00
chrislu
756bcc032d adjust logs 2023-11-27 12:57:29 -08:00
Konstantin Lebedev
dd78397fea logging PickForWrite error 
https://github.com/seaweedfs/seaweedfs/issues/3886
 2023-11-27 12:56:15 -08:00
dependabot[bot]
fe3e7db9d1 Bump github.com/nats-io/nkeys from 0.4.5 to 0.4.6 
Bumps [github.com/nats-io/nkeys](https://github.com/nats-io/nkeys) from 0.4.5 to 0.4.6.
- [Release notes](https://github.com/nats-io/nkeys/releases)
- [Changelog](https://github.com/nats-io/nkeys/blob/main/.goreleaser.yml)
- [Commits](https://github.com/nats-io/nkeys/compare/v0.4.5...v0.4.6)

---
updated-dependencies:
- dependency-name: github.com/nats-io/nkeys
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-11-27 12:54:02 -08:00
dependabot[bot]
27f40fae0c Bump github.com/rdleal/intervalst from 1.2.0 to 1.2.1 
Bumps [github.com/rdleal/intervalst](https://github.com/rdleal/intervalst) from 1.2.0 to 1.2.1.
- [Commits](https://github.com/rdleal/intervalst/compare/v1.2.0...v1.2.1)

---
updated-dependencies:
- dependency-name: github.com/rdleal/intervalst
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-11-27 12:53:20 -08:00
dependabot[bot]
c8ff001b31 Bump github.com/aws/aws-sdk-go from 1.45.25 to 1.48.4 
Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go) from 1.45.25 to 1.48.4.
- [Release notes](https://github.com/aws/aws-sdk-go/releases)
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.45.25...v1.48.4)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-11-27 12:49:39 -08:00
dependabot[bot]
366ad5cfad Bump modernc.org/sqlite from 1.26.0 to 1.27.0 
Bumps [modernc.org/sqlite](https://gitlab.com/cznic/sqlite) from 1.26.0 to 1.27.0.
- [Commits](https://gitlab.com/cznic/sqlite/compare/v1.26.0...v1.27.0)

---
updated-dependencies:
- dependency-name: modernc.org/sqlite
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-11-27 12:40:28 -08:00
dependabot[bot]
b7b9f1c690 Bump github.com/aws/aws-sdk-go-v2 from 1.23.0 to 1.23.1 
Bumps [github.com/aws/aws-sdk-go-v2](https://github.com/aws/aws-sdk-go-v2) from 1.23.0 to 1.23.1.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases)
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/v1.23.0...v1.23.1)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-11-27 11:18:30 -08:00
chrislu
81f11883e3 go fmt 2023-11-26 11:47:20 -08:00
jessebot
666a22b980 fix defaults for serviceAccountName for each statefulset to follow exact from helm docs 
helm docs: https://helm.sh/docs/chart_template_guide/functions_and_pipelines/#using-the-default-function
 2023-11-26 09:26:38 -08:00
jessebot
d198fd8af7 fix when we create serviceAccount value for master and volume statefulsets to be when global.createClusterRole is set to true 2023-11-26 09:26:38 -08:00
jessebot
0709361ed2 fix duplicate service account name for filer 2023-11-26 09:26:38 -08:00
jessebot
c332832f0b prefer global.serviceAccountName when available for all statefulsets 2023-11-26 09:26:38 -08:00
jessebot
aff03c1d00 User global.serviceAccountName to populate ServiceAccount, ClusterRole, and ClusterRoleBinding 2023-11-26 09:26:38 -08:00
Max Roby
cf5703e86e existingConfigSecretshould now be consistently treated as a string in the post-install-hook 2023-11-24 06:40:19 -08:00
Max Roby
c479c05f6e revert debug changes i missed 2023-11-24 06:40:19 -08:00
Max Roby
d33de9f4db remove trailing spaces 2023-11-24 06:40:19 -08:00
Max Roby
aac2cd23c7 add a true flag to job command 2023-11-24 06:40:19 -08:00
Max Roby
e4cdfde944 add the secrets volumemount 2023-11-24 06:40:19 -08:00
Max Roby
2af6b13800 add a sercret volume mount 2023-11-24 06:40:19 -08:00
Max Roby
7a5d9d8690 bump chart version after rebase 2023-11-24 06:40:19 -08:00
Max Roby
c04284cdd7 remove user job since bucket job can now create public buckets, update values.yaml 2023-11-24 06:40:19 -08:00
Max Roby
b8bfd4411a add missing read action 2023-11-24 06:40:19 -08:00
Max Roby
f33f7c10f0 trying to get anonymous access for buckets working 2023-11-24 06:40:19 -08:00
Max Roby
ac6158818b fix issue with underscores versus dashes in secret name causing variable expansion failure 2023-11-24 06:40:19 -08:00
Max Roby
f7b98ea1fb fix uneeded quote usage 2023-11-24 06:40:19 -08:00
Max Roby
2920949def templates/post-install-user-hook.yaml 2023-11-24 06:40:19 -08:00
Max Roby
5db0064ffe update hook weight order and give descriptive names to jobs 2023-11-24 06:40:19 -08:00