seaweedfs/docker
Chris Lu 580940bf82
Merge accumulated changes related to message queue (#5098)
* balance partitions on brokers

* prepare topic partition first and then publish, move partition

* purge unused APIs

* clean up

* adjust logs

* add BalanceTopics() grpc API

* configure topic

* configure topic command

* refactor

* repair missing partitions

* sequence of operations to ensure ordering

* proto to close publishers and consumers

* rename file

* topic partition versioned by unixTimeNs

* create local topic partition

* close publishers

* randomize the client name

* wait until no publishers

* logs

* close stop publisher channel

* send last ack

* comments

* comment

* comments

* support list of brokers

* add cli options

* Update .gitignore

* logs

* return io.eof directly

* refactor

* optionally create topic

* refactoring

* detect consumer disconnection

* sub client wait for more messages

* subscribe by time stamp

* rename

* rename to sub_balancer

* rename

* adjust comments

* rename

* fix compilation

* rename

* rename

* SubscriberToSubCoordinator

* sticky rebalance

* go fmt

* add tests

* balance partitions on brokers

* prepare topic partition first and then publish, move partition

* purge unused APIs

* clean up

* adjust logs

* add BalanceTopics() grpc API

* configure topic

* configure topic command

* refactor

* repair missing partitions

* sequence of operations to ensure ordering

* proto to close publishers and consumers

* rename file

* topic partition versioned by unixTimeNs

* create local topic partition

* close publishers

* randomize the client name

* wait until no publishers

* logs

* close stop publisher channel

* send last ack

* comments

* comment

* comments

* support list of brokers

* add cli options

* Update .gitignore

* logs

* return io.eof directly

* refactor

* optionally create topic

* refactoring

* detect consumer disconnection

* sub client wait for more messages

* subscribe by time stamp

* rename

* rename to sub_balancer

* rename

* adjust comments

* rename

* fix compilation

* rename

* rename

* SubscriberToSubCoordinator

* sticky rebalance

* go fmt

* add tests

* tracking topic=>broker

* merge

* comment
2023-12-11 12:05:54 -08:00
..
compose Merge accumulated changes related to message queue (#5098) 2023-12-11 12:05:54 -08:00
nginx docker-compose 2021-01-17 18:33:14 +05:00
prometheus stats master_replica_placement_mismatch 2022-06-10 15:30:40 +05:00
Dockerfile.e2e Add an End-to-End workflow for FUSE mount (#3562) 2022-08-31 09:27:53 -07:00
Dockerfile.go_build golang up version to 1.21.3 (#4911) 2023-10-13 05:31:43 -07:00
Dockerfile.local Add an End-to-End workflow for FUSE mount (#3562) 2022-08-31 09:27:53 -07:00
Dockerfile.rocksdb_dev_env golang up version to 1.21.3 (#4911) 2023-10-13 05:31:43 -07:00
Dockerfile.rocksdb_large golang up version to 1.21.3 (#4911) 2023-10-13 05:31:43 -07:00
Dockerfile.rocksdb_large_local add tmux for dev 2022-09-01 14:47:45 -07:00
Dockerfile.s3tests avoid Dockerfile Entrypoint: "file not found" (#3430) 2022-08-11 15:07:44 -07:00
entrypoint.sh feat: Send commands to weed shell from the docker image. 2022-06-01 15:47:10 -07:00
filer_rocksdb.toml add filer.toml for rocksdb to docker image for rocksdb 2022-02-09 00:12:53 -08:00
filer.toml filer: default to leveldb2 2019-06-30 00:44:57 -07:00
Makefile fix: make dev_tls with volume https (#4866) 2023-09-25 06:47:38 -07:00
README.md refactor(compose)!: upgrade to v2 closes #3699 (#3705) 2022-10-16 14:02:33 -07:00
seaweedfs-compose.yml refactor(compose)!: upgrade to v2 closes #3699 (#3705) 2022-10-16 14:02:33 -07:00
seaweedfs-dev-compose.yml refactor(compose)!: upgrade to v2 closes #3699 (#3705) 2022-10-16 14:02:33 -07:00
seaweedfs.sql filer.store.mysql: Use utf8mb4 instead of 3 byte UTF8 (#4094) 2023-01-01 05:07:53 -08:00

Docker

Compose V2

SeaweedFS now uses the v2 syntax docker compose

If you rely on using Docker Compose as docker-compose (with a hyphen), you can set up Compose V2 to act as a drop-in replacement of the previous docker-compose. Refer to the Installing Compose section for detailed instructions on upgrading.

Confirm your system has docker compose v2 with a version check

$ docker compose version
Docker Compose version v2.10.2

Try it out


wget https://raw.githubusercontent.com/seaweedfs/seaweedfs/master/docker/seaweedfs-compose.yml

docker compose -f seaweedfs-compose.yml -p seaweedfs up

Try latest tip


wget https://raw.githubusercontent.com/seaweedfs/seaweedfs/master/docker/seaweedfs-dev-compose.yml

docker compose -f seaweedfs-dev-compose.yml -p seaweedfs up

Local Development

cd $GOPATH/src/github.com/seaweedfs/seaweedfs/docker
make

S3 cmd

list

s3cmd --no-ssl --host=127.0.0.1:8333 ls s3://

Build and push a multiarch build

Make sure that docker buildx is supported (might be an experimental docker feature)

BUILDER=$(docker buildx create --driver docker-container --use)
docker buildx build --pull --push --platform linux/386,linux/amd64,linux/arm64,linux/arm/v7,linux/arm/v6 . -t chrislusf/seaweedfs
docker buildx stop $BUILDER

Minio debugging

mc config host add local http://127.0.0.1:9000 some_access_key1 some_secret_key1
mc admin trace --all --verbose local