1076 Commits

Author	SHA1	Message	Date
chrislu	2b580a7566	also migrate jsonpb	2022-08-17 12:42:03 -07:00
chrislu	eaeb141b09	move proto package	2022-08-17 12:05:07 -07:00
qzh	7fcfaf7bc9	fix(filer.sync): offset may be set to 0 (#3451) ... * fix(filer.sync): initializing the offset is related to the path * fix(filer.sync): the offset maybe to be set to 0. Co-authored-by: zhihao.qu <zhihao.qu@ly.com>	2022-08-15 23:43:52 -07:00
qzh	400f0c3e5d	fix(filer.sync): initializing the offset is related to the path (#3450) ... Co-authored-by: zhihao.qu <zhihao.qu@ly.com>	2022-08-15 21:56:47 -07:00
chrislu	67814a5c79	refactor and fix strings.Split	2022-08-07 01:34:32 -07:00
chrislu	1a4bf0dcb5	filer.sync: parallelize the filer.sync	2022-08-07 00:56:15 -07:00
chrislu	0e9478488d	filer.sync: fix when excluded paths is empty	2022-08-07 00:55:34 -07:00
LHHDZ	84ec68e11a	Add download speed limit support (#3408)	2022-08-05 01:16:42 -07:00
Konstantin Lebedev	4d08393b7c	filer prefer volume server in same data center (#3405) ... * initial prefer same data center https://github.com/seaweedfs/seaweedfs/issues/3404 * GetDataCenter * prefer same data center for ReplicationSource * GetDataCenterId * remove glog	2022-08-04 17:35:00 -07:00
Chris Lu	0bb3ba17ae	Merge pull request #3385 from Woellchen/feature/cluster-status-return-healthy ... Add healthy indicator for raft status	2022-07-30 11:55:30 -07:00
Patrick Schmidt	1a4a36d510	Add healthy indicator for raft status	2022-07-30 19:34:26 +02:00
chrislu	0423d50106	wip note	2022-07-30 09:36:27 -07:00
chrislu	0f50fcb96a	moving	2022-07-29 23:39:11 -07:00
chrislu	26dbc6c905	move to https://github.com/seaweedfs/seaweedfs	2022-07-29 00:17:28 -07:00
chrislu	74f60f246f	dynamically connect to a filer	2022-07-28 23:24:38 -07:00
chrislu	94b8c42b2c	clean up	2022-07-28 23:24:38 -07:00
chrislu	68065128b8	add dc and rack	2022-07-28 23:22:51 -07:00
chrislu	8d31e73ffd	mq broker adds data center and rack	2022-07-28 23:22:07 -07:00
chrislu	87ccef72db	cluster.ps can list brokers	2022-07-28 23:22:07 -07:00
chrislu	21b6b07dd8	renaming	2022-07-28 23:22:06 -07:00
chrislu	8ca7d1ef17	rename to SeaweedMQ	2022-07-28 23:22:06 -07:00
chrislu	ca836568ac	Merge branch 'master' of https://github.com/chrislusf/seaweedfs	2022-07-27 12:12:43 -07:00
chrislu	3828b8ce87	"github.com/chrislusf/raft" => "github.com/seaweedfs/raft"	2022-07-27 12:12:40 -07:00
Konstantin Lebedev	7e09a548a6	exclude directories to sync on filer	2022-07-27 19:22:57 +05:00
chrislu	64f3d6fb6e	metadata subscription uses client epoch	2022-07-23 10:50:28 -07:00
duanhongyi	1ceab96aba	filer tikv support tls	2022-07-08 14:23:06 +08:00
chrislu	b7de5c6c43	shell: remove unused filer parameter from shell.toml	2022-07-07 15:01:23 -07:00
Konstantin Lebedev	bcbdc4cb37	use const multipart uploads folder ... avoid error bucket NotEmpty if multipart uploads folder exist	2022-06-29 16:21:16 +05:00
guol-fnst	74c9f39d48	remove hdfs, add tikv for full version update	2022-06-28 12:35:07 +08:00
chrislu	4a65159250	fix reading time	2022-06-27 12:40:47 -07:00
yulai.li	af23e63e3f	Improve filer command help, add supported filer store list	2022-06-27 12:09:16 +08:00
yulai.li	46e0b629e5	Update tikv client version and add one PC support	2022-06-26 22:43:37 +08:00
chrislu	492da3dbce	master: put metadata under instance specific folder	2022-06-20 19:04:49 -07:00
chrislu	2295766e2c	Merge branch 'master' of https://github.com/chrislusf/seaweedfs	2022-06-20 14:16:18 -07:00
chrislu	1d0c53ea56	remote storage: stop supporting hdfs as a remote storage	2022-06-20 14:15:59 -07:00
Stephan	1eb7826909	Fix link to osxfuse github page	2022-06-20 22:36:07 +02:00
Chris Lu	d28f8bb88f	Merge pull request #3192 from guol-fnst/weed_update ... remove "weed" from UsageLine, or weed will not show usage of weed update	2022-06-16 22:58:29 -07:00
guol-fnst	c7c20881f5	remove "weed" from UsageLine, or weed will not show usage of weed update	2022-06-17 12:47:04 +08:00
Chris Lu	5f8d6b5f13	Merge pull request #3184 from guol-fnst/weed_update ... Weed update	2022-06-16 10:02:45 -07:00
guol-fnst	cd078471c4	fix path bug on windows ... fix usage	2022-06-16 17:24:56 +08:00
guol-fnst	995e221e97	remove -output, add -dir,-name for more flexibility	2022-06-16 16:07:32 +08:00
Chris Lu	82f3bcc65e	Merge pull request #3081 from paochiang/volume_upload_limit_fix ... exclude replication from the concurrentUploadLimitMB	2022-06-15 23:16:44 -07:00
guol-fnst	4bc8792643	support specific version of weed	2022-06-16 11:40:23 +08:00
guol-fnst	1dbb925d29	remove unused function ... remove log when weed is up to date add check whether weed is full version	2022-06-16 11:40:20 +08:00
Chris Lu	4eeeb5f50d	Merge pull request #3180 from blacktear23/issue-3149	2022-06-15 00:55:20 -07:00
yulai.li	358c0c0b37	Fix: provide filer.ui.deleteDir options for server command	2022-06-15 15:53:31 +08:00
Guo Lei	3df84cabf6	Merge branch 'chrislusf:master' into weed_update	2022-06-15 15:28:40 +08:00
guol-fnst	695e8c7555	fix minor bug	2022-06-15 15:26:04 +08:00
zhihao.qu	4d0d1848c6	fix(filer.sync): modify clientName format : from -> to	2022-06-15 13:33:20 +08:00
yulai.li	b90d213a87	Change ui.deleteDir default to true	2022-06-15 11:37:37 +08:00
zhihao.qu	42d04c581b	feat(filer.sync): add metricsServer in filer.sync. ... Metrics include: (1) the offset of the filer.sync (2) the last send timestamp of the filer subscription	2022-06-15 11:33:18 +08:00
yulai.li	28cda854eb	Add filer command line parameter to let Filer UI show/hide directory delete button	2022-06-15 00:30:49 +08:00
zhihao.qu	14d82c3dea	feat(filer.sync): add offset to path.	2022-06-14 19:46:02 +08:00
guol-fnst	78fc9cdfa0	add "copied from https://github.com/restic/restic/tree/master/internal/selfupdate"	2022-06-14 19:10:54 +08:00
guol-fnst	322dbcf372	add update feature	2022-06-14 19:01:57 +08:00
zhihao.qu	cd5cca36a4	feat(filer.sync): add fromTsMs. Extract signature from doSubscribeFilerMetaChanges	2022-06-09 10:53:19 +08:00
chrislu	8a1166c021	auto remove previous leftover socket	2022-06-08 00:32:09 -07:00
chrislu	633a4aed18	filer: fix customizable local socket file name ... fix https://github.com/chrislusf/seaweedfs/issues/3147	2022-06-08 00:15:28 -07:00
chrislu	78be3b0f6c	fix compilation	2022-06-06 10:09:21 -07:00
chrislu	4fd5f96598	filer: remove replication, collection, disk_type info from entry metadata ... these metadata can change and are not used	2022-06-06 00:39:35 -07:00
ningfd	f32142f6f5	add disableXAttr in mount option	2022-06-06 14:09:01 +08:00
creeew	02ae102731	fix filer.sync missing source srv uploaded files to target when target down	2022-06-02 01:28:47 +08:00
chrislu	490e0850bf	filer.meta.tail add one example of using untilTimeAgo	2022-05-30 20:24:59 -07:00
chrislu	968ca95b49	filer.meta.tail: support untilTimeAgo for a range	2022-05-30 16:16:23 -07:00
chrislu	a2b101a737	subscribe metadata between a range	2022-05-30 15:04:19 -07:00
liubaojiang	076e48a676	add inflight upload data wait timeout	2022-05-21 10:38:08 +08:00
Chris Lu	8efe55f981	Merge pull request #3059 from guol-fnst/avoid_dup_vol ... avoid loading duplicated volume directory	2022-05-17 23:48:57 -07:00
guol-fnst	076595fbdd	just exit in case of duplicated volume directories were loaded	2022-05-17 15:41:49 +08:00
Nat Makarevitch	b72f0634d7	minor (typos...), done while reading around	2022-05-16 22:11:33 +08:00
chrislu	29198720f2	s3: add grpc server to accept configuration changes	2022-05-15 00:43:37 -07:00
chrislu	735038b2c1	backup do not need to use preallocation ... fix https://github.com/chrislusf/seaweedfs/issues/3044	2022-05-13 13:46:52 -07:00
Konstantin Lebedev	f127b326bf	add options to scaffold	2022-05-03 22:54:31 +05:00
Konstantin Lebedev	d8925b4e83	Merge branch 'new_master' into ydb ... # Conflicts: # go.mod # go.sum	2022-05-03 00:13:57 +05:00
chrislu	94635e9b5c	filer: add filer group	2022-05-01 21:59:16 -07:00
Konstantin Lebedev	50c4f62ed4	ydb-go-sdk move to v3	2022-05-02 02:07:47 +05:00
chrislu	192983b464	s3 backend support customizing storage class	2022-04-30 17:36:40 -07:00
chrislu	3885374edf	conditionally build elastic, gocdk to reduce binary size	2022-04-21 01:10:46 -07:00
chrislu	6994e88192	fix typo	2022-04-21 00:02:18 -07:00
a	1d6a9e66b6	Merge branch 'master' into a	2022-04-20 14:01:42 -07:00
chrislu	a69f0b62c2	start filer local socket only on non windows ... fix https://github.com/chrislusf/seaweedfs/issues/2930	2022-04-18 00:08:31 -07:00
leyou240	89eb87c1d1	Merge branch 'master' into slices.SortFunc	2022-04-18 10:39:29 +08:00
justin	3551ca2fcf	enhancement: replace sort.Slice with slices.SortFunc to reduce reflection	2022-04-18 10:35:43 +08:00
chrislu	1384529eb7	Fix filer.backup deletes files in backup folder in incremental mode ... fix https://github.com/chrislusf/seaweedfs/issues/2919	2022-04-14 13:35:01 -07:00
a	846858fb43	merge master	2022-04-12 14:42:29 -07:00
a	41d396edc4	Merge branch 'master' into a	2022-04-07 08:22:59 -07:00
Konstantin Lebedev	f5246b748d	Merge branch 'new_master' into hashicorp_raft ... # Conflicts: # weed/pb/master_pb/master.pb.go	2022-04-07 18:50:27 +05:00
chrislu	86ed27f602	mount: remove leftover socket file	2022-04-07 00:33:13 -07:00
eddy-gfx	ec53eec94f	Merge branch 'master' into a	2022-04-06 18:45:55 -05:00
Konstantin Lebedev	17c6e8e39f	Merge branch 'new_master' into hashicorp_raft ... # Conflicts: # go.mod # go.sum	2022-04-05 13:29:46 +05:00
Konstantin Lebedev	622297f1a7	add stats raft handler	2022-04-04 19:16:06 +05:00
Konstantin Lebedev	14dd971890	hashicorp raft with state machine	2022-04-04 17:51:51 +05:00
Konstantin Lebedev	c514710b7b	initial add hashicorp raft	2022-04-04 13:50:56 +05:00
chrislu	6a2bcd03aa	configure mount quota	2022-04-02 21:34:26 -07:00
chrislu	958f880b70	mount: add grpc method to adjust quota	2022-04-02 15:14:37 -07:00
chrislu	daca2d22a5	use original server address string as map key	2022-04-01 17:34:42 -07:00
a	7e92517571	change user and pass to username and password	2022-04-01 14:09:25 -05:00
Konstantin Lebedev	b6a2b43efe	allowDeleteBucketNotEmpty	2022-03-30 22:46:13 +05:00
a	bc603e534f	diff	2022-03-28 16:50:28 +00:00
chrislu	21e0898631	refactor: change masters from a slice to a map	2022-03-26 13:33:17 -07:00
chrislu	4ba7127ab1	refactor	2022-03-26 13:13:19 -07:00