22 Commits

Author	SHA1	Message	Date
Konstantin Lebedev	6fa3d0cc46	fix delete key panic of remote sync dir (#3770)	2022-10-01 02:33:47 -07:00
chrislu	b834027c5a	refactor	2022-09-11 21:53:15 -07:00
chrislu	2c6b68b40e	simplify a bit	2022-09-10 14:18:28 -07:00
Konstantin Lebedev	b64674018a	[sync] override amz storage class, None to delete (#3639) ... * override amz storage class, None to delete https://github.com/seaweedfs/seaweedfs/issues/3636 * use empty string to delete * without nil check	2022-09-10 14:15:42 -07:00
chrislu	205ecb5d03	skip directories under ".uploads" directory ... related to https://github.com/seaweedfs/seaweedfs/issues/3636 skipping all directories under ".uploads" directory.	2022-09-09 22:57:38 -07:00
chrislu	b4131a3a72	filer.remote.sync: parallelize uploading to remove object storage	2022-08-22 00:01:48 -07:00
chrislu	eaeb141b09	move proto package	2022-08-17 12:05:07 -07:00
chrislu	26dbc6c905	move to https://github.com/seaweedfs/seaweedfs	2022-07-29 00:17:28 -07:00
chrislu	64f3d6fb6e	metadata subscription uses client epoch	2022-07-23 10:50:28 -07:00
creeew	02ae102731	fix filer.sync missing source srv uploaded files to target when target down	2022-06-02 01:28:47 +08:00
chrislu	a2b101a737	subscribe metadata between a range	2022-05-30 15:04:19 -07:00
chrislu	202a29d014	refactoring	2022-02-25 01:17:26 -08:00
chrislu	5c87fcc6d2	add client id for all metadata listening clients	2021-12-30 00:23:57 -08:00
chrislu	9f9ef1340c	use streaming mode for long poll grpc calls ... streaming mode would create separate grpc connections for each call. this is to ensure the long poll connections are properly closed.	2021-12-26 00:15:03 -08:00
Chris Lu	ad16221a35	adjust error log	2021-11-28 22:06:17 -08:00
Chris Lu	cf1586a34d	add logs for writing to remote file	2021-11-27 22:09:23 -08:00
Chris Lu	6c27845be0	add retries when writing to remote s3 ... fix https://github.com/chrislusf/seaweedfs/issues/2465	2021-11-22 21:48:04 -08:00
Chris Lu	63da4bbb54	separate filer.remote.gateway command to avoid confusion	2021-09-15 22:47:17 -07:00
Chris Lu	e5fc35ed0c	change server address from string to a type	2021-09-12 22:47:52 -07:00
Chris Lu	98c68d7a79	filer.remote.sync fix upload logic	2021-09-04 18:46:28 -07:00
Chris Lu	796b2eb929	remember sync time	2021-09-04 13:46:22 -07:00
Chris Lu	4b28c5f6c3	filer.remote.sync: split into buckets mode and single directory mode	2021-09-04 04:35:46 -07:00