29 Commits

Author	SHA1	Message	Date
chrislu	9f9ef1340c	use streaming mode for long poll grpc calls ... streaming mode would create separate grpc connections for each call. this is to ensure the long poll connections are properly closed.	2021-12-26 00:15:03 -08:00
Chris Lu	e5fc35ed0c	change server address from string to a type	2021-09-12 22:47:52 -07:00
Chris Lu	678c54d705	data sink: add incremental mode	2021-02-28 16:19:03 -08:00
Chris Lu	9a06c35da4	replicate: incremental sink only contains new and updated files ... address da08402ba2	2021-01-28 02:39:22 -08:00
Chris Lu	da08402ba2	replicate: use creation time for local incremental file sink ... related to https://github.com/chrislusf/seaweedfs/pull/1762	2021-01-28 02:17:41 -08:00
Konstantin Lebedev	02fdc0a333	rename backup to local_incremental and use mtime	2021-01-28 14:56:13 +05:00
Konstantin Lebedev	6b54ff9912	replication to create time date directory	2021-01-27 15:01:33 +05:00
Chris Lu	446e476a11	go fmt	2020-09-12 04:08:03 -07:00
Chris Lu	387ab6796f	filer: cross cluster synchronization	2020-09-09 11:21:23 -07:00
Chris Lu	37d5b3ba12	replication: pass isFromOtherCluster also to EventNotification ... EventNotification is consistent with message queue and metadata logs.	2020-07-01 08:06:20 -07:00
Chris Lu	91da7057b1	refactoring	2020-04-05 13:11:43 -07:00
Chris Lu	892e726eb9	avoid reusing context object ... fix https://github.com/chrislusf/seaweedfs/issues/1182	2020-02-25 21:50:12 -08:00
Chris Lu	d335f04de6	support env variables to overwrite toml file	2020-01-29 09:09:55 -08:00
Chris Lu	b3b42bc947	replicate need to include new entry path	2019-04-16 00:44:31 -07:00
Chris Lu	55bab1b456	add context.Context	2019-03-15 17:20:24 -07:00
Chris Lu	d312c55bbe	file path supports windows, avoiding back slashes ... fix https://github.com/chrislusf/seaweedfs/issues/868	2019-03-04 13:00:08 -08:00
Chris Lu	8dfac6a4cf	working b2 sink	2018-11-04 11:58:59 -08:00
Chris Lu	08266b7256	go fmt	2018-10-11 00:08:13 -07:00
Chris Lu	04da4c8094	add logging	2018-10-06 13:01:29 -07:00
Chris Lu	4a8ef198d7	add logging	2018-10-06 13:00:33 -07:00
Chris Lu	e8ef501f02	add s3 replication sink	2018-10-03 23:36:52 -07:00
Chris Lu	31ed352ab6	replication handle cases when entry already exists	2018-09-25 09:27:03 -07:00
Chris Lu	b1b8c4ed32	join via filepath	2018-09-23 01:46:50 -07:00
Chris Lu	9fe24991d5	refactoring	2018-09-23 00:40:36 -07:00
Chris Lu	01ceace18e	adjust sink options	2018-09-22 00:53:52 -07:00
Chris Lu	db69ce89f0	go fmt	2018-09-21 01:56:43 -07:00
Chris Lu	a6cfaba018	able to sync the changes	2018-09-21 01:54:29 -07:00
Chris Lu	779641e9d4	adjust replicated entry name	2018-09-17 01:37:24 -07:00
Chris Lu	788acdf527	add WIP filer.replicate	2018-09-17 00:27:56 -07:00