125 Commits

Author	SHA1	Message	Date
Chris Lu	37d5b3ba12	replication: pass isFromOtherCluster also to EventNotification ... EventNotification is consistent with message queue and metadata logs.	2020-07-01 08:06:20 -07:00
Chris Lu	31e23e9783	filer: support active<=>active filer replication	2020-06-30 22:53:57 -07:00
Chris Lu	97239ce6f1	rename filechunk is_gzipped to is_compressed	2020-06-20 08:15:49 -07:00
Chris Lu	ed3cf811f5	refactoring	2020-04-29 13:26:02 -07:00
Chris Lu	f282ed444b	refactoring	2020-04-13 21:58:10 -07:00
Chris Lu	4b27afe176	fix sqs message reading	2020-04-10 15:27:47 -07:00
Chris Lu	ec2eb8bc48	add If-None-Match and If-Modified-Since ... fix https://github.com/chrislusf/seaweedfs/issues/1269	2020-04-08 08:12:00 -07:00
Chris Lu	4c498e73de	filer replication: add s3 endpoint	2020-04-07 17:49:00 -07:00
Chris Lu	91da7057b1	refactoring	2020-04-05 13:11:43 -07:00
Chris Lu	eedd33dda3	refactoring	2020-03-28 13:41:58 -07:00
Chris Lu	b97768c51c	refactoring	2020-03-23 01:30:22 -07:00
Chris Lu	c0f0fdb3ba	refactoring	2020-03-23 00:01:34 -07:00
Chris Lu	ae2ee379c0	consistent 64bit size	2020-03-22 01:37:46 -07:00
Chris Lu	bec6ec7db6	go fmt	2020-03-17 10:01:55 -07:00
HongyanShen	81610ed006	fix: #1226	2020-03-11 14:37:14 +08:00
Chris Lu	2e3f6ad3a9	filer: remember content is gzipped or not	2020-03-08 21:39:33 -07:00
Chris Lu	8645283a7b	fuse mount: avoid lookup nil entry ... fix https://github.com/chrislusf/seaweedfs/issues/1221	2020-03-07 16:51:46 -08:00
Chris Lu	13e215ee5c	filer: option to encrypt data on volume server	2020-03-06 00:49:47 -08:00
Chris Lu	f90c43635d	refactoring	2020-03-04 00:39:47 -08:00
Chris Lu	97ab8a1976	remove ctx if possible	2020-02-25 22:23:59 -08:00
Chris Lu	892e726eb9	avoid reusing context object ... fix https://github.com/chrislusf/seaweedfs/issues/1182	2020-02-25 21:50:12 -08:00
Chris Lu	0841bedb15	move filer assign volume grpc errror to response	2020-02-25 17:15:09 -08:00
Chris Lu	7d10fdf737	fix directory lookup nil	2020-02-25 11:13:06 -08:00
Chris Lu	6ab7368ef2	filer: dynamically create bucket under /buckets folder	2020-02-24 22:28:45 -08:00
Chris Lu	d335f04de6	support env variables to overwrite toml file	2020-01-29 09:09:55 -08:00
Chris Lu	72a64a5cf8	use the same context object in order to retry	2020-01-26 14:42:11 -08:00
Chris Lu	c48fc8b4de	grpc send error via response instead of grpc error	2020-01-25 09:17:19 -08:00
Chris Lu	9711a6ffaa	WIP	2019-11-18 19:24:37 -08:00
Chris Lu	0ea98dc6a2	disable azure due to api changes	2019-07-17 00:39:36 -07:00
Chris Lu	3fa1f150d9	refactoring	2019-06-22 20:04:56 -07:00
Chris Lu	b3b42bc947	replicate need to include new entry path	2019-04-16 00:44:31 -07:00
Chris Lu	a41ba79119	Merge pull request #914 from jba/gocdk-receive ... replication: add GoCDK PubSub support	2019-04-08 10:31:02 -07:00
Chris Lu	c789b496d8	use cached grpc client	2019-04-05 20:31:58 -07:00
Jonathan Amsterdam	a6a5d80401	fix typo	2019-04-05 08:13:32 -04:00
Jonathan Amsterdam	c0c9a8bad5	replication: add GoCDK PubSub support	2019-04-04 17:22:45 -04:00
Chris Lu	55bab1b456	add context.Context	2019-03-15 17:20:24 -07:00
Chris Lu	d312c55bbe	file path supports windows, avoiding back slashes ... fix https://github.com/chrislusf/seaweedfs/issues/868	2019-03-04 13:00:08 -08:00
Chris Lu	77b9af531d	adding grpc mutual tls	2019-02-18 12:11:52 -08:00
Chris Lu	157c0f7c01	add jwt for writes	2019-02-15 09:59:22 -08:00
Chris Lu	39ea8484c1	adjust proto API	2018-12-11 07:17:10 -08:00
Chris Lu	1bfb96f34d	optimization for reading whole chunk with gzip encoding	2018-12-07 01:57:55 -08:00
Chris Lu	8dfac6a4cf	working b2 sink	2018-11-04 11:58:59 -08:00
Chris Lu	3674ad9f8e	go fmt	2018-11-01 01:12:21 -07:00
Chris Lu	db584ff7f8	separate into notification.toml, add gcp pub/sub message queue	2018-11-01 01:11:09 -07:00
Chris Lu	6219a9ad1f	filer ordered notifications	2018-10-31 21:48:05 -07:00
Chris Lu	4c97ff3717	support AWS SQS as file change notification message queue	2018-10-31 01:11:19 -07:00
Chris Lu	6a756136ef	go fmt	2018-10-23 23:59:49 -07:00
Chris Lu	c58b73ad9b	adding BackBlaze, Azure	2018-10-23 23:59:40 -07:00
Chris Lu	b861899919	use released version of azblob ... replace https://github.com/chrislusf/seaweedfs/pull/754	2018-10-23 02:18:46 -07:00
Chris Lu	08266b7256	go fmt	2018-10-11 00:08:13 -07:00
Chris Lu	9f4c2f87d3	adding filer replication sink to Azure	2018-10-09 01:35:48 -07:00
Chris Lu	453d0be4d4	adjust error format	2018-10-09 01:35:30 -07:00
Chris Lu	a5b5887efc	add filer replication to aws s3	2018-10-06 17:10:15 -07:00
Chris Lu	84d4a2c8a0	add filer replication to google cloud storage	2018-10-06 13:08:38 -07:00
Chris Lu	f8c2704d2b	reformat	2018-10-06 13:04:33 -07:00
Chris Lu	04da4c8094	add logging	2018-10-06 13:01:29 -07:00
Chris Lu	4a8ef198d7	add logging	2018-10-06 13:00:33 -07:00
Chris Lu	56c5c7b1b6	add google cloud storage	2018-10-04 01:14:44 -07:00
Chris Lu	e8ef501f02	add s3 replication sink	2018-10-03 23:36:52 -07:00
Chris Lu	31ed352ab6	replication handle cases when entry already exists	2018-09-25 09:27:03 -07:00
Chris Lu	b1b8c4ed32	join via filepath	2018-09-23 01:46:50 -07:00
Chris Lu	b16d47030e	save and use last processed kafka offsets	2018-09-23 01:34:40 -07:00
Chris Lu	9fe24991d5	refactoring	2018-09-23 00:40:36 -07:00
Chris Lu	d3e1f20dcc	adjust log level	2018-09-22 22:11:49 -07:00
Chris Lu	9a3d46f8e3	handle duplicated replication when retry happens	2018-09-22 11:14:04 -07:00
Chris Lu	01ceace18e	adjust sink options	2018-09-22 00:53:52 -07:00
Chris Lu	db69ce89f0	go fmt	2018-09-21 01:56:43 -07:00
Chris Lu	a6cfaba018	able to sync the changes	2018-09-21 01:54:29 -07:00
Chris Lu	d5149e592e	add logging on kafka reading	2018-09-19 22:31:45 -07:00
Chris Lu	25fb6f9a46	fix compilation	2018-09-17 02:23:21 -07:00
Chris Lu	779641e9d4	adjust replicated entry name	2018-09-17 01:37:24 -07:00
Chris Lu	788acdf527	add WIP filer.replicate	2018-09-17 00:27:56 -07:00
Chris Lu	5071f528f6	testing compilation with remove package	2013-02-10 03:49:51 -08:00
Chris Lu	55f2627fcf	testing new directory structure	2013-02-10 03:31:40 -08:00
Chris Lu	ab6fb13ad7	avoid the "src" folder	2013-02-10 03:25:35 -08:00