96 Commits

Author	SHA1	Message	Date
Chris Lu	dce1f02c9e	filer.backup: backup to local directory optionally is incremental ... fixed one issue with https://github.com/chrislusf/seaweedfs/issues/2084	2021-05-25 17:19:20 -07:00
Chris Lu	8f8738867f	add retry to assign volume ... fix https://github.com/chrislusf/seaweedfs/issues/2056	2021-05-07 07:29:26 -07:00
Chris Lu	540441fd38	go fmt	2021-02-28 20:34:14 -08:00
Chris Lu	c9722dceb2	adjust log level	2021-02-28 20:26:55 -08:00
Chris Lu	f2fcb77808	local file sink: create backup files with permission 0755	2021-02-28 16:20:47 -08:00
Chris Lu	984fdd6192	always use non bucket prefixing url	2021-02-28 16:20:13 -08:00
Chris Lu	9abb041763	filer source: support filerProxy mode	2021-02-28 16:19:47 -08:00
Chris Lu	678c54d705	data sink: add incremental mode	2021-02-28 16:19:03 -08:00
Chris Lu	a0e84c4fbc	go fmt	2021-02-10 23:41:05 -08:00
Chris Lu	821c46edf1	Merge branch 'master' into support_ssd_volume	2021-02-09 11:37:07 -08:00
Chris Lu	990fa69bfe	add back AdjustedUrl() related code	2021-01-28 14:36:29 -08:00
Chris Lu	da08402ba2	replicate: use creation time for local incremental file sink ... related to https://github.com/chrislusf/seaweedfs/pull/1762	2021-01-28 02:17:41 -08:00
Konstantin Lebedev	02fdc0a333	rename backup to local_incremental and use mtime	2021-01-28 14:56:13 +05:00
Konstantin Lebedev	6b54ff9912	replication to create time date directory	2021-01-27 15:01:33 +05:00
Konstantin Lebedev	3634811408	replication to todays date directory	2021-01-27 12:45:58 +05:00
Konstantin Lebedev	612b7975a1	replication to local disk storage	2021-01-26 22:50:25 +05:00
Chris Lu	00707ec00f	mount: outsideContainerClusterMode proxy through filer ... Running mount outside of the cluster would not need to expose all the volume servers to outside of the cluster. The chunk read and write will go through the filer.	2021-01-24 19:01:58 -08:00
Chris Lu	6ca10725b8	Revert "mount: when outside cluster network, use filer as proxy to access volume servers" ... This reverts commit 096e088d7b.	2021-01-24 03:15:19 -08:00
Chris Lu	096e088d7b	mount: when outside cluster network, use filer as proxy to access volume servers	2021-01-24 01:41:38 -08:00
Chris Lu	80b8692688	filer.sync: replicate outside of either cluster, only need to see filers	2021-01-24 00:01:44 -08:00
Chris Lu	2b76854641	add "weed filer.cat" to read files directly from volume servers	2021-01-06 04:22:00 -08:00
Chris Lu	1bf22c0b5b	go fmt	2020-12-16 09:14:05 -08:00
Chris Lu	51eadaf2b6	rename parameter name to "disk"	2020-12-13 12:05:31 -08:00
Chris Lu	0d2ec832e2	rename from volumeType to diskType	2020-12-13 11:59:32 -08:00
Chris Lu	e9cd798bd3	adding volume type	2020-12-13 00:58:58 -08:00
Chris Lu	f4abd01adf	filer: cache small file to filer store	2020-11-30 04:34:04 -08:00
Chris Lu	e219c57849	passing full path when assign volume locations	2020-10-25 15:46:29 -07:00
Chris Lu	f375b93aef	renaming	2020-10-25 15:32:43 -07:00
Chris Lu	d75bc62196	to read files that are quickly changing	2020-10-22 12:59:15 -07:00
Chris Lu	723ae11db4	refactoring in order to adjust volume server url later	2020-10-11 20:15:10 -07:00
Chris Lu	a8624c2e4f	read from alternative replica ... related to https://github.com/chrislusf/seaweedfs/issues/1512	2020-10-07 22:49:04 -07:00
Chris Lu	387ab6796f	filer: cross cluster synchronization	2020-09-09 11:21:23 -07:00
Chris Lu	4fc0bd1a81	return http response directly	2020-09-09 03:53:09 -07:00
Chris Lu	eb7929a971	rename filer2 to filer	2020-09-01 00:21:19 -07:00
Chris Lu	ca658a97c5	add signatures to messages to avoid double processing	2020-08-28 23:48:48 -07:00
Chris Lu	c27e18aa6a	read possible old deleted chunks	2020-08-19 00:43:07 -07:00
Chris Lu	c647deace1	file size support set file length ... use Attr.FileSize and TotalChunkSize to determine file size	2020-08-15 09:32:47 -07:00
Chris Lu	97d97f3528	go code can read and write chunk manifest	2020-07-19 17:59:43 -07:00
Chris Lu	31e23e9783	filer: support active<=>active filer replication	2020-06-30 22:53:57 -07:00
Chris Lu	97239ce6f1	rename filechunk is_gzipped to is_compressed	2020-06-20 08:15:49 -07:00
Chris Lu	ed3cf811f5	refactoring	2020-04-29 13:26:02 -07:00
Chris Lu	f282ed444b	refactoring	2020-04-13 21:58:10 -07:00
Chris Lu	ec2eb8bc48	add If-None-Match and If-Modified-Since ... fix https://github.com/chrislusf/seaweedfs/issues/1269	2020-04-08 08:12:00 -07:00
Chris Lu	4c498e73de	filer replication: add s3 endpoint	2020-04-07 17:49:00 -07:00
Chris Lu	eedd33dda3	refactoring	2020-03-28 13:41:58 -07:00
Chris Lu	b97768c51c	refactoring	2020-03-23 01:30:22 -07:00
Chris Lu	c0f0fdb3ba	refactoring	2020-03-23 00:01:34 -07:00
Chris Lu	ae2ee379c0	consistent 64bit size	2020-03-22 01:37:46 -07:00
Chris Lu	bec6ec7db6	go fmt	2020-03-17 10:01:55 -07:00
HongyanShen	81610ed006	fix: #1226	2020-03-11 14:37:14 +08:00