87 Commits

Author	SHA1	Message	Date
Chris Lu	b430d1b6ee	filer.copy: "check.size" before copying files ... fix https://github.com/chrislusf/seaweedfs/issues/2067	2021-05-12 21:45:39 -07:00
Chris Lu	8f8738867f	add retry to assign volume ... fix https://github.com/chrislusf/seaweedfs/issues/2056	2021-05-07 07:29:26 -07:00
Chris Lu	007401f3a0	remove duplicated code	2021-05-07 07:14:24 -07:00
Chris Lu	55a8f57381	go fmt	2021-05-06 03:37:51 -07:00
Chris Lu	cd7bf1a72a	filer.copy copy empty folders ... fix https://github.com/chrislusf/seaweedfs/issues/2016	2021-04-21 11:17:43 -07:00
Chris Lu	cc0df36a9e	smaller file chunks are faster	2021-04-01 02:21:59 -07:00
Chris Lu	62191b08ea	disk type support custom tags	2021-02-22 02:03:12 -08:00
Chris Lu	6daa932f5c	refactoring to get master function, instead of passing master values directly ... this will enable retrying later	2021-02-17 20:55:55 -08:00
Chris Lu	0bc3a1f9e8	disk type only supports hdd and ssd, not ready for random tags yet	2021-02-14 11:38:43 -08:00
Chris Lu	ef76365ec2	adjust help message	2021-02-13 15:47:08 -08:00
Chris Lu	821c46edf1	Merge branch 'master' into support_ssd_volume	2021-02-09 11:37:07 -08:00
Chris Lu	2b76854641	add "weed filer.cat" to read files directly from volume servers	2021-01-06 04:22:00 -08:00
Chris Lu	1bf22c0b5b	go fmt	2020-12-16 09:14:05 -08:00
Chris Lu	23014b6810	Merge branch 'master' into support_ssd_volume	2020-12-16 08:26:51 -08:00
Chris Lu	3c7f9633eb	show error a little bit more obviously ... fix https://github.com/chrislusf/seaweedfs/issues/1678	2020-12-14 09:39:33 -08:00
Chris Lu	8baba93fce	rename parameter name to "disk"	2020-12-13 12:06:21 -08:00
Chris Lu	0d2ec832e2	rename from volumeType to diskType	2020-12-13 11:59:32 -08:00
Chris Lu	e9cd798bd3	adding volume type	2020-12-13 00:58:58 -08:00
Chris Lu	745ee8d8f3	avoid unnecessary error message ... fix https://github.com/chrislusf/seaweedfs/issues/1611	2020-11-11 13:00:05 -08:00
Chris Lu	de86945aeb	go fmt	2020-10-31 16:45:38 -07:00
Chris Lu	7ecbb4b3c9	clean up	2020-10-30 10:46:31 -07:00
Kenny	9cc6575ab5	Update filer_copy.go ... 修改 weed filer.copy 上传目录时文件名变子目录的问题	2020-10-30 18:16:49 +08:00
Chris Lu	e219c57849	passing full path when assign volume locations	2020-10-25 15:46:29 -07:00
Chris Lu	f375b93aef	renaming	2020-10-25 15:32:43 -07:00
Chris Lu	63b0fb54f7	minor	2020-10-25 14:15:53 -07:00
Chris Lu	147d4d23b6	filer.copy: automatically use the right bucket	2020-10-25 11:21:33 -07:00
Chris Lu	387ab6796f	filer: cross cluster synchronization	2020-09-09 11:21:23 -07:00
Chris Lu	39e72fb23c	go fmt	2020-05-10 03:50:30 -07:00
Chris Lu	871efa4fc1	refactoring ... some previous chunk etag was using md5, which should be wrong.	2020-04-30 17:20:47 -07:00
wuyuxiang	6850d28d6b	refacotr: move signal handling and pprof to grace package	2020-04-28 14:10:23 +08:00
Chris Lu	57df14f76f	report error if copying failed	2020-04-21 14:28:46 -07:00
Chris Lu	eedd33dda3	refactoring	2020-03-28 13:41:58 -07:00
Chris Lu	d848d08944	use public url also for deletions	2020-03-18 11:16:45 -07:00
Chris Lu	89eb05b50f	filer: support TTL for all filer stores	2020-03-09 01:02:01 -07:00
Chris Lu	2e3f6ad3a9	filer: remember content is gzipped or not	2020-03-08 21:39:33 -07:00
Chris Lu	936e7cdbfb	pass in filer.copy cipher option	2020-03-07 12:46:00 -08:00
Chris Lu	8c3e25b38a	mimee type default "application/octet-stream" to empty string	2020-03-07 06:08:08 -08:00
Chris Lu	13e215ee5c	filer: option to encrypt data on volume server	2020-03-06 00:49:47 -08:00
Chris Lu	f90c43635d	refactoring	2020-03-04 00:39:47 -08:00
Chris Lu	97ab8a1976	remove ctx if possible	2020-02-25 22:23:59 -08:00
Chris Lu	892e726eb9	avoid reusing context object ... fix https://github.com/chrislusf/seaweedfs/issues/1182	2020-02-25 21:50:12 -08:00
Chris Lu	0841bedb15	move filer assign volume grpc errror to response	2020-02-25 17:15:09 -08:00
Chris Lu	6ab7368ef2	filer: dynamically create bucket under /buckets folder	2020-02-24 22:28:45 -08:00
Chris Lu	d335f04de6	support env variables to overwrite toml file	2020-01-29 09:09:55 -08:00
Chris Lu	72a64a5cf8	use the same context object in order to retry	2020-01-26 14:42:11 -08:00
Chris Lu	c48fc8b4de	grpc send error via response instead of grpc error	2020-01-25 09:17:19 -08:00
Chris Lu	392678f8f3	upload skipping mimetype if not needed	2019-12-15 20:57:08 -08:00
Chris Lu	69de05f6cb	go fmt	2019-10-25 07:45:12 -07:00
Chris Lu	9573c0f4b3	filer: filer.copy cleanup in case of failed uploads	2019-10-24 10:16:01 -07:00
Chris Lu	5d78871487	filer: parallize weed filer.copy for single file	2019-10-24 07:26:23 -07:00