43 Commits

Author	SHA1	Message	Date
chrislu	26dbc6c905	move to https://github.com/seaweedfs/seaweedfs	2022-07-29 00:17:28 -07:00
chrislu	f2f0482dd3	mount: random read also try to use the local cache first	2022-07-07 11:50:28 -07:00
chrislu	53513475bf	mount: add back random read support ... avoid too much memory used also	2022-03-13 01:38:52 -08:00
chrislu	941ced60a4	download 2 chunks if at the beginning of a file	2022-02-27 03:57:24 -08:00
chrislu	551d00d51a	prefetch other chunks when stream reading	2022-02-26 23:20:45 -08:00
chrislu	3345a50d9b	prefetch 2 chunks	2022-02-26 03:06:17 -08:00
chrislu	28b395bef4	better control for reader caching	2022-02-26 02:16:47 -08:00
banjiaojuhao	45e9c83421	padding zero for sparse file	2022-01-13 22:21:22 +08:00
chrislu	9a00c17555	reader: avoid wrong pattern detection due to lock waiting	2021-12-28 16:30:33 -08:00
chrislu	9f9ef1340c	use streaming mode for long poll grpc calls ... streaming mode would create separate grpc connections for each call. this is to ensure the long poll connections are properly closed.	2021-12-26 00:15:03 -08:00
chrislu	b541e39a2c	fix tests	2021-12-22 16:17:30 -08:00
chrislu	4c1368d621	fix test	2021-12-22 16:05:08 -08:00
chrislu	0cb9036f66	mount: only cache the first chunk on stream read	2021-12-19 23:06:03 -08:00
chrislu	a152f17937	mount: improve read performance on random reads	2021-12-19 22:43:14 -08:00
Chris Lu	1737af480a	adjust logs	2021-05-10 21:47:51 -07:00
Nathan Hawkins	042de9359c	make reader_at handle random reads more efficiently for FUSE	2021-04-28 19:13:37 -04:00
Chris Lu	990fa69bfe	add back AdjustedUrl() related code	2021-01-28 14:36:29 -08:00
Chris Lu	00707ec00f	mount: outsideContainerClusterMode proxy through filer ... Running mount outside of the cluster would not need to expose all the volume servers to outside of the cluster. The chunk read and write will go through the filer.	2021-01-24 19:01:58 -08:00
Chris Lu	6ca10725b8	Revert "mount: when outside cluster network, use filer as proxy to access volume servers" ... This reverts commit 096e088d7b.	2021-01-24 03:15:19 -08:00
Chris Lu	096e088d7b	mount: when outside cluster network, use filer as proxy to access volume servers	2021-01-24 01:41:38 -08:00
Chris Lu	de876c795d	minor fix	2021-01-18 01:14:27 -08:00
Chris Lu	2b76854641	add "weed filer.cat" to read files directly from volume servers	2021-01-06 04:22:00 -08:00
Chris Lu	8e78187a97	add back last read chunk cache to reader and properly close the reader	2020-12-08 22:26:46 -08:00
Chris Lu	900d22c6ec	mount: avoid memory leaking read buffer ... fix https://github.com/chrislusf/seaweedfs/issues/1654 the reader goes together with the file handle, which may stay for a long time.	2020-12-08 02:38:53 -08:00
Chris Lu	8750cac090	move to util.RetryWaitTime	2020-11-01 02:36:43 -08:00
Chris Lu	df8d976bb0	refactoring	2020-11-01 01:58:48 -07:00
Chris Lu	bd103c143a	add lock for vidCache	2020-10-21 19:28:59 -07:00
Chris Lu	93bcf56514	file read report EOF ... fix https://github.com/chrislusf/seaweedfs/issues/1344	2020-10-14 12:18:24 -07:00
Chris Lu	723ae11db4	refactoring in order to adjust volume server url later	2020-10-11 20:15:10 -07:00
Chris Lu	d155f907c2	mount: configurable read wait time	2020-10-10 20:09:43 -07:00
Chris Lu	8a52379ecb	add retry if volume can not be found	2020-10-10 16:02:39 -07:00
Chris Lu	cff8bb6554	return proper error	2020-10-10 15:43:22 -07:00
Chris Lu	b2ee5873fb	fix error not being returned	2020-10-08 23:19:20 -07:00
Chris Lu	eed492b73b	randomize file locations	2020-10-07 23:58:32 -07:00
Chris Lu	a8624c2e4f	read from alternative replica ... related to https://github.com/chrislusf/seaweedfs/issues/1512	2020-10-07 22:49:04 -07:00
Chris Lu	36492c47ec	adjust	2020-10-05 14:06:18 -07:00
Chris Lu	8f8e9ddbde	adjust API	2020-10-05 09:47:07 -07:00
Chris Lu	6b591b02af	adjust log level	2020-10-04 16:21:43 -07:00
Chris Lu	666859f7cd	mount: read prefetching	2020-10-04 01:31:04 -07:00
Chris Lu	bc47835997	mount: avoid duplicated reads	2020-10-03 20:16:42 -07:00
Chris Lu	8d65ad1444	Revert "mount: adds read prefetching" ... This reverts commit 692f0614d1.	2020-10-03 19:40:56 -07:00
Chris Lu	692f0614d1	mount: adds read prefetching	2020-10-03 16:50:09 -07:00
Chris Lu	eb7929a971	rename filer2 to filer	2020-09-01 00:21:19 -07:00