435 Commits

Author	SHA1	Message	Date
Chris Lu	11716fbf6f	make reading error more obvious	2020-10-22 13:33:45 -07:00
Chris Lu	3bf0116de1	mount: less channel waiting	2020-10-21 02:16:21 -07:00
Chris Lu	c31b254248	mount: shortcut when there is only one chunk	2020-10-20 23:48:29 -07:00
Chris Lu	898db14729	2.05	2020-10-17 02:42:33 -07:00
Chris Lu	0542911e29	go fmt	2020-10-13 19:50:46 -07:00
Chris Lu	c127da1219	filer: linearize timeout for large chunk of data	2020-10-13 14:04:46 -07:00
Chris Lu	9b4f7fed14	mount: report filer IO error ... related to https://github.com/chrislusf/seaweedfs/issues/1530	2020-10-13 11:21:13 -07:00
Chris Lu	3f7d1d1bf1	Only wait on retryable requests	2020-10-13 00:29:46 -07:00
Chris Lu	b18f21cce1	mount: fix bound tree with filer.path ... fix https://github.com/chrislusf/seaweedfs/issues/1528	2020-10-12 21:58:37 -07:00
Chris Lu	bbd0afd37e	2.04	2020-10-11 21:25:30 -07:00
Chris Lu	4fc673341f	2.03	2020-10-04 21:58:22 -07:00
Chris Lu	707936f482	re-enable caching larger than 16MB ... revert 62ce85610e	2020-10-03 14:12:38 -07:00
Chris Lu	f1e879fe7a	2.02	2020-10-01 07:15:49 -07:00
Chris Lu	b9887504e8	fix test	2020-09-27 23:19:50 -07:00
Chris Lu	f46eae284e	adjust for test	2020-09-27 23:08:11 -07:00
Chris Lu	75aca5e13d	2.01	2020-09-27 23:02:41 -07:00
Chris Lu	c49e2bb9a3	adjust	2020-09-27 12:07:45 -07:00
Chris Lu	62ce85610e	skip caching too large chunks	2020-09-27 11:58:48 -07:00
Chris Lu	9ad2dcca2b	more tests	2020-09-27 11:42:51 -07:00
Chris Lu	e43d86c796	fix pre allocated volume size	2020-09-27 10:58:19 -07:00
Chris Lu	31fc7bb2e1	refactor ... adjust for faster test	2020-09-27 10:41:29 -07:00
Chris Lu	a37535cd9f	avoid non utf-8 in filename ... fix https://github.com/chrislusf/seaweedfs/issues/1493	2020-09-26 00:13:39 -07:00
Chris Lu	1012df7bb5	switch hardlink id from int64 to bytes	2020-09-24 11:11:42 -07:00
Chris Lu	5e239afdfc	hardlink works now	2020-09-24 03:06:48 -07:00
Chris Lu	62563a895a	refactoring	2020-09-20 16:00:01 -07:00
Chris Lu	9cac9c4001	2.00	2020-09-20 00:47:04 -07:00
Chris Lu	f8fea19669	1.99	2020-09-12 13:46:33 -07:00
Chris Lu	ba984a4e29	1.98	2020-09-12 04:13:02 -07:00
Chris Lu	446e476a11	go fmt	2020-09-12 04:08:03 -07:00
Chris Lu	ab201c2798	1.97	2020-09-11 13:47:50 -07:00
Chris Lu	19537c9d21	1.96	2020-09-10 19:52:07 -07:00
Chris Lu	660d7c0edd	1.95	2020-09-10 01:32:05 -07:00
Chris Lu	387ab6796f	filer: cross cluster synchronization	2020-09-09 11:21:23 -07:00
Chris Lu	4fc0bd1a81	return http response directly	2020-09-09 03:53:09 -07:00
Chris Lu	c18ea21f7a	1.94	2020-09-07 13:13:53 -07:00
Chris Lu	432fe3d926	1.93	2020-09-06 12:12:09 -07:00
Chris Lu	b8f32bcab9	filer: compress stored metadata	2020-09-03 11:00:20 -07:00
Chris Lu	dd52037c27	1.92	2020-08-30 22:56:35 -07:00
Chris Lu	a41588279a	change log level 5 to 4	2020-08-30 20:12:04 -07:00
Chris Lu	b69cb74c03	read meta logs by timestamp ... pass in event ts when moving logs meta aggregator reads in memory logs only	2020-08-29 17:37:19 -07:00
Chris Lu	ca658a97c5	add signatures to messages to avoid double processing	2020-08-28 23:48:48 -07:00
Chris Lu	0be6863c87	rename	2020-08-26 22:40:15 -07:00
Chris Lu	5f55a87101	close http response	2020-08-24 00:32:44 -07:00
Chris Lu	81a8aa6581	1.91	2020-08-23 17:28:40 -07:00
Chris Lu	aee27ccbe1	multiple fixes ... * adjust isOpen count * move ContinuousDirtyPages lock to filehandle * fix problem with MergeIntoVisibles, avoid reusing slices * let filer delete the garbage	2020-08-23 15:48:02 -07:00
Chris Lu	99d05f758c	adjust logs	2020-08-18 23:39:18 -07:00
Chris Lu	6a92f0bc7a	refactoring to typed Size ... Go is amazing with refactoring!	2020-08-18 17:04:28 -07:00
Chris Lu	09e126bae5	refactoring: use interface	2020-08-17 20:20:08 -07:00
Chris Lu	be4d42b8e2	rename	2020-08-17 20:15:53 -07:00
Chris Lu	97e54a80d4	rename variables	2020-08-17 16:05:13 -07:00
Chris Lu	ff200398bb	1.90	2020-08-16 21:18:50 -07:00
Chris Lu	b71df82292	1.89	2020-08-16 00:57:28 -07:00
Chris Lu	003d48da21	adjust logs	2020-08-15 19:55:28 -07:00
Chris Lu	e74dc4e4bc	add back fs node cache for renaming	2020-08-09 21:56:09 -07:00
Chris Lu	b056707770	1.88	2020-08-08 22:55:12 -07:00
Chris Lu	20e2ac1add	filer: store md5 metadata for files uploaded by filer ... fix https://github.com/chrislusf/seaweedfs/issues/1412	2020-08-06 10:04:17 -07:00
Chris Lu	1b3a80dd3d	non-fatal error	2020-08-01 13:46:52 -07:00
Chris Lu	bbbea8159c	http request use gzip if possible	2020-08-01 13:20:52 -07:00
Chris Lu	2f03481cb2	in case when content is not compressed	2020-08-01 13:08:10 -07:00
Chris Lu	a6b59d50f7	1.87	2020-07-30 13:52:04 -07:00
Chris Lu	7a7e70b6cc	1.86	2020-07-20 23:39:58 -07:00
Chris Lu	befb396892	mount: resolve home directory ... fix https://github.com/chrislusf/seaweedfs/issues/1391	2020-07-16 22:38:55 -07:00
Chris Lu	ddec7b2bb9	go fmt	2020-07-14 07:34:16 -07:00
Chris Lu	5a4f258a8c	1.85	2020-07-12 17:34:09 -07:00
Chris Lu	224103e13b	aggregated logs has empty flushFn	2020-07-11 09:12:03 -07:00
Chris Lu	b813fac4a3	1.84	2020-06-28 07:28:21 -07:00
Chris Lu	f0f884edd5	1.83	2020-06-27 15:46:59 -07:00
Chris Lu	bef356ce4c	since we already know the chunk size, no need to iterate	2020-06-27 12:51:04 -07:00
Chris Lu	a808b3b5df	incase the memory data is too small	2020-06-27 11:59:15 -07:00
Chris Lu	3dbd51c3c2	a little bit more efficient	2020-06-26 10:02:37 -07:00
Chris Lu	212b6e7d42	error logging	2020-06-26 10:01:55 -07:00
Chris Lu	48b23f2fdd	FUSE mount: prevent concurrent modification	2020-06-26 10:00:48 -07:00
Chris Lu	3cec4b3c49	FUSE mount: fix file id written twice? ... fix https://github.com/chrislusf/seaweedfs/issues/1373	2020-06-25 20:11:49 -07:00
Chris Lu	5be12eea37	zstd fix	2020-06-24 11:39:12 -07:00
Chris Lu	fe60db404a	prepare for zstd	2020-06-23 09:12:02 -07:00
Chris Lu	3080c197e3	rename UnCompressData to DecompressData	2020-06-20 08:16:16 -07:00
Chris Lu	a735fd767c	adjust uncompress data	2020-06-20 08:01:00 -07:00
Chris Lu	e912fd15e3	renaming	2020-06-19 22:45:27 -07:00
Chris Lu	c48b407053	1.82	2020-06-19 13:47:27 -07:00
Chris Lu	c0283eee1a	more test cases	2020-06-19 09:45:42 -07:00
Chris Lu	55b6efb755	fix checking visited nodes	2020-06-19 09:45:42 -07:00
Chris Lu	546709c1de	check has visited by the boundary	2020-06-18 22:28:17 -07:00
Chris Lu	0e3b970c0c	added bounded tree to track exploration boundary	2020-06-18 21:09:58 -07:00
Chris Lu	95a9686eaf	1.81	2020-06-10 13:00:42 -07:00
Chris Lu	bb3e86fbd5	auto create non-existing cache directory ... fix https://github.com/chrislusf/seaweedfs/issues/1350	2020-06-08 08:49:57 -07:00
Chris Lu	b8e346cc86	1.80	2020-06-05 15:29:25 -07:00
Chris Lu	45a9d852d3	go fmt	2020-06-05 15:27:10 -07:00
Chris Lu	bc2ec6774d	inject git version into build	2020-06-02 00:10:38 -07:00
bingoohuang	1f8782a1ed	try showing the first 100 volume ids and an extra ...	2020-05-29 16:15:33 +08:00
bingoohuang	1a642b9876	add Volume Ids column only for max 100 volumes for convenience in the master ui.	2020-05-29 15:37:58 +08:00
bingoohuang	accb4964b7	util.BytesToHumanReadable	2020-05-29 10:00:07 +08:00
Chris Lu	ed9e4dc749	1.79 ... fix compilation problem	2020-05-19 08:21:51 -07:00
Chris Lu	85aeead3d2	1.78	2020-05-17 20:28:04 -07:00
Chris Lu	759cda0fe2	log	2020-05-16 18:47:41 -07:00
Chris Lu	4b7fa31468	ensure montonically increasing tsNs	2020-05-11 01:53:54 -07:00
Chris Lu	39e72fb23c	go fmt	2020-05-10 03:50:30 -07:00
Chris Lu	6bf3eb69cb	async chan write read, no write for closed chan	2020-05-10 03:48:35 -07:00
Chris Lu	dfccc3c263	able to read chan and write chan	2020-05-08 02:47:22 -07:00
Chris Lu	f9b6178b8f	log messages	2020-04-30 03:05:34 -07:00
Chris Lu	4e16a90454	for debugging	2020-04-30 02:19:32 -07:00
Chris Lu	5a0986dca0	reset on getting the buffer	2020-04-29 02:41:01 -07:00
wuyuxiang	6850d28d6b	refacotr: move signal handling and pprof to grace package	2020-04-28 14:10:23 +08:00
Chris Lu	f4fcde05b6	1.77	2020-04-26 05:54:47 -07:00
Chris Lu	369aa8a10a	1.76	2020-04-22 23:31:59 -07:00
Chris Lu	72c5dba4d4	1.75	2020-04-21 22:03:07 -07:00
Chris Lu	cb3985be70	go fmt	2020-04-20 17:48:06 -07:00
Chris Lu	5eb83dfbd3	add memory buffer size limit	2020-04-20 17:43:50 -07:00
Chris Lu	258fba8a0f	continue for reading from sealed memory buffer	2020-04-20 17:28:18 -07:00
Chris Lu	4bf959edf0	message broker: read also from sealed memory buffer	2020-04-20 17:26:38 -07:00
Chris Lu	bd43c62fbd	lower the test criteria	2020-04-20 03:08:10 -07:00
Chris Lu	c3f9fdf48f	adjust test	2020-04-20 02:54:21 -07:00
Chris Lu	5e8bb86995	close the connection with better accouting	2020-04-20 02:53:50 -07:00
Chris Lu	2955b96ef1	refactor	2020-04-19 23:54:32 -07:00
Chris Lu	ce3cb25cfb	working for in memory single log buffer	2020-04-19 23:37:50 -07:00
Chris Lu	e0f5996560	fix "call of Unmarshal passes non-pointer as second argument"	2020-04-17 10:04:41 -07:00
Chris Lu	f5a748d33c	refactoring	2020-04-16 02:55:09 -07:00
Chris Lu	23715af402	Merge pull request #1273 from wyxloading/config_race ... Fix data race about config	2020-04-13 22:24:51 -07:00
Chris Lu	2b5c4fbbf3	tiered caching ... 1/4 for small less than 1MB files. 1/4 for 1~4MB files, 1/2 for bigger than 4MB files	2020-04-13 22:19:27 -07:00
Chris Lu	f282ed444b	refactoring	2020-04-13 21:58:10 -07:00
wuyuxiang	b556d3d035	Fix data race about config	2020-04-14 10:22:40 +08:00
Chris Lu	5c9e91393f	1.74	2020-04-13 10:25:48 -07:00
Chris Lu	7764e0465c	refactoring	2020-04-12 21:00:55 -07:00
Chris Lu	94e35cdb35	mount: fix ... fix bug found by git bisect, but I do not understand why it can cause error!	2020-04-12 03:34:36 -07:00
Chris Lu	2a1f396df5	avoid duplicated setting chunks into cache	2020-04-12 01:06:50 -07:00
Chris Lu	b9b7da905e	handle nil chunk cache	2020-04-12 01:00:12 -07:00
Chris Lu	df97da25f9	mount: add on disk caching	2020-04-11 21:12:41 -07:00
Chris Lu	d7f3acb2c0	refactor	2020-04-11 12:45:24 -07:00
Chris Lu	ed54682598	refactoring	2020-04-11 12:43:17 -07:00
Chris Lu	e909b55633	refactoring	2020-04-11 12:39:46 -07:00
Chris Lu	43c62a8a95	1.73	2020-04-09 21:44:30 -07:00
Chris Lu	59f40e2027	volume: best effort to detect ip address ... fix https://github.com/chrislusf/seaweedfs/issues/1264	2020-04-09 00:26:24 -07:00
Chris Lu	f6a7e79dc3	weed shell: simplify CLI option for filer	2020-04-08 23:57:15 -07:00
Chris Lu	8764bdb9df	1.72	2020-04-08 22:35:14 -07:00
Chris Lu	00b993a234	add util for md5	2020-04-08 22:30:38 -07:00
Chris Lu	b51d8f03bb	1.71	2020-04-05 22:04:16 -07:00
Chris Lu	91da7057b1	refactoring	2020-04-05 13:11:43 -07:00
Chris Lu	7bc3c93512	add util.PathJoin	2020-04-05 12:40:46 -07:00
Chris Lu	50a5018b7f	writing meta logs is working	2020-03-30 01:19:33 -07:00
Chris Lu	be6c2f8511	1.70	2020-03-29 13:40:55 -07:00
Chris Lu	057722bbf4	return part of the chunk if chunkview is not the full chunk	2020-03-29 00:54:39 -07:00
Chris Lu	005b4ab3fe	1.69	2020-03-27 04:51:31 -07:00
Chris Lu	5463560912	small test	2020-03-26 23:50:07 -07:00
Chris Lu	0a05052b5c	1.68	2020-03-26 22:22:36 -07:00
Chris Lu	dd5b582d05	go fmt	2020-03-26 00:09:01 -07:00
Chris Lu	2e4fadd10a	fix fscache move	2020-03-25 22:19:19 -07:00
Chris Lu	c0f0fdb3ba	refactoring	2020-03-23 00:01:34 -07:00
Chris Lu	d6412f27a0	logging	2020-03-22 18:32:56 -07:00
Chris Lu	3b3e063f25	1.67	2020-03-20 23:42:49 -07:00
Chris Lu	d3e4a31058	filer: fix where deletion can miss under high concurrency	2020-03-20 23:39:32 -07:00
Chris Lu	4bc19f1e52	master: fix connections count reporting	2020-03-20 22:41:37 -07:00