106 Commits

Author	SHA1	Message	Date
Chris Lu	ace0ea3d28	s3: avoid duplicated bucket	2020-10-15 10:52:20 -07:00
Chris Lu	d5fcb0f474	Hadoop: printout the entry creation error message	2020-10-11 15:11:16 -07:00
Chris Lu	ea13e0523b	fix logging	2020-10-11 14:59:48 -07:00
Chris Lu	9449100757	adjust throwing exception	2020-10-10 01:06:54 -07:00
Chris Lu	d3d3609a03	adjust logging	2020-10-10 01:04:31 -07:00
Chris Lu	6fc272f913	adjust throwing exception	2020-10-10 01:03:04 -07:00
Chris Lu	00a75d7c99	Hadoop: fix reading file tail	2020-10-10 00:57:57 -07:00
Chris Lu	e1a3ffcdbf	Hadoop: add exponential back off for failed reads	2020-10-10 00:57:57 -07:00
Chris Lu	1012df7bb5	switch hardlink id from int64 to bytes	2020-09-24 11:11:42 -07:00
Chris Lu	5e239afdfc	hardlink works now	2020-09-24 03:06:48 -07:00
Chris Lu	cb427d48fa	filer report metrics configuration	2020-09-17 06:46:51 -07:00
Chris Lu	387ab6796f	filer: cross cluster synchronization	2020-09-09 11:21:23 -07:00
Chris Lu	bba90ff3c8	read filer signature	2020-09-05 22:52:15 -07:00
Chris Lu	ca658a97c5	add signatures to messages to avoid double processing	2020-08-28 23:48:48 -07:00
Chris Lu	13bfe5deef	same logic for reading random access files from Go	2020-08-16 21:14:39 -07:00
Chris Lu	15dc0a704d	Revert "add read ahead input stream" ... This reverts commit b3089dcc8e.	2020-08-03 09:11:24 -07:00
Chris Lu	b3089dcc8e	add read ahead input stream	2020-08-03 09:06:09 -07:00
Chris Lu	53190a9972	fix compilation	2020-08-03 09:05:49 -07:00
Chris Lu	d6073f6386	ensure GC	2020-08-03 00:40:23 -07:00
Chris Lu	9981748498	only try to cache chunk manifest chunks	2020-08-02 23:50:44 -07:00
Chris Lu	0ed1f43d29	decompress after decrypt if necessary ... skip any decompress error	2020-08-02 23:50:23 -07:00
Chris Lu	e1f070a9a1	Hadoop: 1.4.4	2020-08-01 12:42:41 -07:00
Chris Lu	4d9da157bc	HDFS: read gzip content	2020-08-01 11:36:29 -07:00
Chris Lu	8cc35e2c13	fix wrong decompression logic	2020-08-01 11:19:57 -07:00
Chris Lu	5080bc1d69	debug	2020-07-29 18:26:26 -07:00
Chris Lu	daf8c0c8ce	cache vid locations	2020-07-29 18:25:52 -07:00
Chris Lu	b684c312d2	minor	2020-07-29 18:25:35 -07:00
Chris Lu	735912e0f5	enable read cache	2020-07-29 17:39:44 -07:00
Chris Lu	648ef566c4	HCFS: avoid lock bottleneck	2020-07-22 22:54:06 -07:00
Chris Lu	6839f96c0c	simplify	2020-07-22 22:52:49 -07:00
Chris Lu	64926d2345	disable ChunkCache	2020-07-20 21:18:58 -07:00
Chris Lu	b380b9e5d7	shared http client	2020-07-20 18:27:11 -07:00
Chris Lu	0e341a2a9a	error logging	2020-07-20 18:26:59 -07:00
Chris Lu	cacc601cc8	ensure changing buffer size requirements	2020-07-20 18:26:48 -07:00
Chris Lu	aee6d89350	before writing and after reading file chunks	2020-07-20 18:26:17 -07:00
Chris Lu	6debe3c3ec	use 1000 as merge factor	2020-07-20 18:25:26 -07:00
Chris Lu	1d724ab237	hdfs: support read write chunk manifest	2020-07-20 03:29:17 -07:00
Chris Lu	d6d95765f9	reduce chunk cache size	2020-07-16 16:19:01 -07:00
Chris Lu	64d7d5fe89	increase inbound message size	2020-07-16 00:33:54 -07:00
Chris Lu	7bca72deed	reuse bytebuffer	2020-07-15 23:33:31 -07:00
Chris Lu	2286d27730	rename	2020-07-15 14:19:15 -07:00
Chris Lu	86c8137546	1.3.4	2020-07-15 13:49:06 -07:00
Chris Lu	22f8aae028	fix compilation	2020-07-15 13:27:10 -07:00
Chris Lu	316e853e0e	option to disable chunk cache	2020-07-15 09:51:51 -07:00
Chris Lu	0db4204c81	add is_file_chunks to filer.proto	2020-07-14 22:42:52 -07:00
Chris Lu	fc9af962ec	1.3.2	2020-07-12 14:51:24 -07:00
Chris Lu	4bd8f3281e	1.3.0 ... * add option to include last entry *	2020-07-11 22:24:02 -07:00
Chris Lu	578f316173	refactoring	2020-07-11 15:33:31 -07:00
Chris Lu	70d8a3a1d3	add SubscribeLocalMetadata without checking persisted meta logs	2020-07-05 15:50:07 -07:00
Chris Lu	37d5b3ba12	replication: pass isFromOtherCluster also to EventNotification ... EventNotification is consistent with message queue and metadata logs.	2020-07-01 08:06:20 -07:00