109 Commits

Author	SHA1	Message	Date
Chris Lu	4f195a54ca	1.4.5 ... change the scope for hadoop depencies to provided	2020-08-09 16:34:47 -07:00
Chris Lu	15dc0a704d	Revert "add read ahead input stream" ... This reverts commit b3089dcc8e.	2020-08-03 09:11:24 -07:00
Chris Lu	b3089dcc8e	add read ahead input stream	2020-08-03 09:06:09 -07:00
Chris Lu	53190a9972	fix compilation	2020-08-03 09:05:49 -07:00
Chris Lu	d6073f6386	ensure GC	2020-08-03 00:40:23 -07:00
Chris Lu	9981748498	only try to cache chunk manifest chunks	2020-08-02 23:50:44 -07:00
Chris Lu	0ed1f43d29	decompress after decrypt if necessary ... skip any decompress error	2020-08-02 23:50:23 -07:00
Chris Lu	e1f070a9a1	Hadoop: 1.4.4	2020-08-01 12:42:41 -07:00
Chris Lu	4d9da157bc	HDFS: read gzip content	2020-08-01 11:36:29 -07:00
Chris Lu	8cc35e2c13	fix wrong decompression logic	2020-08-01 11:19:57 -07:00
Chris Lu	6b41c5250b	Hadoop file system: 1.4.3 ... added buffered fs input stream	2020-07-29 21:33:10 -07:00
Chris Lu	5080bc1d69	debug	2020-07-29 18:26:26 -07:00
Chris Lu	daf8c0c8ce	cache vid locations	2020-07-29 18:25:52 -07:00
Chris Lu	b684c312d2	minor	2020-07-29 18:25:35 -07:00
Chris Lu	735912e0f5	enable read cache	2020-07-29 17:39:44 -07:00
Chris Lu	6f058b3791	HCFS: 1.4.1	2020-07-22 22:56:53 -07:00
Chris Lu	648ef566c4	HCFS: avoid lock bottleneck	2020-07-22 22:54:06 -07:00
Chris Lu	6839f96c0c	simplify	2020-07-22 22:52:49 -07:00
Chris Lu	54f9f9138e	HCFS: 1.4.0	2020-07-20 23:25:08 -07:00
Chris Lu	64926d2345	disable ChunkCache	2020-07-20 21:18:58 -07:00
Chris Lu	b380b9e5d7	shared http client	2020-07-20 18:27:11 -07:00
Chris Lu	0e341a2a9a	error logging	2020-07-20 18:26:59 -07:00
Chris Lu	cacc601cc8	ensure changing buffer size requirements	2020-07-20 18:26:48 -07:00
Chris Lu	aee6d89350	before writing and after reading file chunks	2020-07-20 18:26:17 -07:00
Chris Lu	6debe3c3ec	use 1000 as merge factor	2020-07-20 18:25:26 -07:00
Chris Lu	1d724ab237	hdfs: support read write chunk manifest	2020-07-20 03:29:17 -07:00
Chris Lu	f90d2c93c9	1.3.9 remove logs	2020-07-17 16:11:57 -07:00
Chris Lu	3abd74b1d7	1.3.8	2020-07-17 15:46:20 -07:00
Chris Lu	54445b207d	Hadoop: 1.3.6	2020-07-16 16:20:01 -07:00
Chris Lu	d6d95765f9	reduce chunk cache size	2020-07-16 16:19:01 -07:00
Chris Lu	64d7d5fe89	increase inbound message size	2020-07-16 00:33:54 -07:00
Chris Lu	7bca72deed	reuse bytebuffer	2020-07-15 23:33:31 -07:00
Chris Lu	2286d27730	rename	2020-07-15 14:19:15 -07:00
Chris Lu	86c8137546	1.3.4	2020-07-15 13:49:06 -07:00
Chris Lu	22f8aae028	fix compilation	2020-07-15 13:27:10 -07:00
Chris Lu	bc3be0bb37	Hadoop: 1.3.3 ... improve memory efficiency	2020-07-15 13:25:44 -07:00
Chris Lu	316e853e0e	option to disable chunk cache	2020-07-15 09:51:51 -07:00
Chris Lu	0db4204c81	add is_file_chunks to filer.proto	2020-07-14 22:42:52 -07:00
Chris Lu	fc9af962ec	1.3.2	2020-07-12 14:51:24 -07:00
Chris Lu	4bd8f3281e	1.3.0 ... * add option to include last entry *	2020-07-11 22:24:02 -07:00
Chris Lu	578f316173	refactoring	2020-07-11 15:33:31 -07:00
Chris Lu	70d8a3a1d3	add SubscribeLocalMetadata without checking persisted meta logs	2020-07-05 15:50:07 -07:00
Chris Lu	37d5b3ba12	replication: pass isFromOtherCluster also to EventNotification ... EventNotification is consistent with message queue and metadata logs.	2020-07-01 08:06:20 -07:00
Chris Lu	31e23e9783	filer: support active<=>active filer replication	2020-06-30 22:53:57 -07:00
Chris Lu	97239ce6f1	rename filechunk is_gzipped to is_compressed	2020-06-20 08:15:49 -07:00
Chris Lu	ca3516ac6d	adjust protoc	2020-06-20 08:00:25 -07:00
Chris Lu	ce79ec0bd4	HCFS: 1.2.9 fix concurrent modification	2020-06-18 07:52:32 -07:00
Chris Lu	222f93e816	possibly fix concurrent access to entry object in SeaweedOutputStream	2020-06-17 14:59:43 -07:00
Chris Lu	8dfaaeabfd	HCFS: 1.2.8 fix hbase related bugs ... 1. SeaweedFileSystem.listStatus need to work with file also 2. SeaweedRead readChunkView has wrong len	2020-05-24 17:07:34 -07:00
Chris Lu	dfccc3c263	able to read chan and write chan	2020-05-08 02:47:22 -07:00