92 Commits

Author	SHA1	Message	Date
Chris Lu	13bfe5deef	same logic for reading random access files from Go	2020-08-16 21:14:39 -07:00
Chris Lu	15dc0a704d	Revert "add read ahead input stream" ... This reverts commit b3089dcc8e.	2020-08-03 09:11:24 -07:00
Chris Lu	b3089dcc8e	add read ahead input stream	2020-08-03 09:06:09 -07:00
Chris Lu	53190a9972	fix compilation	2020-08-03 09:05:49 -07:00
Chris Lu	d6073f6386	ensure GC	2020-08-03 00:40:23 -07:00
Chris Lu	9981748498	only try to cache chunk manifest chunks	2020-08-02 23:50:44 -07:00
Chris Lu	0ed1f43d29	decompress after decrypt if necessary ... skip any decompress error	2020-08-02 23:50:23 -07:00
Chris Lu	e1f070a9a1	Hadoop: 1.4.4	2020-08-01 12:42:41 -07:00
Chris Lu	4d9da157bc	HDFS: read gzip content	2020-08-01 11:36:29 -07:00
Chris Lu	8cc35e2c13	fix wrong decompression logic	2020-08-01 11:19:57 -07:00
Chris Lu	5080bc1d69	debug	2020-07-29 18:26:26 -07:00
Chris Lu	daf8c0c8ce	cache vid locations	2020-07-29 18:25:52 -07:00
Chris Lu	b684c312d2	minor	2020-07-29 18:25:35 -07:00
Chris Lu	735912e0f5	enable read cache	2020-07-29 17:39:44 -07:00
Chris Lu	648ef566c4	HCFS: avoid lock bottleneck	2020-07-22 22:54:06 -07:00
Chris Lu	6839f96c0c	simplify	2020-07-22 22:52:49 -07:00
Chris Lu	64926d2345	disable ChunkCache	2020-07-20 21:18:58 -07:00
Chris Lu	b380b9e5d7	shared http client	2020-07-20 18:27:11 -07:00
Chris Lu	0e341a2a9a	error logging	2020-07-20 18:26:59 -07:00
Chris Lu	cacc601cc8	ensure changing buffer size requirements	2020-07-20 18:26:48 -07:00
Chris Lu	aee6d89350	before writing and after reading file chunks	2020-07-20 18:26:17 -07:00
Chris Lu	6debe3c3ec	use 1000 as merge factor	2020-07-20 18:25:26 -07:00
Chris Lu	1d724ab237	hdfs: support read write chunk manifest	2020-07-20 03:29:17 -07:00
Chris Lu	d6d95765f9	reduce chunk cache size	2020-07-16 16:19:01 -07:00
Chris Lu	64d7d5fe89	increase inbound message size	2020-07-16 00:33:54 -07:00
Chris Lu	7bca72deed	reuse bytebuffer	2020-07-15 23:33:31 -07:00
Chris Lu	2286d27730	rename	2020-07-15 14:19:15 -07:00
Chris Lu	86c8137546	1.3.4	2020-07-15 13:49:06 -07:00
Chris Lu	22f8aae028	fix compilation	2020-07-15 13:27:10 -07:00
Chris Lu	316e853e0e	option to disable chunk cache	2020-07-15 09:51:51 -07:00
Chris Lu	0db4204c81	add is_file_chunks to filer.proto	2020-07-14 22:42:52 -07:00
Chris Lu	fc9af962ec	1.3.2	2020-07-12 14:51:24 -07:00
Chris Lu	4bd8f3281e	1.3.0 ... * add option to include last entry *	2020-07-11 22:24:02 -07:00
Chris Lu	578f316173	refactoring	2020-07-11 15:33:31 -07:00
Chris Lu	70d8a3a1d3	add SubscribeLocalMetadata without checking persisted meta logs	2020-07-05 15:50:07 -07:00
Chris Lu	37d5b3ba12	replication: pass isFromOtherCluster also to EventNotification ... EventNotification is consistent with message queue and metadata logs.	2020-07-01 08:06:20 -07:00
Chris Lu	31e23e9783	filer: support active<=>active filer replication	2020-06-30 22:53:57 -07:00
Chris Lu	97239ce6f1	rename filechunk is_gzipped to is_compressed	2020-06-20 08:15:49 -07:00
Chris Lu	ca3516ac6d	adjust protoc	2020-06-20 08:00:25 -07:00
Chris Lu	222f93e816	possibly fix concurrent access to entry object in SeaweedOutputStream	2020-06-17 14:59:43 -07:00
Chris Lu	8dfaaeabfd	HCFS: 1.2.8 fix hbase related bugs ... 1. SeaweedFileSystem.listStatus need to work with file also 2. SeaweedRead readChunkView has wrong len	2020-05-24 17:07:34 -07:00
Chris Lu	dfccc3c263	able to read chan and write chan	2020-05-08 02:47:22 -07:00
Chris Lu	1e3e4b3072	add broker connects to filer	2020-05-05 02:05:28 -07:00
Chris Lu	b52b8ec685	Hadoop: fix entry not found for HCFS ... also fix cipher related changes.	2020-04-26 05:21:54 -07:00
Chris Lu	e24b25de78	async meta caching: can stream updates now	2020-04-21 21:16:13 -07:00
Chris Lu	bda82f61bc	filer: able to append to a file	2020-04-17 02:28:09 -07:00
Chris Lu	7764e0465c	refactoring	2020-04-12 21:00:55 -07:00
Chris Lu	6f948e4887	remove configurable topics folder location	2020-04-12 13:07:59 -07:00
Chris Lu	ec2eb8bc48	add If-None-Match and If-Modified-Since ... fix https://github.com/chrislusf/seaweedfs/issues/1269	2020-04-08 08:12:00 -07:00
Chris Lu	2d43f85577	watch entries with common path prefix	2020-04-05 12:51:21 -07:00