343 Commits

Author	SHA1	Message	Date
Chris Lu	e4c63ff2f8	go fmt	2019-11-22 14:51:09 -08:00
Chris Lu	9711a6ffaa	WIP	2019-11-18 19:24:37 -08:00
chenwanli	295f3beed5	rm ldb and bdb directory	2019-11-19 09:35:06 +08:00
Chris Lu	c6e8225a20	adjust memory mapped file size ... related to https://github.com/chrislusf/seaweedfs/pull/1087	2019-11-12 21:05:48 -08:00
Lei Liu	46755ea1e1	fix master maintenance logic ... Signed-off-by: Lei Liu <lei01.liu@horizon.ai>	2019-11-12 14:46:10 +08:00
Chris Lu	85f8649320	refactor memory mapped file into backend storage	2019-11-09 00:10:59 -08:00
Chris Lu	c5c1d83d91	Merge branch 'master' into refactoring_dat_backend	2019-11-08 22:54:41 -08:00
Chris Lu	c34ffed43f	go fmt	2019-11-08 22:47:50 -08:00
Chris Lu	84c503c6a7	adjust ec reading log level	2019-11-08 22:41:02 -08:00
zhangsong	1dd101f782	use read lock to avoid io hang during heartbeat	2019-11-08 20:27:55 +08:00
Chris Lu	db30a46050	skip memory mapped file when compacting	2019-10-29 23:34:38 -07:00
Chris Lu	5b950c735e	Merge branch 'master' into refactoring_dat_backend	2019-10-29 23:18:41 -07:00
Chris Lu	57e441d67b	fix compaction logic	2019-10-29 23:18:01 -07:00
Chris Lu	b7156291a8	adjust variable names	2019-10-29 23:16:43 -07:00
Chris Lu	4b5ba4927f	adjust NewDiskFile() paramaters	2019-10-29 22:37:36 -07:00
Chris Lu	cd7ce720c7	fix test	2019-10-29 00:37:15 -07:00
Chris Lu	19b6a16003	changed from os.file to backend.DataStorageBackend	2019-10-29 00:35:16 -07:00
Chris Lu	7a51a9a582	refactor: simplifying to ReadAt() and WriteAt()	2019-10-25 00:11:25 -07:00
Chris Lu	46ed2ca902	refactoring	2019-10-24 23:41:32 -07:00
Chris Lu	f937933b3d	refactoring	2019-10-23 22:25:53 -07:00
Chris Lu	3c865ee39b	fix missing needle header read	2019-10-22 00:57:47 -07:00
Chris Lu	fc412e428b	refactor ScanVolumeFileFrom()	2019-10-22 00:50:30 -07:00
Chris Lu	c9a183eb69	refactor memory map related code	2019-10-22 00:49:42 -07:00
Chris Lu	fec07c829d	go fmt	2019-10-21 23:03:48 -07:00
Chris Lu	faec9076a4	adjust parameter names	2019-10-21 22:57:01 -07:00
j.laycock	2e2fe00dbd	Comma, no space?	2019-10-18 11:31:25 +01:00
j.laycock	248f3be6e3	using a space instead of a comma to hopefully fix the build!	2019-10-18 11:23:02 +01:00
j.laycock	2c455841ea	Make volumeCreate more consistent between all 3 implementations.	2019-10-18 11:01:45 +01:00
j.laycock	b0ddad6889	Fix volume_create breaking the build	2019-10-18 10:32:07 +01:00
joeslay	d53aee179b	Merge pull request #10 from chrislusf/master ... merge seaweed master	2019-10-14 16:03:40 +01:00
Chris Lu	87e5a02a99	fix logic error	2019-10-09 00:07:18 -07:00
Chris Lu	09874f0d16	volume: return error if superblock is not initialized ... fix https://github.com/chrislusf/seaweedfs/issues/1079	2019-10-09 00:02:50 -07:00
j.laycock	eb27c2b037	Make releaseMemory private and return byte array instead, fix other platform compilation issues, reduce in-memory chunk size.	2019-10-01 12:21:44 +01:00
j.laycock	d5f5acb734	limit locking physical memory to 80% of max physical memory	2019-09-20 12:44:29 +01:00
j.laycock	476140fd6b	minor change to setProcessWorkingSetSize function	2019-09-19 11:59:00 +01:00
j.laycock	6fc6322c90	Change joeslay paths to chrislusf paths	2019-09-12 14:18:21 +01:00
joeslay	d8c34b032f	Merge pull request #6 from chrislusf/master ... merge seaweed master	2019-09-12 11:44:09 +01:00
Chris Lu	5e9c65469e	volume: skip readonly checking when Destroy() ... fix https://github.com/chrislusf/seaweedfs/issues/1063	2019-09-11 09:45:09 -07:00
j.laycock	c1a928887a	Add some comments/documentation	2019-09-11 10:42:37 +01:00
joeslay	9ea9a5e97a	Merge pull request #5 from chrislusf/master ... merge seaweed master	2019-09-11 10:25:27 +01:00
j.laycock	15a4c91c28	Remove Finalizer	2019-09-10 17:05:54 +01:00
j.laycock	9c9dff7386	Virtual lock memory pages and Set Process Working set size to hint to windows harder not to write pages to disk as much, add finalize function, minor renaming	2019-09-10 16:18:51 +01:00
Chris Lu	02710f9624	refactoring: remove unused functions	2019-09-09 10:03:41 -07:00
Chris Lu	0f861d23a2	avoid nil needle map ... fix https://github.com/chrislusf/seaweedfs/issues/1061	2019-09-09 09:48:08 -07:00
j.laycock	63acc8c972	rename mem_buffer to mBuffer	2019-09-05 13:46:29 +01:00
j.laycock	44ae041e80	rename more memorymapped variables to memoryMapMaxSizeMB	2019-09-05 13:42:23 +01:00
j.laycock	5885ab67b3	rename volume property MemoryMap to MemoryMapMaxSizeMB	2019-09-05 11:56:48 +01:00
j.laycock	5a6dfb05fc	Only use truncate flag when creating non memory map files, rename and use memory map size for reserving max file size	2019-09-05 11:46:12 +01:00
j.laycock	f6146d6ad2	use 0 instead of false for max memory flag	2019-09-05 11:43:18 +01:00
j.laycock	4257582db5	Allocate in 16MB chunks, make creation of memory maps always aligned to 16MB chunks	2019-09-05 11:15:01 +01:00