9520 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
j.laycock	303234ebd5	change go.mod	2019-09-05 13:48:55 +01:00
j.laycock	63acc8c972	rename mem_buffer to mBuffer	2019-09-05 13:46:29 +01:00
j.laycock	44ae041e80	rename more memorymapped variables to memoryMapMaxSizeMB	2019-09-05 13:42:23 +01:00
j.laycock	5885ab67b3	rename volume property MemoryMap to MemoryMapMaxSizeMB	2019-09-05 11:56:48 +01:00
j.laycock	5a6dfb05fc	Only use truncate flag when creating non memory map files, rename and use memory map size for reserving max file size	2019-09-05 11:46:12 +01:00
j.laycock	f6146d6ad2	use 0 instead of false for max memory flag	2019-09-05 11:43:18 +01:00
j.laycock	4257582db5	Allocate in 16MB chunks, make creation of memory maps always aligned to 16MB chunks	2019-09-05 11:15:01 +01:00
j.laycock	84f2dc3b53	Remove test code	2019-09-05 11:14:02 +01:00
Chris Lu	20d90dea5a	filer: avoid hard-coded upload timeout	2019-09-05 01:26:59 -07:00
Tom Maxwell	4a878c0006	Changed the InMemory bool to a uint32 so that it can be used to alter how much space to reserve	2019-09-04 15:27:14 +01:00
joeslay	6ee65356e3	Merge pull request #3 from chrislusf/master ... merge seaweed master	2019-09-04 14:58:04 +01:00
j.laycock	cc756ddd79	Rename End_of_file variable, implement platform indepenent memory_map.go	2019-09-04 14:24:17 +01:00
Chris Lu	d9a997cb9e	work with travis	2019-09-03 11:26:11 -07:00
j.laycock	9aa0859697	Remove inmemory from vaccum stuff	2019-09-03 18:20:45 +01:00
Chris Lu	6361e2b2fc	fix travis	2019-09-03 10:20:16 -07:00
j.laycock	de5a7e60a2	remove temp hack	2019-09-03 18:20:09 +01:00
j.laycock	cbd0a98fa1	Add InMemory to Volume Grow structure	2019-09-03 18:19:02 +01:00
Chris Lu	e33f5f5b33	travis build	2019-09-03 09:24:35 -07:00
Chris Lu	ee8bcb0c12	remove println	2019-09-03 09:22:56 -07:00
j.laycock	1f01eb78e8	Rename mem_map to mMap, remove some in_memory variables being passed around, added MemoryMapped member to volume struct	2019-09-03 17:00:59 +01:00
Tom Maxwell	d637d86d22	Changes to try and pass the URL parameters through - in memory flag not working still	2019-09-03 15:41:28 +01:00
j.laycock	9a459d984b	Do not vacuum memory mapped files	2019-09-03 15:05:43 +01:00
Chris Lu	89a0cb2e11	1.43	2019-09-03 01:31:58 -07:00
Chris Lu	d361ecb23b	HCFS: 1.1.6	2019-09-03 01:31:31 -07:00
Chris Lu	fd509c3844	HCFS: working with HBase	2019-09-03 00:50:28 -07:00
j.laycock	0123c7a898	Change to max 2GB for now	2019-09-02 17:46:22 +01:00
joeslay	e91139348e	Merge pull request #2 from chrislusf/master ... merge seaweed master	2019-09-02 11:39:40 +01:00
j.laycock	595a1beff0	Swap imports to use joeslay	2019-09-02 11:28:40 +01:00
Chris Lu	60c9215a00	HCFS: avoid verbose file not found exception stack trace	2019-09-01 21:40:26 -07:00
Chris Lu	af8b413a9c	HCFS: fix mkdirs NPE	2019-09-01 12:25:06 -07:00
Chris Lu	cb299dfaa2	HCFS: use latest grpc versions, separate hadoop2 and hadoop3	2019-09-01 03:46:51 -07:00
j.laycock	1e62a2b233	Fix memory not being unmapped	2019-08-30 16:55:33 +01:00
Chris Lu	5f283498c0	Merge pull request #1057 from ingardm/master ... new tool based on see_dat to remove duplicate fids	2019-08-30 08:52:50 -07:00
j.laycock	840ccdc35d	Refactor to pass memory maps by reference instead of value, fix memory maps not being created properly or written to properly	2019-08-30 12:30:00 +01:00
j.laycock	dc50701e7d	Overload createFile function, expose File in memory_map struct, delete from memory_map map on delete	2019-08-30 12:30:00 +01:00
j.laycock	523f3a12b3	use Os.File/uintptr instead of windows.Handle in memory map struct	2019-08-30 12:30:00 +01:00
j.laycock	0e5d3b1a70	Move memory_map_windows to new folder, intercept most of the read and write calls to volume dat files	2019-08-30 12:30:00 +01:00
Ingard Mevåg	f7a0a0e62c	new tool based on see_dat to remove duplicate fids. Duped fids could happen if a volume server was shut down before it could complete vacumming	2019-08-30 11:26:50 +02:00
Chris Lu	170ee6ef0f	tmp	2019-08-29 23:29:10 -07:00
Chris Lu	58168a8c52	volume: truncate dat files when creating	2019-08-26 13:01:57 -07:00
joeslay	36bde84000	Merge pull request #1 from chrislusf/master ... merge changes from chrislusf/seaweed master	2019-08-23 17:03:37 +01:00
j.laycock	1e89e719b3	Add windows memory map functions to storage package	2019-08-23 16:19:00 +01:00
Chris Lu	396c4fc143	Merge pull request #1054 from chrislusf/revert-1049-master ... Revert "use std encoding lib"	2019-08-23 08:06:19 -07:00
Chris Lu	35d471a818	Revert "use std encoding lib"	2019-08-23 07:59:09 -07:00
Chris Lu	fa160e00f3	Merge pull request #1051 from xushuxun/master ... volume: read dat files' last modified time correctly	2019-08-20 22:25:37 -07:00
xushuxun	9af9f36b89	volume: read dat files' last modified time no matter dat files are catWrite or readonly	2019-08-21 11:26:01 +08:00
Chris Lu	b439055640	Merge pull request #1049 from divinerapier/master ... use std encoding lib	2019-08-19 09:10:56 -07:00
divinerapier	e798e4e9c5	use std encoding lib ... Signed-off-by: divinerapier <poriter.coco@gmail.com>	2019-08-19 18:07:54 +08:00
Chris Lu	41caf8a777	Merge pull request #1045 from xushuxun/master ... weed backup: add ttl and replication parameter	2019-08-15 20:47:35 -07:00
xushuxun	5904d78bd4	weed backup: add ttl and replication parameter	2019-08-16 11:05:22 +08:00