31 Commits

Author	SHA1	Message	Date
Chris Lu	c0f0fdb3ba	refactoring	2020-03-23 00:01:34 -07:00
Chris Lu	7b37178716	filer: close stores if interrupted	2020-03-14 20:30:26 -07:00
Chris Lu	d214cefc2e	filer: list diretory pagination make up for the expired entries	2020-03-09 23:28:01 -07:00
Chris Lu	89eb05b50f	filer: support TTL for all filer stores	2020-03-09 01:02:01 -07:00
Chris Lu	afb20de14c	breaks dependency loop	2020-03-07 17:01:39 -08:00
Chris Lu	6a8484b4ae	master able to list all master clients by type	2020-03-01 22:13:47 -08:00
Chris Lu	555413d9fc	weed queue starts	2020-02-27 00:07:13 -08:00
Chris Lu	6ab7368ef2	filer: dynamically create bucket under /buckets folder	2020-02-24 22:28:45 -08:00
Chris Lu	d335f04de6	support env variables to overwrite toml file	2020-01-29 09:09:55 -08:00
Chris Lu	d4e75a0d18	filer: option to create file only if it is new, O_EXCL	2020-01-22 11:42:40 -08:00
Chris Lu	bbb6ebc3c0	filer: DeleteFolderChildren for deleting large folders	2019-12-13 00:23:05 -08:00
Chris Lu	8123a488cd	filer: optimize leveldb parameters	2019-05-17 18:14:25 -07:00
Chris Lu	0fe286a6ca	filer: optimization for leveldb, add leveldb2 ... large filer db may see high CPU and disk usage due to background compaction	2019-05-17 17:33:49 -07:00
Chris Lu	35aba35c07	Revert "weed volume: disable block cache on leveldb" ... This reverts commit a55e708d36.	2019-04-09 00:22:40 -07:00
Chris Lu	a55e708d36	weed volume: disable block cache on leveldb ... saving 8MB for each volume, but at the cost of slower (offset,size) lookup	2019-04-09 00:18:32 -07:00
Chris Lu	78ac2bef3c	go fmt	2019-03-30 23:09:16 -07:00
Chris Lu	97406333a5	support atomic renaming for mysql/postgres filer store	2019-03-30 23:08:29 -07:00
Chris Lu	b92122b885	fix test	2019-03-16 09:50:57 -07:00
Chris Lu	36b632ebcb	fix tests	2019-03-16 09:50:21 -07:00
Chris Lu	cece860bfd	add context to all filer APIs	2019-03-15 15:55:34 -07:00
Chris Lu	77b9af531d	adding grpc mutual tls	2019-02-18 12:11:52 -08:00
Chris Lu	52b24a9902	default "weed server -filer" to same directory as -mdir	2018-12-05 23:24:25 -08:00
Chris Lu	db22666a30	add default root directory	2018-12-02 19:42:50 -08:00
Chris Lu	f827ada811	merge notification config with filer.toml	2018-08-19 15:17:55 -07:00
Chris Lu	eb2acd11c2	decouple from viper for filer store	2018-06-17 13:01:57 -07:00
Chris Lu	43e3f5724c	use fixed list of masters in both filer and volume servers	2018-06-01 00:39:39 -07:00
Chris Lu	0301504184	add mime, use simple insert and update filer store API ... 1. add mime type to file in filer 2. purge old chunks if overwrite during insert	2018-05-30 20:24:57 -07:00
Chris Lu	458ada173e	go fmt	2018-05-27 11:52:26 -07:00
Chris Lu	603de2d5db	skip deletion if entry not found	2018-05-27 00:00:56 -07:00
Chris Lu	c1e353491a	refactoring variable names	2018-05-26 04:50:55 -07:00
Chris Lu	9e77563c99	add leveldb store ... 1. switch to viper for filer store configuration 2. simplify FindEntry() return values, removing “found” 3. add leveldb store	2018-05-26 03:49:46 -07:00