1150 Commits

Author	SHA1	Message	Date
Chris Lu	eebc44cce3	refactoring	2019-06-20 21:57:17 -07:00
Chris Lu	3106065b58	fix startup problem with metrics	2019-06-20 09:56:49 -07:00
Chris Lu	c74dc2b306	go fmt	2019-06-20 00:55:52 -07:00
Chris Lu	e63317fb08	ec deletion code complete, not tested yet	2019-06-20 00:55:30 -07:00
Chris Lu	4cea8aefd0	add grpc VolumeEcBlobDelete	2019-06-20 00:17:11 -07:00
Chris Lu	856da7aae2	ec volume support deletes	2019-06-19 22:57:14 -07:00
Chris Lu	115558e5f5	adjust counters	2019-06-17 21:02:50 -07:00
Chris Lu	d8ed73926d	volume servers get metrics address and interval from the master	2019-06-17 14:51:47 -07:00
Chris Lu	68d1bef236	instance format	2019-06-16 21:57:32 -07:00
Chris Lu	935639b908	metrics: disk size for <collection, normal/EC>	2019-06-16 21:56:41 -07:00
Chris Lu	0fdb1e705d	collect volume disk usage metrics	2019-06-16 02:44:20 -07:00
Chris Lu	289fd7eb39	count number of volumes and ec shards	2019-06-16 02:24:15 -07:00
Chris Lu	ff6a6dd11e	refactoring	2019-06-15 21:46:55 -07:00
Chris Lu	8b43679ae3	refactoring	2019-06-15 12:21:44 -07:00
Chris Lu	5336008dcd	refactoring	2019-06-14 13:06:01 -07:00
Chris Lu	d67189921f	go fmt	2019-06-14 00:55:12 -07:00
Chris Lu	5f6c9825f8	volume server: adds basic metrics	2019-06-14 00:54:56 -07:00
Chris Lu	a11525fe4e	filer: adds basic metrics pushing to Prometheus gateway	2019-06-13 02:01:54 -07:00
Chris Lu	be3f1f84a2	1.35	2019-06-10 21:34:06 -07:00
Chris Lu	57092d69ac	go fmt	2019-06-10 21:33:32 -07:00
Chris Lu	f9d8bd51ad	ec shard balancing	2019-06-10 21:32:56 -07:00
Chris Lu	9d9162ca35	ec.balance: collect dc rack info	2019-06-07 00:25:05 -07:00
Chris Lu	e66bddd84c	customizable sleep intervals	2019-06-06 00:39:08 -07:00
Chris Lu	50aa769554	jwt for read access control	2019-06-06 00:29:02 -07:00
Chris Lu	d344e0a035	fix ec related bugs	2019-06-05 23:20:26 -07:00
Chris Lu	450f4733ce	report empty volume or ec shards	2019-06-05 13:32:33 -07:00
Chris Lu	7f6fb9ffd0	every 17 minutes instead of seconds ... TODO: make this configurable	2019-06-05 13:32:08 -07:00
Chris Lu	6b08db65b0	fix shard count reporting	2019-06-05 01:58:37 -07:00
Chris Lu	784141c5e6	adjust script parameter	2019-06-05 01:48:03 -07:00
Chris Lu	ede876cfdb	periodic scripts exeuction from leader master	2019-06-05 01:30:24 -07:00
Chris Lu	b9e138713c	ec.encode: add -fullPercent option	2019-06-05 00:13:13 -07:00
Chris Lu	0e49add2bc	adjust help message	2019-06-05 00:11:37 -07:00
Chris Lu	eaa76f11b7	free volume slots factor in ec shard counts	2019-06-04 23:41:56 -07:00
Chris Lu	ca8a2bb534	go fmt	2019-06-04 22:04:10 -07:00
Chris Lu	2215e81be7	ui add ec shard statuses	2019-06-04 21:52:37 -07:00
Chris Lu	0e52862586	avoid the test that depends on ordering in a different folder	2019-06-04 02:22:32 -07:00
Chris Lu	2f7710a75d	debug sporadic test error on travis	2019-06-04 02:09:06 -07:00
Chris Lu	06133ae98f	correct count for free ec slots, avoid removing generated shards	2019-06-04 01:49:51 -07:00
Chris Lu	6cea23d091	purge duplicated ec shards	2019-06-04 01:32:36 -07:00
Chris Lu	b05456fe07	able to purge extra ec shard copies	2019-06-03 20:25:02 -07:00
Chris Lu	11cffb3168	fix ec.rebuild bugs	2019-06-03 11:50:54 -07:00
Chris Lu	d85b41b904	fix ec.encode not finding the local ec shards	2019-06-03 10:38:21 -07:00
Chris Lu	7e80b2b882	fix multiple bugs	2019-06-03 02:26:31 -07:00
Chris Lu	55be09996d	fix volume balance bug	2019-06-03 00:13:31 -07:00
Chris Lu	9ce6b949bf	adjust help message	2019-06-01 10:37:08 -07:00
Chris Lu	d6e2c877fa	ec.balance: use specific collection names	2019-06-01 02:00:18 -07:00
Chris Lu	133b772fb5	destroy ec volume if it is empty	2019-06-01 01:51:28 -07:00
Chris Lu	ba18314aab	ec shard delete also check ec volumes, in addition to volumes	2019-06-01 01:41:22 -07:00
Chris Lu	f919d0235c	ec encode volumes quiet for a period of time	2019-05-31 23:41:17 -07:00
Chris Lu	a72cef3c42	encode by collection	2019-05-31 15:48:40 -07:00