142 Commits

Author	SHA1	Message	Date
Chris Lu	cbd94b18a5	improve "ls -al" performance for large directory	2018-11-08 07:37:34 -08:00
Chris Lu	85d1d99459	default "weed export to current enabled store"	2018-11-04 12:59:29 -08:00
Chris Lu	6c45787a37	selectively export files	2018-11-04 12:07:33 -08:00
Chris Lu	ff4189ab25	go fmt	2018-11-04 11:59:08 -08:00
Chris Lu	8dfac6a4cf	working b2 sink	2018-11-04 11:58:59 -08:00
Chris Lu	a64613172d	bootstrap filer replication with weed filer.export -targetStore=notification	2018-11-03 12:43:45 -07:00
Chris Lu	3674ad9f8e	go fmt	2018-11-01 01:12:21 -07:00
Chris Lu	db584ff7f8	separate into notification.toml, add gcp pub/sub message queue	2018-11-01 01:11:09 -07:00
Chris Lu	4c97ff3717	support AWS SQS as file change notification message queue	2018-10-31 01:11:19 -07:00
Chris Lu	fe31f389b0	add configuration instructions	2018-10-30 02:29:11 -07:00
Chris Lu	c58b73ad9b	adding BackBlaze, Azure	2018-10-23 23:59:40 -07:00
Chris Lu	fda771c83f	migrate volume sync status to grpc API on volume server	2018-10-15 01:19:15 -07:00
Chris Lu	b1daede91b	move volume vacuum to gRpc	2018-10-14 23:12:43 -07:00
Chris Lu	556382ff5f	adding basic grpc to volume server	2018-10-11 01:16:33 -07:00
Chris Lu	08266b7256	go fmt	2018-10-11 00:08:13 -07:00
Chris Lu	1d7e01b754	reformat	2018-10-11 00:05:54 -07:00
Chris Lu	da6154b29c	refactor volume server to startVolumeServer()	2018-10-11 00:04:31 -07:00
Chris Lu	60d2f1557d	refactor func name	2018-10-10 23:19:54 -07:00
Chris Lu	9f4c2f87d3	adding filer replication sink to Azure	2018-10-09 01:35:48 -07:00
Chris Lu	96a23591e7	remove comments	2018-10-07 22:21:00 -07:00
Chris Lu	a5b5887efc	add filer replication to aws s3	2018-10-06 17:10:15 -07:00
Chris Lu	84d4a2c8a0	add filer replication to google cloud storage	2018-10-06 13:08:38 -07:00
Chris Lu	14858f6224	add logging	2018-10-06 13:01:38 -07:00
Chris Lu	56c5c7b1b6	add google cloud storage	2018-10-04 01:14:44 -07:00
Chris Lu	e8ef501f02	add s3 replication sink	2018-10-03 23:36:52 -07:00
Chris Lu	98384b62fd	adjust description	2018-09-28 01:58:34 -07:00
Chris Lu	12ba8b9799	generate useable filer.toml	2018-09-23 09:26:25 -07:00
Chris Lu	b16d47030e	save and use last processed kafka offsets	2018-09-23 01:34:40 -07:00
Chris Lu	9fe24991d5	refactoring	2018-09-23 00:40:36 -07:00
Chris Lu	7d6b2a4740	add ETag to upload results and chunks	2018-09-22 22:12:21 -07:00
Chris Lu	420f068376	add more instructions	2018-09-22 22:12:06 -07:00
Chris Lu	01ceace18e	adjust sink options	2018-09-22 00:53:52 -07:00
Chris Lu	402ab598b6	go fmt	2018-09-22 00:12:10 -07:00
Chris Lu	7bb62b9f21	delay file creation without chunks from dir.Create to file.Flush	2018-09-22 00:11:46 -07:00
Chris Lu	db69ce89f0	go fmt	2018-09-21 01:56:43 -07:00
Chris Lu	a6cfaba018	able to sync the changes	2018-09-21 01:54:29 -07:00
Chris Lu	a8cd7df44a	let filer choose default replication	2018-09-20 09:00:15 -07:00
Chris Lu	d5149e592e	add logging on kafka reading	2018-09-19 22:31:45 -07:00
Chris Lu	25fb6f9a46	fix compilation	2018-09-17 02:23:21 -07:00
Chris Lu	779641e9d4	adjust replicated entry name	2018-09-17 01:37:24 -07:00
Chris Lu	b7a375f5aa	set large limit for "weed filer.export" directory listing	2018-09-17 00:42:36 -07:00
Chris Lu	4e1f1a0b92	set large limit for "weed mount" directory listing	2018-09-17 00:41:33 -07:00
Chris Lu	788acdf527	add WIP filer.replicate	2018-09-17 00:27:56 -07:00
Chris Lu	7ad5a90127	go fmt	2018-09-03 16:47:00 -07:00
Chris Lu	6e3f4d1079	add working filer.export command	2018-08-23 00:02:04 -07:00
Chris Lu	98b8f8649d	adding filer.export prototype	2018-08-22 23:54:22 -07:00
Chris Lu	ae4e654d2a	add example configuration for default redis create-cluster setup	2018-08-22 18:23:19 -07:00
Chris Lu	748870b03f	add "weed scaffold" command	2018-08-19 15:36:30 -07:00
Chris Lu	f827ada811	merge notification config with filer.toml	2018-08-19 15:17:55 -07:00
Chris Lu	f036ef8a3c	add filer notification	2018-08-13 01:20:49 -07:00