72 Commits

Author	SHA1	Message	Date
Chris Lu	84d4a2c8a0	add filer replication to google cloud storage	2018-10-06 13:08:38 -07:00
Chris Lu	f8c2704d2b	reformat	2018-10-06 13:04:33 -07:00
Chris Lu	04da4c8094	add logging	2018-10-06 13:01:29 -07:00
Chris Lu	4a8ef198d7	add logging	2018-10-06 13:00:33 -07:00
Chris Lu	56c5c7b1b6	add google cloud storage	2018-10-04 01:14:44 -07:00
Chris Lu	e8ef501f02	add s3 replication sink	2018-10-03 23:36:52 -07:00
Chris Lu	31ed352ab6	replication handle cases when entry already exists	2018-09-25 09:27:03 -07:00
Chris Lu	b1b8c4ed32	join via filepath	2018-09-23 01:46:50 -07:00
Chris Lu	b16d47030e	save and use last processed kafka offsets	2018-09-23 01:34:40 -07:00
Chris Lu	9fe24991d5	refactoring	2018-09-23 00:40:36 -07:00
Chris Lu	d3e1f20dcc	adjust log level	2018-09-22 22:11:49 -07:00
Chris Lu	9a3d46f8e3	handle duplicated replication when retry happens	2018-09-22 11:14:04 -07:00
Chris Lu	01ceace18e	adjust sink options	2018-09-22 00:53:52 -07:00
Chris Lu	db69ce89f0	go fmt	2018-09-21 01:56:43 -07:00
Chris Lu	a6cfaba018	able to sync the changes	2018-09-21 01:54:29 -07:00
Chris Lu	d5149e592e	add logging on kafka reading	2018-09-19 22:31:45 -07:00
Chris Lu	25fb6f9a46	fix compilation	2018-09-17 02:23:21 -07:00
Chris Lu	779641e9d4	adjust replicated entry name	2018-09-17 01:37:24 -07:00
Chris Lu	788acdf527	add WIP filer.replicate	2018-09-17 00:27:56 -07:00
Chris Lu	5071f528f6	testing compilation with remove package	2013-02-10 03:49:51 -08:00
Chris Lu	55f2627fcf	testing new directory structure	2013-02-10 03:31:40 -08:00
Chris Lu	ab6fb13ad7	avoid the "src" folder	2013-02-10 03:25:35 -08:00