56 Commits

Author	SHA1	Message	Date
chrislu	74f60f246f	dynamically connect to a filer	2022-07-28 23:24:38 -07:00
chrislu	68065128b8	add dc and rack	2022-07-28 23:22:51 -07:00
chrislu	64f3d6fb6e	metadata subscription uses client epoch	2022-07-23 10:50:28 -07:00
chrislu	fa61074513	add clientId logging	2022-07-14 12:27:34 -07:00
chrislu	4fd5f96598	filer: remove replication, collection, disk_type info from entry metadata ... these metadata can change and are not used	2022-06-06 00:39:35 -07:00
creeew	02ae102731	fix filer.sync missing source srv uploaded files to target when target down	2022-06-02 01:28:47 +08:00
chrislu	6adc42147f	fresh filer store bootstrap from the oldest peer	2022-05-30 21:27:48 -07:00
chrislu	c59068d0f3	refactor	2022-05-30 16:28:36 -07:00
chrislu	682382648e	collect cluster node start time	2022-05-30 16:23:52 -07:00
chrislu	94635e9b5c	filer: add filer group	2022-05-01 21:59:16 -07:00
chrislu	21e0898631	refactor: change masters from a slice to a map	2022-03-26 13:33:17 -07:00
chrislu	4042fdf3bb	rename to skipCheckParentDir ... related to https://github.com/chrislusf/seaweedfs/pull/2761 It's better to default to false.	2022-03-16 23:55:31 -07:00
zzq09494	40b0033fa7	go fmt	2022-03-17 14:19:48 +08:00
zzq09494	81cce4b4c3	filer: support uploading file without needEnsureParentDir	2022-03-17 10:53:47 +08:00
zzq09494	a6a8892255	Revert "filer: support uploading file without needEnsureParentDir" ... This reverts commit a93c4947ba.	2022-03-17 10:27:17 +08:00
zzq09494	a93c4947ba	filer: support uploading file without needEnsureParentDir	2022-03-17 10:18:23 +08:00
chenkai	47c30e3add	filer list entries use context to break job	2021-12-28 15:03:41 +08:00
chrislu	9f9ef1340c	use streaming mode for long poll grpc calls ... streaming mode would create separate grpc connections for each call. this is to ensure the long poll connections are properly closed.	2021-12-26 00:15:03 -08:00
Chris Lu	4729a57cc0	use constants	2021-11-08 17:47:56 -08:00
Chris Lu	e0fc2898e9	auto updated filer peer list	2021-11-06 14:23:35 -07:00
Chris Lu	5ea86ef1da	Revert "master: rename grpc function KeepConnected() to SubscribeVolumeLocationUpdates()" ... This reverts commit af71ae11aa.	2021-11-05 17:52:15 -07:00
Chris Lu	af71ae11aa	master: rename grpc function KeepConnected() to SubscribeVolumeLocationUpdates()	2021-11-03 01:09:48 -07:00
Chris Lu	2baed2e1e9	avoid possible metadata subscription data loss ... Previous implementation append filer logs into one file. So one file is not always sorted, which can lead to miss reading some entries, especially when different filers have different write throughput.	2021-09-25 01:18:44 -07:00
Chris Lu	e5fc35ed0c	change server address from string to a type	2021-09-12 22:47:52 -07:00
Chris Lu	679f800caa	Merge branch 'master' into add_remote_storage	2021-08-06 20:27:12 -07:00
byunghwa.yun	f3dc909b21	Change default permissions	2021-08-06 12:24:35 +09:00
Chris Lu	c090d6bb25	add ReadRemote(), add read remote setup when filer starts	2021-07-28 22:43:12 -07:00
Chris Lu	182288f860	filer: fix mysql, postgres batch delete error	2021-07-22 08:23:20 -07:00
Chris Lu	cc7714fdbe	logging changes to debug	2021-06-27 05:54:16 -07:00
Konstantin Lebedev	6aa1a56ec8	avoid crashes Galera Cluster ... https://github.com/chrislusf/seaweedfs/issues/2125	2021-06-15 18:12:39 +05:00
Chris Lu	e06807a55b	adjust logs	2021-03-30 20:36:06 -07:00
Chris Lu	a4063a5437	add stream list directory entries	2021-01-15 23:56:24 -08:00
Chris Lu	f002e668de	change limit to int64 in case of overflow	2021-01-14 23:10:37 -08:00
Chris Lu	9a50dbcda0	chagned api	2021-01-14 22:18:38 -08:00
Chris Lu	da7e5aaa65	filer: optimize for less number of directory lookup ... bottom up directory lookup	2020-12-27 20:46:17 -08:00
Chris Lu	0a7c5f85a9	filer: add namePattern to search in current folder	2020-12-26 15:05:31 -08:00
Chris Lu	14910d035c	the pagination size was too big for recursive deletion	2020-12-12 13:26:10 -08:00
Chris Lu	c2f18a10cb	minor	2020-12-10 22:23:22 -08:00
Chris Lu	a9c6be5fc3	set creation time	2020-11-30 03:11:52 -08:00
Chris Lu	effa00ed08	refactor	2020-11-26 11:21:58 -08:00
Chris Lu	513bcd6e0d	filer: avoid duplicated FindEntry for deletion	2020-11-26 11:14:56 -08:00
Chris Lu	590f02179d	filer: load filer conf when starting	2020-11-15 14:06:03 -08:00
Konstantin Lebedev	1eec5c8d5d	gen pb	2020-11-12 04:10:06 +05:00
Konstantin Lebedev	fc7baef5bb	fiil serverUrls sorted by data center	2020-11-12 02:13:33 +05:00
Chris Lu	16fae84414	fix format error	2020-10-24 20:11:31 -07:00
Chris Lu	e9d40b80b2	less verbose logs	2020-10-24 09:42:54 -07:00
Chris Lu	5e239afdfc	hardlink works now	2020-09-24 03:06:48 -07:00
Chris Lu	30dc365cbd	add self filer	2020-09-06 00:11:46 -07:00
Chris Lu	71b0e256c7	filer: setOrLoadFilerStoreSignature	2020-09-05 14:08:59 -07:00
Chris Lu	2815bbe6c0	go fmt	2020-09-01 21:59:26 -07:00