Konstantin Lebedev
a53e406c99
[master] refactor HasGrowRequest to atomic bool ( #5782 )
...
refactor HasGrowRequest to atomit bool
2024-07-15 10:51:21 -07:00
Konstantin Lebedev
33964fa292
metrics stats of volume layout depends on the data center ( #5775 )
...
stats volume layout depends on the data center
2024-07-12 12:32:25 -07:00
Konstantin Lebedev
04f4b10884
fix: avoid timeout if datacenter does not exist in topology ( #5772 )
...
* fix: avoid timeout if datacenter does not exist in topology
* fix: error msg
* fix: rm dublicate check
* fix: compare
* revert minor change
2024-07-12 11:19:08 -07:00
chrislu
3a82f5ffad
ensure metadata follow a specific folder
...
fix https://github.com/seaweedfs/seaweedfs/issues/5774
2024-07-12 11:17:30 -07:00
vadimartynov
ec9e7493b3
-metricsIp cmd flag ( #5773 )
...
* Added/Updated:
- Added metrics ip options for all servers;
- Fixed a bug with the selection of the binIp or ip parameter for the metrics handler;
* Fixed cmd flags
2024-07-12 10:56:26 -07:00
小羽
cb5dae0c9c
Fix "no more writable volumes" error when volume grows and master leader changed at the same time ( #5771 )
2024-07-12 10:49:15 -07:00
小羽
e8537d7172
Different disk labels should not use the same DiskUsages instance while master received volume heatbeat ( #5770 )
2024-07-12 08:09:51 -07:00
chrislu
4e7d8eb3f1
small refactoring
2024-07-11 14:50:11 -07:00
vadimartynov
de60f383de
Added tls for http handlers ( #5764 )
...
* Added https handler for filer
* Added example for security.toml
2024-07-11 07:53:18 -07:00
chrislu
2addcd1623
fix test
2024-07-11 07:53:02 -07:00
chrislu
590397229e
fix heap init
2024-07-11 00:26:18 -07:00
chrislu
06e3dd306f
clean up
2024-07-11 00:19:39 -07:00
chrislu
c59517e284
upgrade to github.com/redis/go-redis/v9
...
fix https://github.com/seaweedfs/seaweedfs/issues/4532
2024-07-11 00:15:19 -07:00
chrislu
33b11f92bc
Squashed commit of the following:
...
commit 465b47b8f72668dfc12eaa72befb232513c9e1db
Merge: f39272b54 9c440d472
Author: chrislu <chris.lu@gmail.com>
Date: Wed Jul 10 23:56:51 2024 -0700
Merge branch 'master' into merged-persisted-logs
commit f39272b5416bdd4d1714ce3e99aded0fe62e7d89
Author: chrislu <chris.lu@gmail.com>
Date: Wed Jul 10 23:49:26 2024 -0700
merge meta logs from multiple files
2024-07-11 00:04:24 -07:00
Konstantin Lebedev
9c440d472c
[s3] revert skip deletion error, since the error file was not found is already skipped on the side of the grpc function ( #5760 )
...
* revert skip deletion error, since the error file was not found is already skipped on the side of the grpc function
* fix response error
* fix test_lifecycle_get
* Revert "fix test_lifecycle_get"
This reverts commit 8f991bdcf9
.
2024-07-10 08:47:43 -07:00
chrislu
182f6d00a9
always copy ecj files
2024-07-10 01:25:57 -07:00
Dan
bd54669d58
Detect underflow when calculating unused space ( #5758 )
...
* Detect underflow when calculating unused space
* Detect underflow when calculating unused space
2024-07-10 00:30:28 -07:00
chrislu
b8121e4b24
simplify
2024-07-08 11:10:41 -07:00
chrislu
f618121e63
Fix S3 deletion in deep folders, and names with empty spaces
...
fix https://github.com/seaweedfs/seaweedfs/issues/5748
2024-07-08 10:20:09 -07:00
chrislu
f3d708d3b6
add a test case
2024-07-07 23:44:36 -07:00
chrislu
d29fccc521
skip checking if it is the root directory
2024-07-07 23:44:36 -07:00
chrislu
114ac39917
add a simple test
2024-07-07 23:44:36 -07:00
Konstantin Lebedev
f77eee667d
add s3test for sql ( #5718 )
...
* add s3test for sql
* fix test test_bucket_listv2_delimiter_basic for s3
* fix action s3tests
* regen s3 api xsd
* rm minor s3 test test_bucket_listv2_fetchowner_defaultempty
* add docs
* without xmlns
2024-07-04 11:00:41 -07:00
chrislu
7c06306857
fix breadcrumb
2024-07-03 17:40:55 -07:00
rhysm
7ee1f520a4
volume.tier.upload: Fix deleting replicated volumes ( #5743 )
...
Co-authored-by: Rhys M <rhysm@protonmail.com>
2024-07-03 15:51:25 -07:00
chrislu
8943a572d8
log error message
2024-07-03 09:50:47 -07:00
chrislu
62c29b2398
Revert "directory can paginate"
...
This reverts commit 69003d0e90
.
2024-07-02 23:55:48 -07:00
chrislu
761a1555de
fix ordering
2024-07-02 23:55:40 -07:00
chrislu
69003d0e90
directory can paginate
2024-07-02 21:36:03 -07:00
Konstantin Lebedev
5ffacbb6ea
refactor all methods strings to const ( #5726 )
2024-07-01 01:00:39 -07:00
chrislu
0fdf7eca48
avoid possible nil case during other error cases
2024-07-01 00:54:37 -07:00
chrislu
ac6fd36c06
using fixed bootstrap from peer filer
2024-06-30 23:16:54 -07:00
chrislu
fbe1316c92
3.69
2024-06-30 23:08:49 -07:00
chrislu
d8dfadb617
ParallelProcessDirectoryStructure
...
need to use this for simpler parallel processing
2024-06-28 15:02:46 -07:00
chrislu
1c0718f26d
Merge branch 'master' of https://github.com/seaweedfs/seaweedfs
2024-06-28 14:57:23 -07:00
chrislu
c030cb3ce9
bootstrap filer from one peer
2024-06-28 14:57:20 -07:00
chrislu
00f87e5bb5
remove unused
2024-06-28 14:54:39 -07:00
Taehyung Lim
4d0bf6ddd4
fixed fail to initialize existing ec volume when volume server has separate index dictory ( #5723 )
2024-06-28 13:04:51 -07:00
chrislu
cb67137a03
optionally open the leveldb in readonly mode
2024-06-25 21:07:04 -07:00
chrislu
90182e97fe
remove unused function
2024-06-25 09:18:11 -07:00
chrislu
9ac1023362
check bucket name in sql backend
...
fix https://github.com/seaweedfs/seaweedfs/issues/5710
2024-06-25 08:54:19 -07:00
chrislu
ded761ffc5
adjust visibility
2024-06-24 17:14:52 -07:00
chrislu
07f47776c3
minor
2024-06-23 11:47:26 -07:00
Nikita Borzykh
64756c2d79
fix: correct command flag for master.raftBootstrap option in server.go ( #5701 )
2024-06-22 19:28:37 -07:00
chrislu
82ef66cc19
Merge branch 'master' of https://github.com/seaweedfs/seaweedfs
2024-06-22 08:30:18 -07:00
chrislu
622448b993
update advancedtls
2024-06-22 08:30:16 -07:00
Numblgw
73baf82f05
bugfix: unregister ec shards when volume server disconnected ( #5697 )
...
bugfix unregister ec shards when volume server disconnected
Co-authored-by: liguowei <liguowei@xinye.com>
2024-06-20 15:29:36 -07:00
Konstantin Lebedev
34165013c8
chore: hot fix panic fs.verify ( #5696 )
2024-06-20 15:24:31 -07:00
Konstantin Lebedev
7988ee0805
[fs.verify] skip failed files if entry not found on filerStore ( #5693 )
2024-06-19 06:50:55 -07:00
Konstantin Lebedev
ece018b1a9
[fs.verify] getmeta data from filer log ( #5678 )
...
* initial
* fix: print entry path
2024-06-18 22:56:47 -07:00
chrislu
a829f36d17
adjust error handling
...
fix https://github.com/seaweedfs/seaweedfs/issues/5677
2024-06-17 10:59:41 -07:00
chrislu
49893267e9
Merge branch 'master' into mq
2024-06-15 11:53:19 -07:00
chrislu
464611f614
optionally skip deleting file chunks
2024-06-15 11:39:48 -07:00
chrislu
64fd233a59
DeleteUncommittedChunks
2024-06-15 09:55:22 -07:00
chrislu
843e778875
refactor
2024-06-15 09:41:08 -07:00
chrislu
677cfb8ad1
refactor
2024-06-15 09:39:49 -07:00
chrislu
cb1ba0275a
sort imports
2024-06-14 11:44:42 -07:00
chrislu
32dbb6a2ce
Merge branch 'master' into mq
2024-06-14 11:42:05 -07:00
vadimartynov
8aae82dd71
Added context for the MasterClient's methods to avoid endless loops ( #5628 )
...
* Added context for the MasterClient's methods to avoid endless loops
* Returned WithClient function. Added WithClientCustomGetMaster function
* Hid unused ctx arguments
* Using a common context for the KeepConnectedToMaster and WaitUntilConnected functions
* Changed the context termination check in the tryConnectToMaster function
* Added a child context to the tryConnectToMaster function
* Added a common context for KeepConnectedToMaster and WaitUntilConnected functions in benchmark
2024-06-14 11:40:34 -07:00
chrislu
70b31e3a28
Merge branch 'master' into mq
2024-06-14 09:17:58 -07:00
chrislu
2a169dde9a
minor
2024-06-14 09:17:46 -07:00
chrislu
8ffda89ed6
Merge branch 'master' into mq
2024-06-13 21:48:57 -07:00
chrislu
b03c831ad2
more logs
2024-06-13 21:48:44 -07:00
chrislu
458dda56ae
Merge branch 'master' into mq
2024-06-12 00:32:04 -07:00
Taehyung Lim
4744889973
fix issue: sometimes volume.fsck report 'volume not found' ( #5537 )
...
* fix issue: sometimes volume.fsck report 'volume not found' when a volume server has multiple disk types
* rename variable
* adjust counters
---------
Co-authored-by: chrislu <chris.lu@gmail.com>
2024-06-11 22:22:57 -07:00
MeenakshiSachdeva
d2516d99cc
Meenakshi fix filer sync ( #5672 )
...
* Fix Filer Sync Issue: 5455
* Fix Filer Sync Issue: 5455
2024-06-10 11:16:29 -07:00
MeenakshiSachdeva
1caa012a76
Fix Filer Sync Issue: 5455 ( #5663 )
2024-06-10 09:19:38 -07:00
chrislu
0cd1c4be48
Merge branch 'master' into mq
2024-06-09 21:21:43 -07:00
chrislu
a9cd9b0542
3.68
2024-06-09 21:10:46 -07:00
chrislu
b5d36541d9
Merge branch 'master' into mq
2024-06-09 12:14:57 -07:00
chrislu
dbfbabac55
simplify
2024-06-09 12:14:10 -07:00
steve.wei
2150289442
fix: Ensure that the clientAddress is unique ( #5655 )
2024-06-07 09:13:03 -07:00
chrislu
25b2850e7d
refactor out FilerClientAccessor
2024-06-06 19:44:19 -07:00
chrislu
4093115ca9
Merge branch 'master' into mq
2024-06-06 19:27:07 -07:00
Gaspare Iengo
dc6b750424
Fix panic ( #5654 )
2024-06-06 18:59:50 -07:00
Gaspare Iengo
fce8fc1e16
Fix Issue #5649 ( #5652 )
2024-06-06 12:49:33 -07:00
steve.wei
d8da4bbaa7
Set the capacity of clientChan to 10000 ( #5647 )
2024-06-05 05:41:46 -07:00
chrislu
9f02bf4ede
Merge branch 'master' into mq
2024-06-04 21:12:30 -07:00
Lê Hoàng Nam
1f2dc54647
fix(s3api): make post api upload object default return 204 ( #5648 )
2024-06-04 06:18:47 -07:00
LHHDZ
36b5b713ba
fix deadlock caused by message chan blocked ( #5639 )
2024-06-03 07:42:40 -07:00
Dominic Pearson
d8bde9b96e
Solaris disk support ( #5638 )
2024-06-02 22:10:28 -07:00
NyaMisty
579ebbdf60
Support concurrent volume.fsck & support disabling -cutoffTimeAgo to improve speed ( #5636 )
2024-06-02 14:25:42 -07:00
NyaMisty
0c62d591e2
Ignore remote volume when selecting volumes in operation (ec.encode/volume.tier.upload) ( #5635 )
2024-06-02 14:16:05 -07:00
NyaMisty
e1c671c028
Fix volume.tier.upload nil pointer panic ( #5634 )
2024-06-02 14:15:39 -07:00
NyaMisty
f2a37933b1
Fix sorted needle file's write mode for (*SortedFileNeedleMap).Delete() ( #5633 )
2024-06-02 14:12:25 -07:00
chrislu
41cc825ddb
Merge branch 'master' into mq
2024-05-30 12:03:22 -07:00
chrislu
d1f0c40402
remove per-message debug logs
2024-05-30 09:49:08 -07:00
chrislu
df9d889489
fix size calculation
2024-05-30 09:41:04 -07:00
chrislu
ff14dfa0ee
debug
2024-05-30 09:15:50 -07:00
chrislu
b485b9695c
fix passing sub follower offset
2024-05-30 09:15:23 -07:00
chrislu
f7b818483a
fix cases when buffer wraps around
2024-05-30 09:10:30 -07:00
chrislu
9a5cc065b0
fix
2024-05-30 08:29:06 -07:00
chrislu
23a72db1df
stop partitionOffsetChan if closed
2024-05-30 00:27:44 -07:00
chrislu
af19256dbf
skip control messages
2024-05-29 23:34:39 -07:00
chrislu
ad2b878130
fix inflight message tracker
2024-05-29 23:33:37 -07:00
chrislu
f8a22038c5
passing along publisher name
2024-05-29 23:31:48 -07:00
chrislu
f0b9e163a0
avoid nil stopChan
2024-05-29 16:18:02 -07:00
chrislu
a5874954dc
less logs
2024-05-29 16:17:37 -07:00
chrislu
3ddfd15ec1
Merge branch 'master' of https://github.com/seaweedfs/seaweedfs
2024-05-29 10:41:38 -07:00
chrislu
3e7a92061b
pass along volume server grpc port
...
fix https://github.com/seaweedfs/seaweedfs/issues/5617
2024-05-29 10:41:33 -07:00