rustrover
ab70aa92da
remove repetitive words ( #5364 )
2024-03-09 07:35:47 -08:00
chrislu
b544a69550
Merge branch 'master' of https://github.com/seaweedfs/seaweedfs
2024-03-07 10:42:15 -08:00
chrislu
5c0f01c0eb
purge cluster id
2024-03-07 10:42:12 -08:00
Konstantin Lebedev
170b63d6f8
[filer.backup] add param uploader_part_size for S3sink ( #5352 )
...
* fix: install cronie
* chore: refactor configure S3Sink
* chore: refactor cinfig
* add filer-backup compose file
* fix: X-Amz-Meta-Mtime and resolve with comments
* fix: attr mtime
* fix: MaxUploadPartst is reduced to the maximum allowable
* fix: env and force set max MaxUploadParts
* fix: env WEED_SINK_S3_UPLOADER_PART_SIZE_MB
2024-03-07 08:35:51 -08:00
Seyed Mahdi Sadegh Shobeiri
ecc154fa9e
Add deleted bytes to total_disk_size ( #5161 )
2024-03-06 07:28:46 -08:00
adasauce
3e3e0fa240
feat: add support for S3 ListObjects and ListObjectsV2 ( #5350 )
2024-03-06 07:24:44 -08:00
Konstantin Lebedev
872b5161e6
[shell] fs log purge ( #5344 )
...
* fix: install cronie
* chore: shell delete old logs
* Revert "fix: install cronie"
This reverts commit 920832b04b
2024-03-05 09:09:08 -08:00
Sean Ross
0833057503
Moved noapplexattr under runtime.GOARCH == "amd64" to resolve the fin… ( #5351 )
...
Moved noapplexattr under runtime.GOARCH == "amd64" to resolve the finder copy bug on arm64 macOS devices.
2024-02-29 02:16:28 -08:00
jerebear12
85d6d5371b
Disable filer UI in configuration ( #5297 )
...
* Add filer.ui.enabled configuration property
* Add filer.expose_directory_metadata to config
* Ammend commit
* Remove ShowUI reference
* Update all routes that allow directory metadata
* Add cmd flag to server.go
2024-02-27 08:38:55 -08:00
chrislu
54d7748a4a
3.63
2024-02-25 22:17:28 -08:00
Konstantin Lebedev
7187346cc1
avoid unexpected compact size ( #5272 )
...
https://github.com/seaweedfs/seaweedfs/issues/5215
2024-02-24 05:27:35 -08:00
chrislu
7c45992c79
when verifyNeedleIntegrity, do not truncate files
...
related to https://github.com/seaweedfs/seaweedfs/pull/5259
2024-02-24 02:37:03 -08:00
Chris Lu
32cb9b3276
fix unaligned 64-bit atomic operation in weed mount on arm when readi… ( #5308 )
...
fix unaligned 64-bit atomic operation in weed mount on arm when reading a file
fix #5306
2024-02-19 18:51:45 -08:00
7y-9
41ec9d7759
refactor: put the auth outside ( #5313 )
2024-02-19 03:07:48 -08:00
7y-9
f037c09c11
fix: only admin auth can delete S3 bucket ( #5312 )
2024-02-19 00:38:05 -08:00
Konstantin Lebedev
6181aa7594
fix: fs verify error counter ( #5261 )
2024-02-15 01:31:51 -08:00
Sébastien
c694cb4e7d
filer: reduce delete entry ErrNotFound logs ( #5301 )
2024-02-14 14:22:08 -08:00
Konstantin Lebedev
8fb978d6f6
[volume] requests that were canceled by the client are not an internal server problem(500 => 499) ( #5304 )
2024-02-14 14:18:56 -08:00
Justin Dhillon
a48e2ec45b
Fix Broken Links ( #5287 )
...
* https://learn.microsoft.com/en-us/windows/win32/api/memoryapi/nf-memoryapi-setprocessworkingsetsize
* https://learn.microsoft.com/en-us/windows/win32/api/memoryapi/nf-memoryapi-getprocessworkingsetsize
* remove https://github.com/h5bp/html5-boilerplate/blob/master/src/css/main.css
* https://github.com/AShiou/hof
2024-02-14 08:26:38 -08:00
sxlehua
ffe5f19aa0
Add s3 postpolicy support header ( #5280 )
...
* Add s3 postpolicy support header
* optimized code
2024-02-05 07:55:07 -08:00
Chris Lu
56df44845f
fix when two consecutive chunks with the same modified_ts_ns
...
fix https://github.com/seaweedfs/seaweedfs/issues/5276
2024-02-04 09:22:24 -08:00
sxlehua
0b49c16361
Adapt S3 POST ContentType ( #5275 )
2024-02-03 22:33:34 -08:00
Benoît Knecht
56287bd07d
weed/shell: Cluster check other disk types ( #5245 )
...
* week/shell: Cluster check other disk types
The `cluster.check` command only took the empty (`""`) and `hdd` disk types
into consideration, but a cluster with only `ssd` or `nvme` disk types would be
equally valid.
This commit simply checks that _any_ disk type is defined, and that some
volumes are available for it.
Signed-off-by: Benoît Knecht <bknecht@protonmail.ch>
* weed/shell: Replace loop that copies slice
Use the following construct instead of a `for` loop:
```golang
x = append(x, y...)
```
See https://staticcheck.dev/docs/checks#S1011 .
Signed-off-by: Benoît Knecht <bknecht@protonmail.ch>
* weed/shell: Check disk types when filer is in use
Filer stores its metadata logs in generic (i.e. `""`) or HDD disk type volumes,
so make sure those disk types exist and have volumes associated with them when
Filer is deployed in the cluster.
Signed-off-by: Benoît Knecht <bknecht@protonmail.ch>
---------
Signed-off-by: Benoît Knecht <bknecht@protonmail.ch>
2024-01-29 10:36:37 -08:00
Sébastien
0775d05a23
fix: http range request return status 500 ( #5251 )
...
When volume server unavailable for at least one chunk; was returning status 206.
Split `StreamContent` in two parts,
- first prepare, to get chunk info and return stream function
- then write chunk, with that stream function
That allow to catch error in first step before setting response status code in `processRangeRequest`
2024-01-29 10:35:52 -08:00
Benoît Knecht
f6e39139d8
weed/storage: Fix volume info file permissions ( #5246 )
2024-01-26 08:31:27 -08:00
chrislu
cb50b720fd
Revert "Fix weed fix"
...
This reverts commit 6c1ce18541
2024-01-25 08:09:36 -08:00
Benoît Knecht
1f08010ef0
weed/shell: Cleanup volume balance logic ( #5241 )
2024-01-25 06:19:58 -08:00
Konstantin Lebedev
0f8e76bbd6
fix: clean metric MasterReplicaPlacementMismatch for unregister volume ( #5239 )
2024-01-25 00:23:24 -08:00
Benoît Knecht
a6aee847b9
weed/shell: Fix volume.balance logic ( #5238 )
2024-01-25 00:17:32 -08:00
Konstantin Lebedev
0b71fae2e3
fix: s3tests test_get_object_ifnonematch_good ( #5237 )
2024-01-24 11:05:55 -08:00
chrislu
025f8eb37b
return dir assign counter
...
fix https://github.com/seaweedfs/seaweedfs/issues/5231
2024-01-23 19:48:42 -08:00
chrislu
49fcb48e04
same logic as grpc assign
...
fix https://github.com/seaweedfs/seaweedfs/issues/5213
2024-01-23 19:39:59 -08:00
chrislu
bb867694d8
skip updating multipart .upload files
2024-01-18 09:24:52 -08:00
chrislu
4ca6b1be3c
skip updating the .upload multipart files
2024-01-18 09:24:52 -08:00
chrislu
5c90b27b0a
go fmt
2024-01-18 09:17:08 -08:00
chrislu
83e4b02517
fix
2024-01-18 09:16:20 -08:00
chrislu
2fa519bcb5
Merge branch 'pr/5216'
2024-01-18 09:14:01 -08:00
chrislu
15b66a6633
refactor
2024-01-18 09:13:14 -08:00
chrislu
3002087541
http assign logic should be the same as grpc assign
...
similar logic as bebbc9fe44
2024-01-18 08:58:53 -08:00
XIAOYQ
be166b434f
fix: skip s3 .uploads
2024-01-18 22:13:46 +08:00
Konstantin Lebedev
4e9ea1e628
chore: filer healthz handler check filer store ( #5208 )
2024-01-17 07:46:37 -08:00
Konstantin Lebedev
f9cf13fada
[filer] avoid return http ok for not allowed methods ( #5209 )
2024-01-17 07:17:07 -08:00
Andrew Azores
2eb82778bc
chore: fix typos in scaffold help output ( #5211 )
2024-01-17 07:10:17 -08:00
chrislu
59b8af99b0
3.62
2024-01-15 20:44:00 -08:00
skycope
316ae45795
can vacuum volume when size mismatch ( #5200 )
...
Co-authored-by: Yang Wang <yangwang@weride.ai>
2024-01-15 16:16:46 -08:00
Konstantin Lebedev
8d23e36c45
fix: doDeleteFiles deletes files ( #5198 )
2024-01-12 11:04:29 -08:00
Konstantin Lebedev
1169f94310
Fix filer sync set offset ( #5197 )
...
* fix: compose 2mount with sync
* fix: DATA RACE
https://github.com/seaweedfs/seaweedfs/issues/5194
https://github.com/seaweedfs/seaweedfs/issues/5195
2024-01-12 10:57:18 -08:00
skycope
0e8a54f6f6
fix write volume over size MaxPossibleVolumeSize ( #5190 )
...
Co-authored-by: Yang Wang <yangwang@weride.ai>
2024-01-11 20:23:46 -08:00
chrislu
050efe6c08
factor in existing ec volume count when estimating max volume count
...
related to https://github.com/seaweedfs/seaweedfs/issues/5191
2024-01-11 08:19:09 -08:00
Konstantin Lebedev
a7fc723ae0
chore: add status code for request_total metrics ( #5188 )
2024-01-10 10:05:27 -08:00
