Konstantin Lebedev
3e25ed1b11
[s3] add s3 pass test_multipart_upload_size_too_small ( #5475 )
...
* add s3 pass test_multipart_upload_size_too_small
* refactor metric names
* return ErrNoSuchUpload if empty parts
* fix test
2024-04-07 11:52:35 -07:00
Konstantin Lebedev
35cba720a5
[s3] add s3 pass test_multipart_upload ( #5474 )
...
add s3 pass test_multipart_upload
2024-04-07 11:51:22 -07:00
Konstantin Lebedev
d42a04cceb
[s3] fix s3 test_multipart_resend_first_finishes_last ( #5471 )
...
* try fix s3 test
https://github.com/seaweedfs/seaweedfs/pull/5466
* add error handler metrics
* refactor
* refactor multipartExt
* delete bad entry parts
2024-04-06 10:56:39 -07:00
Nikita Borzykh
7aa25c1137
fix: correctly form partNumber from new entry.Name format in "listObjectParts" ( #5470 )
2024-04-04 09:16:16 -07:00
mergwyn
881c922972
helm chart: make s3 ingress annotations consistent ( #5463 )
...
Make s3 ingress annotations consistent
2024-04-03 09:09:34 -07:00
mergwyn
b4def8f000
Correct type for volume logs and idx values ( #5462 )
...
Correct type for volume logs and idx values (#1 )
Empty values now correctly set to {}
2024-04-03 08:17:41 -07:00
skycope
b19c9847c6
fix completed multiupload lost data ( #5460 )
...
If there are putObjectPart requests with the same uploadId during
completeMultiPart, it can result in data loss. putObjectPart requests
might be due to timeout retries.
Co-authored-by: Yang Wang <yangwang@weride.ai>
2024-04-02 20:18:42 -07:00
chrislu
ccdd9cd8de
refactor
2024-04-02 16:25:43 -07:00
chrislu
f37c0d0d7a
comment out println
2024-04-02 15:31:31 -07:00
Konstantin Lebedev
d5d8b8e2ae
fix panic at isAllWritable ( #5457 )
...
fix panic
https://github.com/seaweedfs/seaweedfs/issues/5456
2024-04-02 09:06:19 -07:00
Henco Appel
2a88da4de7
fix: always close volume file ( #4530 ) ( #5459 )
...
If sync fails then close is never called. We should always be calling
close on the file.
Co-authored-by: Hendrik Appel <happel@europe.altair.com>
2024-04-02 08:31:40 -07:00
chrislu
d935f70e3c
shutdown follower when leader stops
2024-04-01 22:32:30 -07:00
chrislu
f07875e8e1
send flush message to follower before shutting down logBuffer
2024-04-01 16:01:26 -07:00
Nikita Borzykh
df9031e19a
fix: ensure complete gRPC stream consumption in doListFilerEntries to prevent context canceled errors. ( #5441 )
2024-04-01 15:55:16 -07:00
chrislu
e568e742c9
renaming
2024-04-01 15:02:52 -07:00
dependabot[bot]
94008a84a4
chore(deps): bump github.com/schollz/progressbar/v3 from 3.14.1 to 3.14.2 ( #5453 )
2024-04-01 09:56:07 -07:00
dependabot[bot]
2fc37db77e
chore(deps): bump go.etcd.io/etcd/client/pkg/v3 from 3.5.12 to 3.5.13 ( #5452 )
2024-04-01 09:55:28 -07:00
dependabot[bot]
53fdda82f0
chore(deps): bump github.com/aws/aws-sdk-go-v2 from 1.26.0 to 1.26.1 ( #5451 )
2024-04-01 09:55:11 -07:00
dependabot[bot]
fab5f66a95
chore(deps): bump github.com/linxGnu/grocksdb from 1.8.12 to 1.8.14 ( #5450 )
2024-04-01 09:02:26 -07:00
dependabot[bot]
c18a4c6911
chore(deps): bump github.com/go-sql-driver/mysql from 1.8.0 to 1.8.1 ( #5449 )
2024-04-01 09:01:57 -07:00
dependabot[bot]
d41c1c2956
chore(deps): bump github.com/viant/ptrie from 0.3.0 to 0.3.1 ( #5447 )
2024-04-01 09:01:36 -07:00
dependabot[bot]
d6149f87a3
chore(deps): bump github.com/cenkalti/backoff/v4 from 4.2.1 to 4.3.0 ( #5446 )
2024-04-01 09:01:18 -07:00
dependabot[bot]
ef06d6f074
chore(deps): bump google.golang.org/api from 0.169.0 to 0.172.0 ( #5448 )
2024-04-01 08:59:56 -07:00
dependabot[bot]
2e5aa8d03b
chore(deps): bump actions/dependency-review-action from 4.2.4 to 4.2.5 ( #5445 )
2024-04-01 08:27:33 -07:00
chrislu
47975e75bf
purge old code
2024-03-31 17:49:34 -07:00
chrislu
237e68059d
shutdown follower if no clients, not only publishers
...
to avoid overhead when a publisher repeatedly send one message and close
2024-03-31 17:45:26 -07:00
chrislu
66a878af39
add control message to data message
2024-03-31 16:35:46 -07:00
chrislu
546ae87c39
send is_close message to broker
2024-03-31 01:28:40 -07:00
chrislu
c9df613b6b
add publisher name for debugging
2024-03-31 00:19:16 -07:00
chrislu
ca4f89a6f6
simplify
2024-03-30 20:37:57 -07:00
chrislu
0d55bddc75
logs
2024-03-30 20:37:46 -07:00
Nikita Borzykh
829c0da381
fix: adjust condition in prefixFilterEntries prevent infinite loop ( #5440 )
2024-03-30 14:47:00 -07:00
Konstantin Lebedev
f9ec92dd83
[tests] add action s3 tests ( #5427 )
2024-03-29 07:57:27 -07:00
Konstantin Lebedev
9c1e0f5811
[master] grow volumes if no writable volumes in current dataCenter ( #5434 )
...
* grow volumes if no writable volumes in current dataCenter
https://github.com/seaweedfs/seaweedfs/issues/3886
* fix tests with volume grow
* automatic volume grow one volume
* add ErrorChunkAssign metrics
2024-03-29 00:38:27 -07:00
Konstantin Lebedev
df40908e57
fix panic 5435 ( #5436 )
2024-03-28 16:17:59 -07:00
chrislu
13b7c7b366
Merge branch 'master' into mq-subscribe
2024-03-27 23:57:00 -07:00
chrislu
e3c8be7f89
LocalPartition shutdown
2024-03-27 23:55:06 -07:00
chrislu
ab9fc0ad70
simplify
2024-03-27 23:42:19 -07:00
chrislu
7463058299
change visibility
2024-03-27 23:11:35 -07:00
chrislu
dab5454332
publish and send to follower
2024-03-27 23:10:24 -07:00
chrislu
f249f831b1
MaybeShutdownLocalPartition refactor
2024-03-27 23:02:51 -07:00
chrislu
2a0ab7e90d
fix
2024-03-27 22:59:50 -07:00
chrislu
059a120708
refactor
2024-03-27 22:58:20 -07:00
chrislu
7d87c1d2bb
refactor
2024-03-27 22:48:37 -07:00
chrislu
6aa804b368
lock instead of RLock, to prevent racing condition
...
https://github.com/seaweedfs/seaweedfs/discussions/5432#discussioncomment-8933608
2024-03-27 16:05:11 -07:00
chrislu
5cc94a05b9
separate goroutine to send ack to publisher
2024-03-27 10:27:08 -07:00
chrislu
17806cde2a
separate context
...
If using the same context, the downstream grpc would be cancelled when the parent grpc is cancelled.
2024-03-27 10:24:57 -07:00
chrislu
f67c8309d8
rename
2024-03-26 21:52:12 -07:00
chrislu
7d69552974
log server list
2024-03-26 21:51:28 -07:00
chrislu
36fec34c47
print only adapted url
...
fix https://github.com/seaweedfs/seaweedfs/issues/5424
2024-03-25 12:50:43 -07:00