mirror/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-12-25 10:17:55 +08:00
Code Issues Packages Projects Releases Wiki Activity
10,796 Commits 32 Branches 296 Tags 153 MiB
23809a1e84
Commit Graph

6938 Commits

Author SHA1 Message Date
chrislu
06e3dd306f clean up 2024-07-11 00:19:39 -07:00
chrislu
c59517e284 upgrade to github.com/redis/go-redis/v9 
fix https://github.com/seaweedfs/seaweedfs/issues/4532
 2024-07-11 00:15:19 -07:00
chrislu
33b11f92bc Squashed commit of the following: 
commit 465b47b8f72668dfc12eaa72befb232513c9e1db
Merge: f39272b54 9c440d472
Author: chrislu <chris.lu@gmail.com>
Date:   Wed Jul 10 23:56:51 2024 -0700

    Merge branch 'master' into merged-persisted-logs

commit f39272b5416bdd4d1714ce3e99aded0fe62e7d89
Author: chrislu <chris.lu@gmail.com>
Date:   Wed Jul 10 23:49:26 2024 -0700

    merge meta logs from multiple files
 2024-07-11 00:04:24 -07:00
Konstantin Lebedev
9c440d472c
[s3] revert skip deletion error, since the error file was not found is already skipped on the side of the grpc function (#5760) 
* revert skip deletion error, since the error file was not found is already skipped on the side of the grpc function

* fix response error

* fix test_lifecycle_get

* Revert "fix test_lifecycle_get"

This reverts commit 8f991bdcf9.
 2024-07-10 08:47:43 -07:00
chrislu
182f6d00a9 always copy ecj files 2024-07-10 01:25:57 -07:00
Dan
bd54669d58
Detect underflow when calculating unused space (#5758) 
* Detect underflow when calculating unused space

* Detect underflow when calculating unused space
 2024-07-10 00:30:28 -07:00
chrislu
b8121e4b24 simplify 2024-07-08 11:10:41 -07:00
chrislu
f618121e63 Fix S3 deletion in deep folders, and names with empty spaces 
fix https://github.com/seaweedfs/seaweedfs/issues/5748
 2024-07-08 10:20:09 -07:00
chrislu
f3d708d3b6 add a test case 2024-07-07 23:44:36 -07:00
chrislu
d29fccc521 skip checking if it is the root directory 2024-07-07 23:44:36 -07:00
chrislu
114ac39917 add a simple test 2024-07-07 23:44:36 -07:00
Konstantin Lebedev
f77eee667d
add s3test for sql (#5718) 
* add s3test for sql

* fix test test_bucket_listv2_delimiter_basic for s3

* fix action s3tests

* regen s3 api xsd

* rm minor s3 test test_bucket_listv2_fetchowner_defaultempty

* add docs

* without xmlns
 2024-07-04 11:00:41 -07:00
chrislu
7c06306857 fix breadcrumb 2024-07-03 17:40:55 -07:00
rhysm
7ee1f520a4
volume.tier.upload: Fix deleting replicated volumes (#5743) 
Co-authored-by: Rhys M <rhysm@protonmail.com>
 2024-07-03 15:51:25 -07:00
chrislu
8943a572d8 log error message 2024-07-03 09:50:47 -07:00
chrislu
62c29b2398 Revert "directory can paginate" 
This reverts commit 69003d0e90.
 2024-07-02 23:55:48 -07:00
chrislu
761a1555de fix ordering 2024-07-02 23:55:40 -07:00
chrislu
69003d0e90 directory can paginate 2024-07-02 21:36:03 -07:00
Konstantin Lebedev
5ffacbb6ea
refactor all methods strings to const (#5726) 2024-07-01 01:00:39 -07:00
chrislu
0fdf7eca48 avoid possible nil case during other error cases 2024-07-01 00:54:37 -07:00
chrislu
ac6fd36c06 using fixed bootstrap from peer filer 2024-06-30 23:16:54 -07:00
chrislu
fbe1316c92 3.69 2024-06-30 23:08:49 -07:00
chrislu
d8dfadb617 ParallelProcessDirectoryStructure 
need to use this for simpler parallel processing
 2024-06-28 15:02:46 -07:00
chrislu
1c0718f26d Merge branch 'master' of https://github.com/seaweedfs/seaweedfs 2024-06-28 14:57:23 -07:00
chrislu
c030cb3ce9 bootstrap filer from one peer 2024-06-28 14:57:20 -07:00
chrislu
00f87e5bb5 remove unused 2024-06-28 14:54:39 -07:00
Taehyung Lim
4d0bf6ddd4
fixed fail to initialize existing ec volume when volume server has separate index dictory (#5723) 2024-06-28 13:04:51 -07:00
chrislu
cb67137a03 optionally open the leveldb in readonly mode 2024-06-25 21:07:04 -07:00
chrislu
90182e97fe remove unused function 2024-06-25 09:18:11 -07:00
chrislu
9ac1023362 check bucket name in sql backend 
fix https://github.com/seaweedfs/seaweedfs/issues/5710
 2024-06-25 08:54:19 -07:00
chrislu
ded761ffc5 adjust visibility 2024-06-24 17:14:52 -07:00
chrislu
07f47776c3 minor 2024-06-23 11:47:26 -07:00
Nikita Borzykh
64756c2d79
fix: correct command flag for master.raftBootstrap option in server.go (#5701) 2024-06-22 19:28:37 -07:00
chrislu
82ef66cc19 Merge branch 'master' of https://github.com/seaweedfs/seaweedfs 2024-06-22 08:30:18 -07:00
chrislu
622448b993 update advancedtls 2024-06-22 08:30:16 -07:00
Numblgw
73baf82f05
bugfix: unregister ec shards when volume server disconnected (#5697) 
bugfix unregister ec shards when volume server disconnected

Co-authored-by: liguowei <liguowei@xinye.com>
 2024-06-20 15:29:36 -07:00
Konstantin Lebedev
34165013c8
chore: hot fix panic fs.verify (#5696) 2024-06-20 15:24:31 -07:00
Konstantin Lebedev
7988ee0805
[fs.verify] skip failed files if entry not found on filerStore (#5693) 2024-06-19 06:50:55 -07:00
Konstantin Lebedev
ece018b1a9
[fs.verify] getmeta data from filer log (#5678) 
* initial

* fix: print entry path
 2024-06-18 22:56:47 -07:00
chrislu
a829f36d17 adjust error handling 
fix https://github.com/seaweedfs/seaweedfs/issues/5677
 2024-06-17 10:59:41 -07:00
chrislu
464611f614 optionally skip deleting file chunks 2024-06-15 11:39:48 -07:00
chrislu
64fd233a59 DeleteUncommittedChunks 2024-06-15 09:55:22 -07:00
chrislu
843e778875 refactor 2024-06-15 09:41:08 -07:00
chrislu
677cfb8ad1 refactor 2024-06-15 09:39:49 -07:00
vadimartynov
8aae82dd71
Added context for the MasterClient's methods to avoid endless loops (#5628) 
* Added context for the MasterClient's methods to avoid endless loops

* Returned WithClient function. Added WithClientCustomGetMaster function

* Hid unused ctx arguments

* Using a common context for the KeepConnectedToMaster and WaitUntilConnected functions

* Changed the context termination check in the tryConnectToMaster function

* Added a child context to the tryConnectToMaster function

* Added a common context for KeepConnectedToMaster and WaitUntilConnected functions in benchmark
 2024-06-14 11:40:34 -07:00
chrislu
2a169dde9a minor 2024-06-14 09:17:46 -07:00
chrislu
b03c831ad2 more logs 2024-06-13 21:48:44 -07:00
Taehyung Lim
4744889973
fix issue: sometimes volume.fsck report 'volume not found' (#5537) 
* fix issue: sometimes volume.fsck report 'volume not found' when a volume server has multiple disk types

* rename variable

* adjust counters

---------

Co-authored-by: chrislu <chris.lu@gmail.com>
 2024-06-11 22:22:57 -07:00
MeenakshiSachdeva
d2516d99cc
Meenakshi fix filer sync (#5672) 
* Fix Filer Sync Issue: 5455

* Fix Filer Sync Issue: 5455
 2024-06-10 11:16:29 -07:00
MeenakshiSachdeva
1caa012a76
Fix Filer Sync Issue: 5455 (#5663) 2024-06-10 09:19:38 -07:00
chrislu
a9cd9b0542 3.68 2024-06-09 21:10:46 -07:00
chrislu
dbfbabac55 simplify 2024-06-09 12:14:10 -07:00
steve.wei
2150289442
fix: Ensure that the clientAddress is unique (#5655) 2024-06-07 09:13:03 -07:00
Gaspare Iengo
dc6b750424
Fix panic (#5654) 2024-06-06 18:59:50 -07:00
Gaspare Iengo
fce8fc1e16
Fix Issue #5649 (#5652) 2024-06-06 12:49:33 -07:00
steve.wei
d8da4bbaa7
Set the capacity of clientChan to 10000 (#5647) 2024-06-05 05:41:46 -07:00
Lê Hoàng Nam
1f2dc54647
fix(s3api): make post api upload object default return 204 (#5648) 2024-06-04 06:18:47 -07:00
LHHDZ
36b5b713ba
fix deadlock caused by message chan blocked (#5639) 2024-06-03 07:42:40 -07:00
Dominic Pearson
d8bde9b96e
Solaris disk support (#5638) 2024-06-02 22:10:28 -07:00
NyaMisty
579ebbdf60
Support concurrent volume.fsck & support disabling -cutoffTimeAgo to improve speed (#5636) 2024-06-02 14:25:42 -07:00
NyaMisty
0c62d591e2
Ignore remote volume when selecting volumes in operation (ec.encode/volume.tier.upload) (#5635) 2024-06-02 14:16:05 -07:00
NyaMisty
e1c671c028
Fix volume.tier.upload nil pointer panic (#5634) 2024-06-02 14:15:39 -07:00
NyaMisty
f2a37933b1
Fix sorted needle file's write mode for (*SortedFileNeedleMap).Delete() (#5633) 2024-06-02 14:12:25 -07:00
chrislu
3ddfd15ec1 Merge branch 'master' of https://github.com/seaweedfs/seaweedfs 2024-05-29 10:41:38 -07:00
chrislu
3e7a92061b pass along volume server grpc port 
fix https://github.com/seaweedfs/seaweedfs/issues/5617
 2024-05-29 10:41:33 -07:00
dependabot[bot]
722a14ef57
chore(deps): bump github.com/ydb-platform/ydb-go-sdk-auth-environ from 0.2.0 to 0.4.2 (#5621) 
* chore(deps): bump github.com/ydb-platform/ydb-go-sdk-auth-environ

Bumps [github.com/ydb-platform/ydb-go-sdk-auth-environ](https://github.com/ydb-platform/ydb-go-sdk-auth-environ) from 0.2.0 to 0.4.2.
- [Changelog](https://github.com/ydb-platform/ydb-go-sdk-auth-environ/blob/master/CHANGELOG.md)
- [Commits](https://github.com/ydb-platform/ydb-go-sdk-auth-environ/compare/v0.2.0...v0.4.2)

---
updated-dependencies:
- dependency-name: github.com/ydb-platform/ydb-go-sdk-auth-environ
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* fix compilation

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
 2024-05-27 12:36:00 -07:00
Vlad
72f7b4e9b1
Replaces volume.unmount in the help of the volumeServer.leave (#5619) 2024-05-27 01:13:06 -07:00
chrislu
364bb6c7b4 avoid ticker leak 2024-05-24 17:15:12 -07:00
chrislu
ba98f02d02 go fmt 2024-05-23 08:25:16 -07:00
Chris Lu
cfcf383ee7
fix wrong prefix example 2024-05-21 21:45:29 -07:00
Vlad
a9b057389f
chore: add missing concurrency help in fs.meta.load command (#5609) 2024-05-21 21:42:48 -07:00
chrislu
aba212dedd Merge branch 'master' of https://github.com/seaweedfs/seaweedfs 2024-05-20 11:03:58 -07:00
chrislu
d218fe54fa go fmt 2024-05-20 11:03:56 -07:00
sb
a3a00d9499
Feature/mongodb security (#5602) 2024-05-18 12:19:10 -07:00
sb
3fae87632f
add filer configuration options for username/password and tls (#5601) 2024-05-18 09:02:03 -07:00
Riccardo Bertossa
f6e8a9bf9c
added s3 iam DeleteBucket permission management (#5599) 2024-05-17 04:54:09 -07:00
Martin Stiborský
54f3913bed
[s3] Fixed s3 replication by sending content-md as base64 (#5596) 2024-05-14 06:48:24 -07:00
Konstantin Lebedev
d389c5b27e
fix: recreate index include deleted files (#5579) 
* fix: recreate index include deleted files
https://github.com/seaweedfs/seaweedfs/issues/5508

* fix: counting the number of files

* fix: log
 2024-05-12 11:31:34 -07:00
Dave St.Germain
731b3aadbe
Add support for OpenBSD (#5578) 
Co-authored-by: Dave St.Germain <dcs@adullmoment.com>
 2024-05-10 14:35:41 -07:00
chrislu
d3032d1e80 3.67 2024-05-07 08:47:30 -07:00
chrislu
1917f70f78 also delete parent folder if empty 
fix https://github.com/seaweedfs/seaweedfs/issues/5567
 2024-05-07 08:46:19 -07:00
Patrick Schmidt
96c48bd0da
Fix deadlock in lock table locks (#5566) 2024-05-07 05:44:53 -07:00
chrislu
3682eb929f 3.66 2024-05-05 22:23:18 -07:00
chrislu
fcedf97e94 fix test 2024-05-05 22:19:59 -07:00
chrislu
664b704e30 add delay 2024-05-05 14:17:41 -07:00
chrislu
4e3701df77 reset last error 2024-05-05 14:16:54 -07:00
chrislu
658d302aa4 init candidate servers when setting a starting snapshot 2024-05-05 14:16:26 -07:00
chrislu
a5645d50a7 ensure head index is within range 2024-05-05 12:20:08 -07:00
chrislu
253ec73a17 log 2024-05-05 12:19:31 -07:00
chrislu
30f8600a24 working 2024-05-03 21:27:06 -07:00
chrislu
7a9b115cc2 rename 2024-05-02 11:14:58 -07:00
chrislu
4a3e8869bb subscriber can unmarshal the record 2024-05-02 09:56:11 -07:00
chrislu
1c5043baf7 rename 2024-05-02 09:47:29 -07:00
chrislu
f2f4630029 rename field types 2024-05-02 08:59:22 -07:00
chrislu
b8af997e41 consistent with protobuf data types 2024-05-02 08:52:10 -07:00
chrislu
0f35b3a4ea add example to publish a record 2024-05-02 08:48:51 -07:00
chrislu
928a4e8dff rename 2024-05-02 08:35:06 -07:00
chrislu
5bc1b70a4c rename to WithField() 2024-05-02 08:32:15 -07:00
chrislu
a568d128fb Merge branch 'master' into mq-subscribe 2024-05-02 08:13:53 -07:00
chrislu
f80fb1c02e Merge branch 'master' into mq-subscribe 2024-04-29 21:57:31 -07:00