Commit Graph

786 Commits

Author SHA1 Message Date
chrislu
5dc1362bdc close the input 2024-01-27 16:12:49 -08:00
chrislu
fa835c9319 Update buffered_queue_test.go 2024-01-27 14:46:12 -08:00
Chris Lu
b6de35cdb2 moved. there are some deadlock. WIP 2024-01-27 13:51:19 -08:00
chrislu
08c5fba825 adds a buffered queue 2024-01-25 20:22:41 -08:00
chrislu
1877ce5126 rename 2024-01-15 21:31:21 -08:00
chrislu
33d5343ea1 Merge branch 'master' into mq-subscribe 2024-01-15 20:56:21 -08:00
chrislu
59b8af99b0 3.62 2024-01-15 20:44:00 -08:00
chrislu
fa59a5d67e read from disk if not in memory 2024-01-15 00:20:12 -08:00
chrislu
d6ba97219b refactoring 2024-01-13 17:51:53 -08:00
chrislu
188f471a24 logging 2024-01-11 07:55:26 -08:00
chrislu
d51efddf5c flush to disk
Need to do: read from disk
2024-01-08 23:27:02 -08:00
chrislu
fbb4917e2f Merge branch 'master' into mq-subscribe 2024-01-08 00:08:49 -08:00
chrislu
8ae00e47a6 3.61 2024-01-08 00:04:49 -08:00
chrislu
49428a303b add batch index for each memory buffer 2024-01-08 00:03:08 -08:00
chrislu
1206313952 add logs on flush 2024-01-05 15:35:42 -08:00
chrislu
add16fb1a1 logs 2024-01-05 15:16:22 -08:00
chrislu
d4e91b6ad9 3.60 2024-01-01 19:11:23 -08:00
chrislu
bb9269f3f7 Revert "Update network.go since To16 converts the IP address ip up to a 16-byte representation. If ip is not an IP address (it is the wrong length), To16 returns nil. (#5134)"
This reverts commit 838578b55f.
2023-12-24 12:31:08 -08:00
vivekkoya
838578b55f
Update network.go since To16 converts the IP address ip up to a 16-byte representation. If ip is not an IP address (it is the wrong length), To16 returns nil. (#5134) 2023-12-23 15:01:57 -08:00
chrislu
03c4b2e988 correct lock accounting
possibly fix https://github.com/seaweedfs/seaweedfs/issues/5082
2023-12-22 14:16:23 -08:00
chrislu
81f11883e3 go fmt 2023-11-26 11:47:20 -08:00
chrislu
27b34f3793 3.59 2023-11-12 22:12:08 -08:00
chrislu
c563386675 rename parameters 2023-11-09 08:02:39 -08:00
chrislu
d1e83a3b4d 3.58 2023-10-29 23:04:20 -07:00
Konstantin Lebedev
1cac5d983d
fix: disallow file name too long when writing a file (#4881)
* fix: disallow file name too long when writing a file

* bool LongerName to MaxFilenameLength

---------

Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2023-10-12 14:29:55 -07:00
chrislu
321fda552c comment 2023-10-01 11:36:27 -07:00
chrislu
b02fdeabff RetryForever => RetryUntil 2023-10-01 11:33:56 -07:00
chrislu
40888b5612 align 64bit atomic operation
fix https://github.com/seaweedfs/seaweedfs/issues/4878
2023-09-28 07:58:43 -07:00
Konstantin Lebedev
44906f1f3b
fix: avoid error file name too long when writing a file (#4876) 2023-09-27 05:40:51 -07:00
chrislu
645ae8c57b Revert "Revert "Merge branch 'master' of https://github.com/seaweedfs/seaweedfs""
This reverts commit 8cb42c39
2023-09-25 09:35:16 -07:00
chrislu
a6e35e4f68 fix compilation 2023-09-25 09:16:33 -07:00
chrislu
0f8168c0c9 3.57 2023-09-24 21:29:31 -07:00
chrislu
1df4223195 minor 2023-09-24 09:54:57 -07:00
chrislu
10ac25f857 avoid deleting the entry too early 2023-09-23 12:43:00 -07:00
chrislu
c43238b30a fix waiting condition 2023-09-23 12:28:02 -07:00
chrislu
322af1fc04 fix compilation 2023-09-23 12:13:32 -07:00
chrislu
0414b68a4f if shared lock, still need to wait for exclusive lock to release 2023-09-23 12:08:23 -07:00
chrislu
9ba4639a27 adjust for better logs 2023-09-23 11:53:44 -07:00
chrislu
2df70ce95f adjust logs 2023-09-21 23:51:32 -07:00
chrislu
49a470bcdf reduce logs 2023-09-21 20:08:20 -07:00
chrislu
7669852241 adjust logs 2023-09-21 11:04:12 -07:00
chrislu
e3b1bacf3f add lock table to ensure ordered locks 2023-09-21 10:24:34 -07:00
chrislu
8cb42c39ad Revert "Merge branch 'master' of https://github.com/seaweedfs/seaweedfs"
This reverts commit 2e5aa06026, reversing
changes made to 4d414f54a2.
2023-09-18 16:12:50 -07:00
dependabot[bot]
a04bd4d26f
Bump github.com/rclone/rclone from 1.63.1 to 1.64.0 (#4850)
* Bump github.com/rclone/rclone from 1.63.1 to 1.64.0

Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone) from 1.63.1 to 1.64.0.
- [Release notes](https://github.com/rclone/rclone/releases)
- [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md)
- [Commits](https://github.com/rclone/rclone/compare/v1.63.1...v1.64.0)

---
updated-dependencies:
- dependency-name: github.com/rclone/rclone
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* API changes

* go mod

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
2023-09-18 14:43:05 -07:00
chrislu
5407b86766 3.56 2023-09-10 22:05:41 -07:00
Lars Lehtonen
e6385e5e8b
weed/util: fix dropped errors (#4803) 2023-09-01 13:10:45 -07:00
chrislu
16e3f2d528 fix log buffer test 2023-08-20 12:46:15 -07:00
chrislu
3e9c32a3f0 refactoring to use atomic bool
fix compilation
2023-08-20 12:13:06 -07:00
chrislu
7eafa3420b 3.55 2023-07-23 23:11:37 -07:00
chrislu
358b3a4894 3.54 2023-07-16 22:47:57 -07:00
chrislu
2c4c2f0994 3.53 2023-06-25 22:51:14 -07:00
chrislu
fb4b61036c 3.52 2023-06-04 22:34:26 -07:00
chrislu
4310e1fac4 3.51 2023-05-21 23:43:39 -07:00
chrislu
9204ee2d2d 3.50 2023-05-11 08:03:11 -07:00
chrislu
25b237b83c reset wait time on a successful retry 2023-05-07 23:39:33 -07:00
chrislu
59f55c1a66 3.49 2023-05-07 14:00:19 -07:00
chrislu
42766bccc8 3.48 2023-04-30 22:20:18 -07:00
chrislu
18686b7375 3.47 2023-04-23 22:45:41 -07:00
wusong
19245dde50
mount: add retry for read only case (#4416)
* mount: add retry for read only case

Signed-off-by: Wusong Wang <wangwusong@virtaitech.com>

* add new util retry function for mount

Signed-off-by: Wusong Wang <wangwusong@virtaitech.com>

* change error list param

Signed-off-by: Wusong Wang <wangwusong@virtaitech.com>

---------

Signed-off-by: Wusong Wang <wangwusong@virtaitech.com>
Co-authored-by: Wusong Wang <wangwusong@virtaitech.com>
2023-04-21 00:09:31 -07:00
SmsS4
4131874fa8
use env for flags wtih dot in name (#4415) 2023-04-20 09:33:27 -07:00
chrislu
8ecdf958ab 3.46 2023-04-16 21:57:43 -07:00
chrislu
b9ab65dba5 3.45 2023-04-02 22:52:58 -07:00
chrislu
5b43c4bb98 3.44 2023-03-19 20:27:55 -07:00
chrislu
3227e4175e 3.43 2023-02-20 16:56:05 -08:00
chrislu
8821d6b161 3.42 2023-02-05 21:28:02 -08:00
chrislu
4d71af87f3 3.41 2023-01-29 22:56:01 -08:00
chrislu
2885ba0e50 3.40 2023-01-15 20:12:05 -08:00
chrislu
51d4a4b28d 3.39 2023-01-08 18:20:22 -08:00
chrislu
48f2edc065 3.38 2023-01-02 23:23:02 -08:00
chrislu
438146249f 3.37 2022-12-11 21:08:06 -08:00
chrislu
fad7e1f7cb 3.36 2022-12-04 23:34:29 -08:00
chrislu
b1d7963e57 3.35 2022-11-14 00:21:00 -08:00
Guo Lei
5b905fb2b7
Lazy loading (#3958)
* types packages is imported more than onece

* lazy-loading

* fix bugs

* fix bugs

* fix unit tests

* fix test error

* rename function

* unload ldb after initial startup

* Don't load ldb when starting volume server if ldbtimeout is set.

* remove uncessary unloadldb

* Update weed/command/server.go

Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>

* Update weed/command/volume.go

Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>

Co-authored-by: guol-fnst <goul-fnst@fujitsu.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2022-11-14 00:19:27 -08:00
chrislu
47db75a695 3.34 2022-11-06 23:06:22 -08:00
chrislu
0f360862bf 3.33 2022-10-30 20:40:18 -07:00
chrislu
758d70bdc0 3.32 2022-10-16 20:43:37 -07:00
Konstantin Lebedev
ee38ab8581
avoid data race of LogBuffer isStopping (#3859) 2022-10-16 11:28:56 -07:00
Konstantin Lebedev
401315f337
master fix interruption through ctrl+c (#3834) 2022-10-12 07:18:40 -07:00
chrislu
0711870f43 3.31 2022-10-10 00:15:30 -07:00
chrislu
29632d5a34 3.30 2022-10-02 18:13:44 -07:00
Konstantin Lebedev
301b678147
[volume] Add new volumes to HUP(reload) signal (#3755)
Add new volumes to HUP(reload) signal
2022-09-28 12:44:13 -07:00
chrislu
47fd5d3fa1 skip debug message 2022-09-27 13:12:31 -07:00
chrislu
1ffb1e696e 3.29 2022-09-25 19:20:45 -07:00
chrislu
640c53cda8 add future list 2022-09-25 17:43:42 -07:00
chrislu
cc570a4477 assert results are sorted 2022-09-25 13:49:28 -07:00
chrislu
5c8f1467a1 ordered execution async wait 2022-09-25 13:45:55 -07:00
chrislu
973b8ff067 rename 2022-09-25 13:34:55 -07:00
chrislu
e31fdbc89b rename file 2022-09-25 12:59:38 -07:00
chrislu
901e8157de 3.28 2022-09-18 17:46:04 -07:00
Ryan Russell
0fc242b084
docs: panicing -> panicking (#3687)
Signed-off-by: Ryan Russell <git@ryanrussell.org>

Signed-off-by: Ryan Russell <git@ryanrussell.org>
2022-09-15 01:38:04 -07:00
chrislu
21c0587900 go fmt 2022-09-14 23:06:44 -07:00
Ryan Russell
8efe1db01a
refactor(various): Listner -> Listener readability improvements (#3672)
* refactor(net_timeout): `listner` -> `listener`

Signed-off-by: Ryan Russell <git@ryanrussell.org>

* refactor(s3): `s3ApiLocalListner` -> `s3ApiLocalListener`

Signed-off-by: Ryan Russell <git@ryanrussell.org>

* refactor(filer): `localPublicListner` -> `localPublicListener`

Signed-off-by: Ryan Russell <git@ryanrussell.org>

* refactor(command): `masterLocalListner` -> `masterLocalListener`

Signed-off-by: Ryan Russell <git@ryanrussell.org>

* refactor(net_timeout): `ipListner` -> `ipListener`

Signed-off-by: Ryan Russell <git@ryanrussell.org>

Signed-off-by: Ryan Russell <git@ryanrussell.org>
2022-09-14 11:59:55 -07:00
Ryan Russell
a36d7b77be
refactor(cipher_test): plantext -> plaintext (#3669)
Signed-off-by: Ryan Russell <git@ryanrussell.org>

Signed-off-by: Ryan Russell <git@ryanrussell.org>
2022-09-14 11:24:09 -07:00
Ryan Russell
e22335ba78
refactor(queue_unbounded): inbountLen -> inboundLen (#3666) 2022-09-14 10:12:45 -07:00
chrislu
d8ca7d34fe 3.27 2022-09-11 19:47:53 -07:00
chrislu
c07ab9c060 3.26 2022-09-06 08:26:20 -07:00
chrislu
5b38f22e6e 3.25 2022-09-04 22:45:55 -07:00
Konstantin Lebedev
853880bd83
[filer] DATA RACE on signal_handling fixed (#3575) 2022-09-02 06:20:19 -07:00
chrislu
d1bb23645e Revert "avoid data race on grace.hooks (#3572)"
This reverts commit c37d6fc01a.
2022-09-01 13:08:34 -07:00
Konstantin Lebedev
c37d6fc01a
avoid data race on grace.hooks (#3572)
https://github.com/seaweedfs/seaweedfs/issues/3564
2022-09-01 10:34:06 -07:00