mirror/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-12-30 21:25:32 +08:00
Code Issues Packages Projects Releases Wiki Activity
11,156 Commits 32 Branches 296 Tags 153 MiB
19d01c02c6
Commit Graph

11156 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
chrislu
2ea18cdcc8 remove dead code 2022-07-07 22:26:03 -07:00
Chris Lu
fa8e33ccb8
Update binaries_dev.yml 2022-07-07 22:11:44 -07:00
chrislu
b7de5c6c43 shell: remove unused filer parameter from shell.toml 2022-07-07 15:01:23 -07:00
chrislu
f2f0482dd3 mount: random read also try to use the local cache first 2022-07-07 11:50:28 -07:00
chrislu
05c53820b9 mount: file handler release memory 2022-07-07 11:49:40 -07:00
chrislu
e7843b4127 Merge branch 'master' into messaging 2022-07-06 02:55:13 -07:00
chrislu
69ef6459c3 S3 ListObjectsV2 fix pagination under bucket root 
fix https://github.com/chrislusf/seaweedfs/issues/3166
 2022-07-06 02:28:34 -07:00
Chris Lu
bfea7008f3
Merge pull request #3277 from kmlebedev/rabbitry_enable_durable 2022-07-06 00:19:49 -07:00
Konstantin Lebedev
785223e587 rabbitpubsub enable durable 2022-07-06 10:05:29 +05:00
chrislu
cc51c7582f Merge branch 'master' into messaging 2022-07-04 13:48:00 -07:00
chrislu
57975b93ff adjust used size reporting 2022-07-04 13:47:42 -07:00
chrislu
a79f5bd0d5 adjust used size reporting 2022-07-04 13:46:32 -07:00
chrislu
3c79c77056 3.14 2022-07-04 13:15:49 -07:00
Chris Lu
05510630fd
Merge pull request #3270 from chrislusf/dependabot/go_modules/cloud.google.com/go/pubsub-1.23.1 2022-07-04 12:09:06 -07:00
dependabot[bot]
2c031f2a7c
Bump cloud.google.com/go/pubsub from 1.22.2 to 1.23.1 
Bumps [cloud.google.com/go/pubsub](https://github.com/googleapis/google-cloud-go) from 1.22.2 to 1.23.1.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases)
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-cloud-go/compare/pubsub/v1.22.2...pubsub/v1.23.1)

---
updated-dependencies:
- dependency-name: cloud.google.com/go/pubsub
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-07-04 19:08:32 +00:00
Chris Lu
f69a8127a4
Merge pull request #3271 from chrislusf/dependabot/go_modules/github.com/stretchr/testify-1.8.0 2022-07-04 12:06:46 -07:00
Chris Lu
9ea1d093b0
Merge pull request #3272 from chrislusf/dependabot/go_modules/github.com/aws/aws-sdk-go-1.44.47 2022-07-04 12:06:36 -07:00
Chris Lu
c2c9c6d60a
Merge pull request #3273 from chrislusf/dependabot/go_modules/modernc.org/sqlite-1.17.3 2022-07-04 12:06:27 -07:00
Chris Lu
00d5be61d3
Merge pull request #3274 from chrislusf/dependabot/go_modules/google.golang.org/api-0.86.0 2022-07-04 12:06:13 -07:00
dependabot[bot]
bf924e37c1
Bump google.golang.org/api from 0.85.0 to 0.86.0 
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.85.0 to 0.86.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.85.0...v0.86.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-07-04 15:45:24 +00:00
dependabot[bot]
8f7273a13c
Bump modernc.org/sqlite from 1.17.2 to 1.17.3 
Bumps [modernc.org/sqlite](https://gitlab.com/cznic/sqlite) from 1.17.2 to 1.17.3.
- [Release notes](https://gitlab.com/cznic/sqlite/tags)
- [Commits](https://gitlab.com/cznic/sqlite/compare/v1.17.2...v1.17.3)

---
updated-dependencies:
- dependency-name: modernc.org/sqlite
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-07-04 15:45:13 +00:00
dependabot[bot]
d243fa49cf
Bump github.com/aws/aws-sdk-go from 1.44.37 to 1.44.47 
Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go) from 1.44.37 to 1.44.47.
- [Release notes](https://github.com/aws/aws-sdk-go/releases)
- [Changelog](https://github.com/aws/aws-sdk-go/blob/main/CHANGELOG.md)
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.44.37...v1.44.47)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-07-04 15:44:49 +00:00
dependabot[bot]
92f62165ef
Bump github.com/stretchr/testify from 1.7.5 to 1.8.0 
Bumps [github.com/stretchr/testify](https://github.com/stretchr/testify) from 1.7.5 to 1.8.0.
- [Release notes](https://github.com/stretchr/testify/releases)
- [Commits](https://github.com/stretchr/testify/compare/v1.7.5...v1.8.0)

---
updated-dependencies:
- dependency-name: github.com/stretchr/testify
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-07-04 15:44:39 +00:00
Chris Lu
a122baa427
Merge pull request #3268 from guol-fnst/fix_usage 
add getting bucket quota
 2022-07-04 00:44:43 -07:00
guol-fnst
5bc895673e add getting bucket quota 2022-07-04 15:36:44 +08:00
Chris Lu
267d45c313
Merge pull request #3266 from guol-fnst/fix_usage 
fix usage
 2022-07-03 22:11:37 -07:00
guol-fnst
dd4664e610 fix usage 2022-07-04 11:31:39 +08:00
Chris Lu
c349f81195
Update binaries_dev.yml 2022-07-03 16:16:44 -07:00
chrislu
c1eb4b2c9f Merge branch 'master' into messaging 2022-07-03 16:09:14 -07:00
chrislu
d0eb65ae7b update go-fuse library version 
Make OSXFUSE handle timeouts the same way as Linux
 2022-07-03 16:09:03 -07:00
chrislu
3254f18343 display data center and rack in cluster.ps 2022-07-03 00:55:37 -07:00
chrislu
9f20d3ebd1 add dc and rack 2022-07-03 00:29:25 -07:00
chrislu
0f5d7ed242 mq broker adds data center and rack 2022-07-02 09:28:24 -07:00
chrislu
857a42565e cluster.ps can list brokers 2022-07-01 23:34:51 -07:00
chrislu
ffc2c0a2ef renaming 2022-07-01 22:44:28 -07:00
chrislu
5536ed85e5 renaming 2022-07-01 22:43:25 -07:00
chrislu
54bb41d126 Merge branch 'messaging' of https://github.com/chrislusf/seaweedfs into messaging 2022-07-01 21:59:57 -07:00
chrislu
7df440e36f rename to SeaweedMQ 2022-07-01 21:59:50 -07:00
Chris Lu
7c32361a7d Added SeaweedMQ_Architecture.png 2022-07-01 21:43:39 -07:00
chrislu
141f662734 edge case checking when volume server does not have capacity to balance 
fix https://github.com/chrislusf/seaweedfs/issues/3257
 2022-07-01 12:16:18 -07:00
chrislu
bee3a7c798 fix tests 2022-07-01 12:09:42 -07:00
Chris Lu
ddb0f6bc74
Merge pull request #3258 from kmlebedev/issues_3255 
volumeServer.evacuate fix select empty node
 2022-07-01 02:36:30 -07:00
Chris Lu
96c9d16c11
Merge pull request #3263 from kmlebedev/fix_pagination 
fix pagination
 2022-07-01 02:23:45 -07:00
Konstantin Lebedev
3d5f1cbc5e fix pagination 2022-07-01 14:17:49 +05:00
chrislu
06a8b174b5 also remove Sync() for idx file 2022-06-30 13:50:53 -07:00
chrislu
52580743b9 stuck with file.Sync() 
starting to get weed/storage () - (master) > go test ./...
I0630 12:19:54 65819 needle_map_metric_test.go:26] FileCount expected 10000 actual 10000
I0630 12:19:54 65819 needle_map_metric_test.go:27] DeletedSize expected 1648 actual 1648
I0630 12:19:54 65819 needle_map_metric_test.go:28] ContentSize expected 10000 actual 10000
I0630 12:19:54 65819 needle_map_metric_test.go:29] DeletedCount expected 1648 actual 1959
I0630 12:19:54 65819 needle_map_metric_test.go:30] MaxFileKey expected 10000 actual 10000
I0630 12:19:54 65819 volume_loading.go:136] loading index /var/folders/jv/0rlhdck17jzgt7b3hcnq63mc0000gp/T/TestCompaction909350722/001/1.idx to memory
I0630 12:20:36 65819 volume_vacuum.go:98] Committing volume 1 vacuuming...
panic: test timed out after 10m0s

goroutine 61 [running]:
testing.(*M).startAlarm.func1()
	/usr/local/go/src/testing/testing.go:2029 +0x8e
created by time.goFunc
	/usr/local/go/src/time/sleep.go:176 +0x32

goroutine 1 [chan receive, 10 minutes]:
testing.(*T).Run(0xc0000cd520, {0x1c09bde?, 0x5ab798ea5c102?}, 0x1c67bd8)
	/usr/local/go/src/testing/testing.go:1487 +0x37a
testing.runTests.func1(0xc0000cd520?)
	/usr/local/go/src/testing/testing.go:1839 +0x6e
testing.tRunner(0xc0000cd520, 0xc00039fcd8)
	/usr/local/go/src/testing/testing.go:1439 +0x102
testing.runTests(0xc0000dadc0?, {0x25b4460, 0x6, 0x6}, {0x2855108?, 0x40?, 0x25c4b80?})
	/usr/local/go/src/testing/testing.go:1837 +0x457
testing.(*M).Run(0xc0000dadc0)
	/usr/local/go/src/testing/testing.go:1719 +0x5d9
main.main()
	_testmain.go:57 +0x1aa

goroutine 21 [chan receive]:
github.com/chrislusf/seaweedfs/weed/glog.(*loggingT).flushDaemon(0x0?)
	/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/glog/glog.go:883 +0x6a
created by github.com/chrislusf/seaweedfs/weed/glog.init.0
	/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/glog/glog.go:410 +0x1bf

goroutine 55 [syscall]:
syscall.syscall(0x44ac0f96?, 0xc00007ad80?, 0xc00098b480?, 0x10588df?)
	/usr/local/go/src/runtime/sys_darwin.go:22 +0x4e
syscall.fcntl(0x100000001?, 0xc00098b4b0?, 0x1069a7c?)
	/usr/local/go/src/syscall/zsyscall_darwin_amd64.go:319 +0x30
internal/poll.(*FD).Fsync.func1(...)
	/usr/local/go/src/internal/poll/fd_fsync_darwin.go:18
internal/poll.ignoringEINTR(...)
	/usr/local/go/src/internal/poll/fd_posix.go:74
internal/poll.(*FD).Fsync(0xc00038f1e0?)
	/usr/local/go/src/internal/poll/fd_fsync_darwin.go:17 +0xfc
os.(*File).Sync(0xc00012a030)
	/usr/local/go/src/os/file_posix.go:168 +0x4e
github.com/chrislusf/seaweedfs/weed/storage/backend.(*DiskFile).Sync(...)
	/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/storage/backend/disk_file.go:84
github.com/chrislusf/seaweedfs/weed/storage.(*Volume).makeupDiff(0xc0000bb440, {0xc000633a40, 0x52}, {0xc000633aa0, 0x52}, {0xc000633b00, 0x52}, {0xc000633b60, 0x52})
	/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/storage/volume_vacuum.go:295 +0x12fa
github.com/chrislusf/seaweedfs/weed/storage.(*Volume).CommitCompact(0xc0000bb440)
	/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/storage/volume_vacuum.go:119 +0x3e8
github.com/chrislusf/seaweedfs/weed/storage.TestCompaction(0xc00025a000)
	/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/storage/volume_vacuum_test.go:89 +0x305
testing.tRunner(0xc00025a000, 0x1c67bd8)
	/usr/local/go/src/testing/testing.go:1439 +0x102
created by testing.(*T).Run
	/usr/local/go/src/testing/testing.go:1486 +0x35f

goroutine 56 [chan receive, 10 minutes]:
github.com/chrislusf/seaweedfs/weed/storage.(*Volume).startWorker.func1()
	/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/storage/volume_write.go:244 +0x41a
created by github.com/chrislusf/seaweedfs/weed/storage.(*Volume).startWorker
	/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/storage/volume_write.go:234 +0x56
FAIL	github.com/chrislusf/seaweedfs/weed/storage	600.194s
?   	github.com/chrislusf/seaweedfs/weed/storage/backend	[no test files]
ok  	github.com/chrislusf/seaweedfs/weed/storage/backend/memory_map	(cached)
?   	github.com/chrislusf/seaweedfs/weed/storage/backend/s3_backend	[no test files]
ok  	github.com/chrislusf/seaweedfs/weed/storage/erasure_coding	(cached)
?   	github.com/chrislusf/seaweedfs/weed/storage/idx	[no test files]
ok  	github.com/chrislusf/seaweedfs/weed/storage/needle	(cached)
ok  	github.com/chrislusf/seaweedfs/weed/storage/needle_map	(cached)
ok  	github.com/chrislusf/seaweedfs/weed/storage/super_block	(cached)
?   	github.com/chrislusf/seaweedfs/weed/storage/types	[no test files]
?   	github.com/chrislusf/seaweedfs/weed/storage/volume_info	[no test files]
FAIL
 2022-06-30 12:32:55 -07:00
Konstantin Lebedev
5ed8165161 fix logic 
add option targetServer
https://github.com/chrislusf/seaweedfs/issues/3255
 2022-06-30 17:58:24 +05:00
Chris Lu
413cb3d389
Merge pull request #3256 from shichanglin5/fix_keep_connected 
fixed `volume xx not found` caused by missing VolumeLocation events
 2022-06-30 00:10:09 -07:00
石昌林
200a862701 fixed volume xx not found caused by missing VolumeLocation events 
When the requested master node is the leader, `VolumeLocation` or `ClusterNodeUpdate` may be returned here. If it is `VolumeLocation`, the update will be performed while resetting the vidMap, otherwise the event will be lost
 2022-06-30 13:41:56 +08:00
chrislu
ffaa2163e0 Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-06-29 12:50:33 -07:00