mirror/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-12-19 05:27:50 +08:00
Code Issues Packages Projects Releases Wiki Activity
11,194 Commits 32 Branches 296 Tags 152 MiB
c531e2eb0e
Commit Graph

889 Commits

Author SHA1 Message Date
coffeecloudgit
c531e2eb0e
Update disk_location_ec.go (#6359) 
Add lock for l.ecVolumes
 2024-12-15 22:05:47 -08:00
coffeecloudgit
7eb8257126
Update store.go (#6358) 
Add lock for location.ecVolumes And single delete
 2024-12-15 22:05:22 -08:00
Konstantin Lebedev
ff1392f7f4
[shell] use constant for hdd of type (#6337) 
use constant for hdd of type
 2024-12-10 08:43:59 -08:00
chrislu
f3dde99796 adjust error message 2024-12-05 09:33:50 -08:00
Trim21
fd6c787c02
fix EcVolumes sorting in volume UI (#6275) 
* Update store_ec.go

* fix: EcVolume sorting not work

* use stdlib

* revert
 2024-11-23 22:43:08 -08:00
chrislu
75f5afa571 fix compilation 2024-11-21 00:41:22 -08:00
chrislu
1c143cfcea display actual offset value 2024-11-21 00:38:03 -08:00
chrislu
c9f3448692 ReadAt may return io.EOF t end of file 
related to https://github.com/seaweedfs/seaweedfs/issues/6219
 2024-11-21 00:37:38 -08:00
chrislu
be09d08eb6 adjust error message 2024-11-20 23:49:01 -08:00
chrislu
96f1a2e01a adjust error message 2024-11-19 14:16:06 -08:00
Lisandro Pin
f2db746690
Introduce logic to resolve volume replica placement within EC rebalancing. (#6254) 
* Rename `command_ec_encode_test.go` to `command_ec_common_test.go`.

All tests defined in this file are now for `command_ec_common.go`.

* Minor code cleanups.

- Fix broken `ec.balance` test.
- Rework integer ceiling division to not use floats, which can introduce precision errors.

* Introduce logic to resolve volume replica placement within EC rebalancing.

This will be used to make rebalancing logic topology-aware.

* Give shell.EcNode.dc a dedicated DataCenterId type.
 2024-11-18 18:05:06 -08:00
Kevin Bulteel
4a0dc883cf
Fix/parse upload filename (#6241) 
* fix: parse filename in PUT + refactor

* fix: master iu public url with http

* fix: better parsing and handle disposition header

* fix: take mime type from file extension if not set
 2024-11-15 11:25:18 -08:00
Eugeniy E. Mikhailov
3003c9e17e
added backward compatible CRC check and extra explanatory comments (#6233) 2024-11-12 13:56:14 -08:00
chrislu
9873b033d1 backward compatible vif loading 2024-10-28 19:44:30 -07:00
chrislu
ae5bd0667a rename proto field from DestroyTime to expire_at_sec 
For TTL volume converted into EC volume, this change may leave the volumes staying.
 2024-10-24 21:35:11 -07:00
chrislu
d38456dc06 do not delete collection metrics when unmount a volume 
fix https://github.com/seaweedfs/seaweedfs/issues/6139
 2024-10-22 00:44:52 -07:00
dsd
1e13b6879c
fix(volume): to avoid duplicate write a same needle (#6138) 
fix WriteNeedleBlob to avoid duplicate write a same needle

Co-authored-by: 邓书东 <shudong_deng@hhnb2024010108.intsig.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
 2024-10-18 01:20:50 -07:00
chrislu
f11567816e Revert "fix: volume data integrity check (#6118)" 
This reverts commit e12b9ab746.
 2024-10-17 18:52:30 -07:00
wusong
e12b9ab746
fix: volume data integrity check (#6118) 
Co-authored-by: wang wusong <wangwusong@virtaitech.com>
 2024-10-14 12:17:41 -07:00
chrislu
7dd480acad handle missing leading zero padding in replica 2024-10-01 10:16:21 -07:00
LHHDZ
4dc33cc143
fix unclaimed spaces calculation when volumePreallocate is enabled (#6063) 
the calculation of `unclaimedSpaces` only needs to subtract `unusedSpace` when `preallocate` is not enabled.

Signed-off-by: LHHDZ <shichanglin5@qq.com>
 2024-09-24 23:04:18 -07:00
Max Denushev
d056c0ddf2
fix(volume): don't persist RO state in specific cases (#6058) 
* fix(volume): don't persist RO state in specific cases

* fix(volume): writable always persist
 2024-09-24 16:15:54 -07:00
chrislu
4ec6eab004 fix max volume count auto setting 
related to https://github.com/seaweedfs/seaweedfs/issues/6041#issuecomment-2360448182
 2024-09-19 09:13:08 -07:00
Konstantin Lebedev
6d4f5c94ac
[volume] remove truncate idx file if size not healthy (#6043) 2024-09-19 01:04:08 -07:00
Eugeniy E. Mikhailov
bc01f09e37
Do CRC check if the buffer contains the full needle data before it is sent (#5980) 2024-09-05 17:14:55 -07:00
Bruce
f9e141a412
persist readonly state to volume info (#5977) 2024-09-05 07:58:24 -07:00
Bruce
310d41998d
Skip volume data integrity check for volume which has remote file (#5976) 2024-09-04 21:25:04 -07:00
chrislu
8e4bffc66b copy ec shards to disks already having ec volumes 
fix https://github.com/seaweedfs/seaweedfs/issues/5615
 2024-09-03 21:19:10 -07:00
wyang
361e7ebc74
fix volume.move io.EOF (#5960) 2024-09-02 06:17:41 -07:00
Eugeniy E. Mikhailov
220061573d
update metric for ErrorCRC if it happens during volume readNeedleDataInto (#5957) 2024-09-01 20:30:09 -07:00
chrislu
5535b60e8c fix replication range check 
fix for https://github.com/seaweedfs/seaweedfs/wiki/Replication#replication-string
 2024-08-21 16:58:43 -07:00
chrislu
e8462ba3ad prevent compacting on the same volume 2024-08-18 12:08:43 -07:00
augustazz
0b00706454
EC volume supports expiration and displays expiration message when executing volume.list (#5895) 
* ec volume expire

* volume.list show DestroyTime

* comments

* code optimization

---------

Co-authored-by: xuwenfeng <xuwenfeng1@zto.com>
 2024-08-16 00:20:00 -07:00
chrislu
fdf7193ae7 rename 2024-08-13 13:59:24 -07:00
chrislu
07f4998188 add dat file size into vif for EC 2024-08-13 13:56:00 -07:00
chrislu
3a2e21fee7 fix EC reading on nLargeBlockRows 
fix https://github.com/seaweedfs/seaweedfs/issues/5465
 2024-08-13 12:01:46 -07:00
Dan
bd54669d58
Detect underflow when calculating unused space (#5758) 
* Detect underflow when calculating unused space

* Detect underflow when calculating unused space
 2024-07-10 00:30:28 -07:00
Konstantin Lebedev
5ffacbb6ea
refactor all methods strings to const (#5726) 2024-07-01 01:00:39 -07:00
Taehyung Lim
4d0bf6ddd4
fixed fail to initialize existing ec volume when volume server has separate index dictory (#5723) 2024-06-28 13:04:51 -07:00
NyaMisty
f2a37933b1
Fix sorted needle file's write mode for (*SortedFileNeedleMap).Delete() (#5633) 2024-06-02 14:12:25 -07:00
Konstantin Lebedev
d389c5b27e
fix: recreate index include deleted files (#5579) 
* fix: recreate index include deleted files
https://github.com/seaweedfs/seaweedfs/issues/5508

* fix: counting the number of files

* fix: log
 2024-05-12 11:31:34 -07:00
Konstantin Lebedev
6f9267ebdf
fix: skip file size checking for volume with TTL (#5541) 
fix: skip file size checking for volume with tll
https://github.com/seaweedfs/seaweedfs/issues/5508
 2024-04-28 00:21:57 -07:00
Kevin Bulteel
a3dab1fcd0
feat: upload files directly without multipart/form-data (#5539) 2024-04-26 16:03:40 -07:00
steve.wei
0bdf121e51
rename VolumeServerVolumeGauge (#5504) 2024-04-17 04:49:50 -07:00
Konstantin Lebedev
5189a09de0
[volume] Reduce the number of buffers for uploading one chunk (#5458) 2024-04-11 04:47:21 -07:00
Henco Appel
2a88da4de7
fix: always close volume file (#4530) (#5459) 
If sync fails then close is never called. We should always be calling
close on the file.

Co-authored-by: Hendrik Appel <happel@europe.altair.com>
 2024-04-02 08:31:40 -07:00
chrislu
a1816d21e9 fix compilation 2024-03-19 09:09:14 -07:00
dependabot[bot]
359b00596f
chore(deps): bump github.com/rclone/rclone from 1.65.2 to 1.66.0 (#5387) 
* chore(deps): bump github.com/rclone/rclone from 1.65.2 to 1.66.0

Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone) from 1.65.2 to 1.66.0.
- [Release notes](https://github.com/rclone/rclone/releases)
- [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md)
- [Commits](https://github.com/rclone/rclone/compare/v1.65.2...v1.66.0)

---
updated-dependencies:
- dependency-name: github.com/rclone/rclone
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* Fix compilation error with rclone update (#5395)

Fix compilation error

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Damiano Albani <damiano.albani@gmail.com>
 2024-03-18 17:09:59 -07:00
chrislu
1efa502dbb go fmt 2024-03-12 09:17:20 -07:00
rustrover
ab70aa92da
remove repetitive words (#5364) 2024-03-09 07:35:47 -08:00