mirror/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-11-27 04:39:25 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,837 Commits 32 Branches 296 Tags 148 MiB
39810a9951
Commit Graph

1464 Commits

Author SHA1 Message Date
Chris Lu
81f424a630 go fmt 2019-12-06 06:57:32 -08:00
Chris Lu
916423e96a master: submit support "dataCenter" parameter 2019-12-05 15:51:24 -08:00
Chris Lu
e426bd541e grow volumes on volume servers with slots freed by cloud storage 2019-12-03 21:36:42 -08:00
Chris Lu
7ae8b1cc86 show volume info in volume.list in weed shell 2019-12-02 23:38:56 -08:00
Chris Lu
1becbce657 display remote volumes on volume server ui page 2019-12-02 23:23:54 -08:00
Chris Lu
70648d35ad go fmt 2019-12-02 20:49:58 -08:00
Chris Lu
6383b45bd0 add lock variable 2019-12-02 20:49:50 -08:00
Chris Lu
caae543a9f fix test 2019-12-02 15:54:24 -08:00
Chris Lu
126fb492d2 fix test 2019-12-02 15:52:33 -08:00
Chris Lu
ec8de250e2 tiered storage: can copy to s3, read from s3 
master not aware tiered volume yet, file assigning is not working yet
 2019-12-02 15:08:31 -08:00
Chris Lu
228231f3d7 minor 2019-12-02 15:08:31 -08:00
zhangsong
e83c36e26f fix the bug of volume never be vacuumed 2019-12-02 13:25:32 +08:00
Chris Lu
0da7b894cc pass backend config from master to volume servers 2019-11-29 01:05:09 -08:00
Chris Lu
a9dbd52e06
Merge pull request #1145 from stlpmo-jn/volume_graceful_stop 
let volume server graceful stop
 2019-11-29 00:11:57 -08:00
stlpmo
ea9d1ebd2f resolve the Duration.Milliseconds() is not exist in golang v11 & v12 2019-11-29 15:17:17 +08:00
Chris Lu
ea9a7e61d0 only send metrics address during on the first response 2019-11-28 20:48:08 -08:00
Chris Lu
61bc1d6ffd tweaking 2019-11-28 18:47:51 -08:00
Chris Lu
09c6d8fa32 fix test 2019-11-28 18:44:27 -08:00
Chris Lu
f60154f330 master load backend storage config from master.toml 2019-11-28 18:33:18 -08:00
Chris Lu
641b92f53c fix scaffold error 2019-11-28 18:04:25 -08:00
Chris Lu
ee2072dff9 volume: avoid inifinite loop reading ec volume info if error happens 2019-11-27 23:07:53 -08:00
Chris Lu
0b822a6fb5
Merge pull request #1142 from iliul/wip-fuse-mount 
fuse: check mount point available before do runmount
 2019-11-27 19:22:51 -08:00
Lei Liu
13b6f09fea fuse: adjust linux specific logic 
Signed-off-by: Lei Liu <lei01.liu@horizon.ai>
 2019-11-28 10:21:31 +08:00
Chris Lu
586798ecc0 go fmt 2019-11-27 12:34:57 -08:00
Chris Lu
46294b42e6 filer: support memsql 
fix https://github.com/chrislusf/seaweedfs/issues/1141
 2019-11-27 12:34:03 -08:00
Lei Liu
1ba3456ac2
go fmt 
Signed-off-by: Lei Liu <liul.stone@gmail.com>
 2019-11-27 23:08:51 +08:00
Lei Liu
4c87b222f1
fuse: check mount point available before do runmount 
1. Use more readable mount point information
2. Fix some typos

eg:

$ df -Th
Filesystem              Type            Size  Used Avail Use% Mounted on
localhost:8888:/        fuse.seaweedfs  206G   512  206G   1% /mnt/weedfs

$ mount | grep weedfs
localhost:8888:/ on /mnt/weedfs type fuse.seaweedfs (rw,nodev,relatime,user_id=0,group_id=0,default_permissions,allow_other)

Signed-off-by: Lei Liu <lei01.liu@horizon.ai>
 2019-11-27 22:56:44 +08:00
Chris Lu
0f9ba84274 s3 2019-11-27 03:09:45 -08:00
Chris Lu
67e5f5b558 typo 2019-11-27 03:09:45 -08:00
Lei Liu
2700ac6d1f filer: Add attr.mode in query string 
Signed-off-by: Lei Liu <liul.stone@gmail.com>
 2019-11-27 13:57:29 +08:00
Chris Lu
5f6b360eb7 adjust error message 2019-11-24 23:13:40 -08:00
Chris Lu
2cbe79acda fix typo in command help 2019-11-24 22:17:43 -08:00
Chris Lu
0fca1ae776 adjust build 2019-11-22 23:19:49 -08:00
Chris Lu
bc6cd93431 skip build for 32 bit computers 2019-11-22 22:52:21 -08:00
Chris Lu
249b9d8d5d 1.45 2019-11-22 14:51:16 -08:00
Chris Lu
e4c63ff2f8 go fmt 2019-11-22 14:51:09 -08:00
Chris Lu
fb3c9ed80d shell: fs.meta.save missed directory data with more than 1024 entries 
fix https://github.com/chrislusf/seaweedfs/issues/1130
 2019-11-22 01:39:50 -08:00
divinerapier
5656d43264
can not break out of for-select block 
Signed-off-by: divinerapier <poriter.coco@gmail.com>
 2019-11-20 08:25:29 +08:00
Chris Lu
9711a6ffaa WIP 2019-11-18 19:24:37 -08:00
Chris Lu
ba73c053c3 change uuid package 
fix https://github.com/chrislusf/seaweedfs/issues/1126
 2019-11-18 19:24:37 -08:00
chenwanli
295f3beed5 rm ldb and bdb directory 2019-11-19 09:35:06 +08:00
stlpmo
753138a3f7 test passed 2019-11-17 11:40:36 +08:00
Chris Lu
de0c983808 refactoring scaffolding for master.toml 2019-11-14 22:20:38 -08:00
Chris Lu
c6e8225a20 adjust memory mapped file size 
related to https://github.com/chrislusf/seaweedfs/pull/1087
 2019-11-12 21:05:48 -08:00
Chris Lu
66acc2c84f passing in averageShardsPerEcNode instead of expectedTotalEcShards 
addressing https://github.com/chrislusf/seaweedfs/issues/1111
 2019-11-12 15:36:18 -08:00
Chris Lu
40514c5362 add sortEcNodesByFreeslotsDecending and sortEcNodesByFreeslotsAscending 
addressing https://github.com/chrislusf/seaweedfs/issues/1111
 2019-11-12 13:47:36 -08:00
Chris Lu
717ec47fa2 avoid double counting ec slot 
addressing issue found in https://github.com/chrislusf/seaweedfs/issues/1111

The ec slots are already counted on the server side.
 2019-11-12 09:33:51 -08:00
Lei Liu
46755ea1e1 fix master maintenance logic 
Signed-off-by: Lei Liu <lei01.liu@horizon.ai>
 2019-11-12 14:46:10 +08:00
Chris Lu
ee90236a97 Merge branch 'master' into refactoring_dat_backend 2019-11-11 21:30:14 -08:00
Chris Lu
d7852ebb3b
Merge pull request #1102 from stlpmo-jn/add_ETCD_sequencer 
Add etcd sequencer
 2019-11-11 12:43:24 -08:00
stlpmo
d07701fa75 delete unused function 2019-11-11 18:08:48 +08:00
stlpmo
62d393d6c9 ut pass 2019-11-11 10:52:21 +08:00
stlpmo
802a0eb3fe move from cmd-line to scaffold 2019-11-11 09:15:17 +08:00
Chris Lu
9c2f3b1b0f fix rack_not_found case 
fix rack_not_found in https://github.com/chrislusf/seaweedfs/issues/1111
 2019-11-10 12:06:41 -08:00
Chris Lu
e6ab75972f use constant 2019-11-10 12:05:58 -08:00
Chris Lu
471902cd51 change parameter name 2019-11-10 12:05:45 -08:00
zhangsong
61fa485700 add volume number param in assign operation 2019-11-10 20:11:03 +08:00
Chris Lu
85f8649320 refactor memory mapped file into backend storage 2019-11-09 00:10:59 -08:00
Chris Lu
c5c1d83d91 Merge branch 'master' into refactoring_dat_backend 2019-11-08 22:54:41 -08:00
Chris Lu
c34ffed43f go fmt 2019-11-08 22:47:50 -08:00
Chris Lu
84c503c6a7 adjust ec reading log level 2019-11-08 22:41:02 -08:00
Chris Lu
6cc9e0d788 volume: fix ec shard reading 
fix https://github.com/chrislusf/seaweedfs/issues/1106
 2019-11-08 22:41:02 -08:00
zhangsong
1dd101f782 use read lock to avoid io hang during heartbeat 2019-11-08 20:27:55 +08:00
stlpmo
1c8bed3810 delete the var etcdClient and comments 
refactor the code
add sequencer cmd-line
delete nerver used codes
 2019-11-05 15:45:25 +08:00
stlpmo
364f7200ad Create etcd_sequencer.go 
the 1st version
 2019-11-04 16:36:06 +08:00
Lei Liu
1294999d8b return error when garbageThreshold is not a valid float number 
Signed-off-by: Lei Liu <lei01.liu@horizon.ai>
 2019-10-31 20:43:20 +08:00
Lei Liu
1bcef02a6c fix dir/lookup and col/delete api 
1, Fix Layouts first letter capitalized
2, Return http 204 when delete a collection

Signed-off-by: Lei Liu <lei01.liu@horizon.ai>
 2019-10-31 16:55:45 +08:00
Lei Liu
f2f90436ef fix leader master /dir/lookup api 
Signed-off-by: Lei Liu <lei01.liu@horizon.ai>
 2019-10-30 16:38:40 +08:00
Chris Lu
db30a46050 skip memory mapped file when compacting 2019-10-29 23:34:38 -07:00
Chris Lu
5b950c735e Merge branch 'master' into refactoring_dat_backend 2019-10-29 23:18:41 -07:00
Chris Lu
57e441d67b fix compaction logic 2019-10-29 23:18:01 -07:00
Chris Lu
b7156291a8 adjust variable names 2019-10-29 23:16:43 -07:00
Chris Lu
4b5ba4927f adjust NewDiskFile() paramaters 2019-10-29 22:37:36 -07:00
Lei Liu
c2884cace2 misc updated 
Signed-off-by: Lei Liu <lei01.liu@horizon.ai>
 2019-10-29 21:28:28 +08:00
Chris Lu
cd7ce720c7 fix test 2019-10-29 00:37:15 -07:00
Chris Lu
19b6a16003 changed from os.file to backend.DataStorageBackend 2019-10-29 00:35:16 -07:00
Chris Lu
eb2172f63f FUSE: add os specific mount options 
related to https://github.com/chrislusf/seaweedfs/issues/1094
 2019-10-27 09:12:10 -07:00
Chris Lu
71eb8efd20 fix error logs 2019-10-25 09:44:58 -07:00
Chris Lu
55a2221eba master: add logging for volume server disconnection 
add logging for https://github.com/chrislusf/seaweedfs/issues/1093
 2019-10-25 09:35:19 -07:00
Chris Lu
69de05f6cb go fmt 2019-10-25 07:45:12 -07:00
Chris Lu
288c45a690 fix iitial filer url 2019-10-25 07:44:37 -07:00
Chris Lu
05fe7a2366
Merge pull request #1092 from binbinshi/master 
fix: weed shell filer config is constant
 2019-10-25 07:08:59 -07:00
shibinbin
fe1f469978 fix : change default filer.port to 8888 2019-10-25 17:39:29 +08:00
shibinbin
3464f21b5c fix: weed shell add filer runtime attributes 2019-10-25 17:34:03 +08:00
Chris Lu
7a51a9a582 refactor: simplifying to ReadAt() and WriteAt() 2019-10-25 00:11:25 -07:00
Chris Lu
46ed2ca902 refactoring 2019-10-24 23:41:32 -07:00
Chris Lu
9573c0f4b3 filer: filer.copy cleanup in case of failed uploads 2019-10-24 10:16:01 -07:00
Chris Lu
1b71608b3c
Merge pull request #1091 from divinerapier/fix/abused-404 
fix abused 404 status code
 2019-10-24 09:35:54 -07:00
Chris Lu
5d78871487 filer: parallize weed filer.copy for single file 2019-10-24 07:26:23 -07:00
divinerapier
f1ee6b7a54
fix abused 404 status code 
Signed-off-by: divinerapier <poriter.coco@gmail.com>
 2019-10-24 16:51:26 +08:00
Chris Lu
253dd20bc6 go fmt 2019-10-23 22:25:59 -07:00
Chris Lu
f937933b3d refactoring 2019-10-23 22:25:53 -07:00
Chris Lu
c358f96aaa volume: redirection follow public url 
fix https://github.com/chrislusf/seaweedfs/issues/1089
 2019-10-23 22:11:42 -07:00
Chris Lu
c0776aa40f trying to compile 2019-10-23 01:27:08 -07:00
Chris Lu
23240efa63 filer: add tikv support 2019-10-23 00:31:31 -07:00
Chris Lu
3c865ee39b fix missing needle header read 2019-10-22 00:57:47 -07:00
Chris Lu
c71fddee2b go fmt 2019-10-22 00:50:50 -07:00
Chris Lu
fc412e428b refactor ScanVolumeFileFrom() 2019-10-22 00:50:30 -07:00
Chris Lu
c9a183eb69 refactor memory map related code 2019-10-22 00:49:42 -07:00
Chris Lu
fec07c829d go fmt 2019-10-21 23:03:48 -07:00