Chris Lu
b4c276263f
weed filer: mysql/postgres use ReadCommitted transaction isolation level for atomic rename
2019-04-01 11:03:04 -07:00
Chris Lu
c5a3ff1c35
weed s3: multipart upload goes to the right bucket
...
fix https://github.com/chrislusf/seaweedfs/issues/908
2019-03-31 11:10:19 -07:00
Chris Lu
189c890715
weed replicate: replicate atomic rename to other systems
2019-03-31 08:10:47 -07:00
Chris Lu
8c823abe1f
1.28
2019-03-30 23:22:41 -07:00
Chris Lu
78ac2bef3c
go fmt
2019-03-30 23:09:16 -07:00
Chris Lu
97406333a5
support atomic renaming for mysql/postgres filer store
2019-03-30 23:08:29 -07:00
Chris Lu
920b4e56aa
refactoring
2019-03-29 22:53:35 -07:00
Chris Lu
f60d383947
weed filer.copy: support multiple masters
2019-03-29 22:50:14 -07:00
Chris Lu
487ca51491
weed filer.export: fix pagination error
2019-03-28 00:46:15 -07:00
Chris Lu
07775998a9
some comments
2019-03-28 00:38:30 -07:00
Chris Lu
53b81fcfcd
weed shell: add fs.tree
2019-03-28 00:05:04 -07:00
Chris Lu
c7e7b6229f
detect mime type
2019-03-27 14:25:18 -07:00
Chris Lu
65757ae2fd
weed filer: set content-type consistent with filer store
2019-03-27 11:41:11 -07:00
Chris Lu
37ce4c5269
weed shell: add fs.ls
2019-03-26 12:43:51 -07:00
Chris Lu
7a14cdc90c
refactoring, go fmt
2019-03-25 23:18:40 -07:00
Chris Lu
19728fe3f6
remove deprecated code
2019-03-25 23:12:14 -07:00
Chris Lu
df95ce0b6c
weed backup: efficient delta backup
...
fix https://github.com/chrislusf/seaweedfs/issues/399
2019-03-25 23:01:53 -07:00
Chris Lu
c913583e2d
Merge branch 'master' into add_volume_follow
2019-03-25 21:19:34 -07:00
Chris Lu
91b9a68493
udpate glide
2019-03-25 09:39:54 -07:00
Chris Lu
a32797518b
weed master: redirect to leader for default admin UI
...
fix https://github.com/chrislusf/seaweedfs/issues/898
2019-03-25 09:20:05 -07:00
Chris Lu
70815e9124
WIP
2019-03-25 09:16:12 -07:00
Chris Lu
eaa42c3865
1.27
2019-03-23 14:14:40 -07:00
Chris Lu
cd8a3b99bb
textual changes
2019-03-23 12:57:35 -07:00
Chris Lu
bd1c0735e0
weed shell: adjust help text format
2019-03-23 11:54:26 -07:00
Chris Lu
6b70b36105
weed shell: add "volume.fix.replication"
2019-03-23 11:34:09 -07:00
Chris Lu
95e0520182
weed volume: add grpc operation to relicate a volume to local
2019-03-23 11:33:34 -07:00
Chris Lu
a3490b600c
weed filer, weed master: add option to disable http
2019-03-21 16:00:46 -07:00
Chris Lu
531add52c2
weed master: skip proxied file read in http read only mode
2019-03-21 09:49:04 -07:00
Jonathan Amsterdam
e966033098
Merge branch 'master' of https://github.com/chrislusf/seaweedfs into gocdk
2019-03-20 16:02:38 -04:00
Chris Lu
977b30e992
weed filer: http HEAD response header add ETag
...
fix https://github.com/chrislusf/seaweedfs/issues/892
2019-03-20 10:13:53 -07:00
Jonathan Amsterdam
8db82e2b75
notification: add Go CDK pubsub support
...
Add the gocdk_pub_sub package, which supports the Go Cloud Development
Kit pubsub API.
Link in all current providers.
Update the notification scaffold.
2019-03-20 07:57:58 -04:00
chenwanli
45a52b17fd
benchmark: add replication flag
2019-03-20 16:38:11 +08:00
Chris Lu
88ab932f7d
refactoring function parameter
2019-03-19 23:01:23 -07:00
Chris Lu
5ae4b963a4
avoid using global rand
2019-03-19 22:20:14 -07:00
Chris Lu
f3d316a846
weed shell: adding file system disk usage fs.du
...
fix https://github.com/chrislusf/seaweedfs/issues/889
echo "fs.du http://localhost:8888/some/path " | weed shell
2019-03-19 21:58:00 -07:00
Chris Lu
cea5c53bf7
fix length checking
...
fix https://github.com/chrislusf/seaweedfs/issues/890
2019-03-19 20:56:27 -07:00
Chris Lu
da871896c3
weed filer: set grpc port to port + 10000
2019-03-19 05:47:41 -07:00
Chris Lu
916b809c08
add error checking
2019-03-19 05:34:43 -07:00
Chris Lu
eb4a54d9fe
refactoring
2019-03-19 05:19:37 -07:00
Chris Lu
ece9d13312
volume info collect compact revision number
2019-03-18 09:32:21 -07:00
Chris Lu
104922a3db
text wrapping
2019-03-18 00:35:15 -07:00
Chris Lu
44647a46c0
needle scanner read appendAtNs
2019-03-17 23:28:43 -07:00
Chris Lu
8b26d15740
refactoring: simplify function parameter
2019-03-17 22:32:01 -07:00
Chris Lu
2fcc88116e
go fmt
2019-03-17 20:27:36 -07:00
Chris Lu
aca653c08b
weed shell: list volumes
2019-03-17 20:27:08 -07:00
Chris Lu
22fbbf023b
adjust collection list output
2019-03-17 17:31:05 -07:00
Chris Lu
e48267e287
adjust output
2019-03-17 17:28:29 -07:00
Chris Lu
657dd2e6c9
add shell command to list all collections
2019-03-16 13:43:16 -07:00
Chris Lu
b92122b885
fix test
2019-03-16 09:50:57 -07:00
Chris Lu
36b632ebcb
fix tests
2019-03-16 09:50:21 -07:00
Chris Lu
42cb05c088
add context.Context
2019-03-15 17:23:02 -07:00
Chris Lu
55bab1b456
add context.Context
2019-03-15 17:20:24 -07:00
Chris Lu
cece860bfd
add context to all filer APIs
2019-03-15 15:55:34 -07:00
Chris Lu
55c85f3a66
adding context
2019-03-15 15:26:09 -07:00
Chris Lu
d30600e6d6
fix filer starting under "weed server" when ip is not localhost
...
fix https://github.com/chrislusf/seaweedfs/issues/886
2019-03-15 09:57:33 -07:00
Chris Lu
a4e8aa98a0
weed server: mkdir first, and set the master ip address
...
fix https://github.com/chrislusf/seaweedfs/issues/885
2019-03-15 00:32:42 -07:00
Chris Lu
95ef4513c8
print out memory size
2019-03-13 23:14:40 -07:00
Chris Lu
346541a101
print out per entry memory usage
2019-03-13 23:07:24 -07:00
Chris Lu
99ce10daeb
Merge branch 'master' of https://github.com/chrislusf/seaweedfs
2019-03-11 00:58:17 -07:00
Chris Lu
2ce4dae795
move to 1.26
2019-03-11 00:58:12 -07:00
chenwanli
c668e55e07
Revert "fix https://github.com/chrislusf/seaweedfs/issues/780 "
...
This reverts commit 31038acccf
.
2019-03-11 11:48:11 +08:00
Chris Lu
6fe071175d
mount: add option to disable allow others
...
fix https://github.com/chrislusf/seaweedfs/issues/877
2019-03-10 19:45:40 -07:00
Chris Lu
ad08a52ab6
synchronously upload files
...
fix https://github.com/chrislusf/seaweedfs/issues/807
2019-03-09 13:24:22 -08:00
Chris Lu
4773497d2c
add back "/cluster/status"
...
fix https://github.com/chrislusf/seaweedfs/issues/870
2019-03-06 12:10:45 -08:00
Chris Lu
ab32556a51
weed server: fix error coming from moving raft to grpc
...
fix https://github.com/chrislusf/seaweedfs/issues/872
2019-03-06 10:21:49 -08:00
Chris Lu
0898e6c38e
Merge branch 'master' of https://github.com/chrislusf/seaweedfs
2019-03-04 13:00:10 -08:00
Chris Lu
d312c55bbe
file path supports windows, avoiding back slashes
...
fix https://github.com/chrislusf/seaweedfs/issues/868
2019-03-04 13:00:08 -08:00
Chris Lu
f9dcf56465
adjust log level for loading configurations
2019-03-04 09:02:58 -08:00
chenwanli
f233bbe9c0
Fix https://github.com/chrislusf/seaweedfs/issues/825#issuecomment-469097375
2019-03-04 12:43:43 +08:00
Chris Lu
219b651bc3
jwt check the base file id
...
fix https://github.com/chrislusf/seaweedfs/issues/867
2019-03-03 10:17:44 -08:00
Chris Lu
2812c14520
master: add option to disable http operations
2019-03-02 05:10:05 -08:00
chenwanli
900aad4935
Fix https://github.com/chrislusf/seaweedfs/issues/864
2019-02-28 11:37:44 +08:00
Chris Lu
cb07d15254
add namespace for s3
2019-02-27 00:21:37 -08:00
Chris Lu
70ac2f6ea8
add namespace for ListAllMyBucketsResult
2019-02-26 23:23:04 -08:00
chenwanli
fd27ed7755
Fix https://github.com/chrislusf/seaweedfs/issues/861
2019-02-26 17:12:39 +08:00
Chris Lu
344caf3cd7
1.25
2019-02-25 00:44:48 -08:00
Chris Lu
7bbe24dd28
volume server directly support https
2019-02-25 00:43:36 -08:00
Chris Lu
c892b898a1
Merge branch 'master' of https://github.com/chrislusf/seaweedfs
2019-02-25 00:34:25 -08:00
Chris Lu
0d84e32f56
update library versions
2019-02-25 00:34:21 -08:00
chenwanli
0bc3cdd26a
Fix https://github.com/chrislusf/seaweedfs/issues/825
2019-02-25 10:47:41 +08:00
Chris Lu
0a106c1757
updated glide
2019-02-20 09:09:47 -08:00
Chris Lu
e108688990
avoid grpc 5 seconds timeout
...
some operations may take longer than 5 seconds.
only keep the timeout for raft operations
2019-02-20 01:01:01 -08:00
Chris Lu
0fa1be8c4b
adjust formatting and comments
2019-02-19 21:10:10 -08:00
Chris Lu
72c2e6bb8f
remove unused file
2019-02-19 14:16:19 -08:00
Chris Lu
07af52cb6f
raft change from http to grpc
...
master grpc port is fixed to http port + 10000
2019-02-18 22:38:14 -08:00
Chris Lu
448645203a
remove unused variables
2019-02-18 20:05:55 -08:00
Chris Lu
d37c3ab7a5
adjust error message
2019-02-18 18:03:27 -08:00
Chris Lu
2442d56671
adjust package name
2019-02-18 18:03:16 -08:00
Chris Lu
9a4dda3011
Merge pull request #855 from chrislusf/add_jwt
...
Add jwt
2019-02-18 15:05:32 -08:00
Chris Lu
a1c7dc3806
avoid changing attributes for mount directory
2019-02-18 12:14:28 -08:00
Chris Lu
77b9af531d
adding grpc mutual tls
2019-02-18 12:11:52 -08:00
Chris Lu
55761ae806
skip nil options
2019-02-16 12:49:58 -08:00
Chris Lu
98a03b38e5
avoid util package depends on security package
2019-02-16 12:23:35 -08:00
Chris Lu
31aa60ce05
Merge branch 'master' into add_jwt
2019-02-16 08:55:38 -08:00
Chris Lu
ad257ae179
simplify isLeader() logic
2019-02-16 08:55:23 -08:00
Chris Lu
712a0e19c8
Merge branch 'master' into add_jwt
2019-02-15 10:01:16 -08:00
Chris Lu
2ec6a679c2
avoid "fchmod failed" during cp
2019-02-15 10:00:27 -08:00
Chris Lu
157c0f7c01
add jwt for writes
2019-02-15 09:59:22 -08:00
Chris Lu
7103c1ab7e
go fmt
2019-02-15 00:09:48 -08:00
Chris Lu
74fb237727
benchmark can work in secure mode
2019-02-15 00:09:19 -08:00
Chris Lu
a3b0e39b06
weed mount deletion always goes to weed filer
2019-02-14 07:07:38 -08:00
Chris Lu
215cd27b37
add authorizing fileId write access
...
need to secure upload/update/delete for benchmark/filer/mount
need to add secure grpc
2019-02-14 00:08:20 -08:00
Chris Lu
4ff4a147b2
cleanup security.Secret
2019-02-09 21:56:32 -08:00
Chris Lu
501bd72b1c
wip: add security.toml file
2019-02-09 21:07:12 -08:00
Chris Lu
729d71fd4c
Merge branch 'master' of https://github.com/chrislusf/seaweedfs
2019-02-09 12:52:12 -08:00
Chris Lu
8afc632484
raft: use the first master to bootstrap the election
2019-02-09 12:52:09 -08:00
Chris Lu
744abc2690
log raft state changes
2019-02-09 12:51:14 -08:00
Sergey
aa5ccff6d2
fixing of typos
2019-02-06 18:59:15 +05:00
Chris Lu
1334507595
Revert "randomize based on self address"
...
This reverts commit 6230eb28a6
.
2019-01-28 12:12:51 -08:00
Chris Lu
6230eb28a6
randomize based on self address
...
fix #851
2019-01-28 11:55:33 -08:00
Chris Lu
221105eea3
Revert "use the first entry to bootstrap master cluster"
...
This reverts commit 40c8725ffa
.
2019-01-28 11:46:46 -08:00
Chris Lu
7a493bbefa
better way to detect a master isLeader
2019-01-28 10:36:16 -08:00
Chris Lu
40c8725ffa
use the first entry to bootstrap master cluster
...
fix https://github.com/chrislusf/seaweedfs/issues/851
2019-01-28 10:35:28 -08:00
Chris Lu
adcfe66034
1.24
2019-01-26 00:15:50 -06:00
Chris Lu
834f414af9
add a timeout
2019-01-26 00:15:42 -06:00
Chris Lu
09471b46f9
fix related tests
2019-01-26 00:10:29 -06:00
Chris Lu
5668ed798d
memory needle map mark size to be TombstoneFileSize
...
fix https://github.com/chrislusf/seaweedfs/issues/850
2019-01-26 00:05:44 -06:00
Chris Lu
d3f675abc6
Merge branch 'master' of https://github.com/chrislusf/seaweedfs
2019-01-24 22:39:41 -08:00
Chris Lu
e70f740deb
set file attributes
...
fix https://github.com/chrislusf/seaweedfs/issues/847
2019-01-24 19:38:04 -08:00
bingoohuang
cf0fc797ac
use tempFile.Truncate to reset file size to speedup test
2019-01-23 16:24:51 +08:00
Chris Lu
3f56b12ed4
raft: adding idle connection time out
...
another attempt to fix https://github.com/chrislusf/seaweedfs/issues/825
2019-01-22 09:25:25 -08:00
chenwanli
f47f8be912
Fix block-waiting for leader when there are no volumes
2019-01-22 15:58:37 +08:00
Chris Lu
8ec57e18c7
1.23
2019-01-18 14:27:34 -08:00
Chris Lu
a6bffc58f9
go fmt
2019-01-18 14:15:10 -08:00
Chris Lu
67e2ea72be
master add separate grpc port
...
due to https://github.com/soheilhy/cmux/issues/64
fix https://github.com/chrislusf/seaweedfs/issues/820
fix https://github.com/chrislusf/seaweedfs/issues/840
fix https://github.com/chrislusf/seaweedfs/issues/841
2019-01-18 14:14:47 -08:00
Chris Lu
dfae0f4e9d
1.22
2019-01-18 00:25:20 -08:00
Chris Lu
e84dcb0bfe
fix timeout issue, but can not reproduce with local built binaries
...
fix https://github.com/chrislusf/seaweedfs/issues/841
2019-01-18 00:24:40 -08:00
Chris Lu
1d103e3ed5
timeout http connections
...
possible fix for https://github.com/chrislusf/seaweedfs/issues/825
2019-01-17 23:38:33 -08:00
Chris Lu
b881e11a16
1.21
2019-01-16 20:44:38 -08:00
bingoohuang
ab6be025d7
go fmt and fix some typo
2019-01-17 09:17:19 +08:00
bingoohuang
6ddfaf33cb
extract VolumeFileScanner for ScanVolumeFile
2019-01-16 17:48:59 +08:00
bingoohuang
27093bc2e5
fix needle Append return offset to avoid uint32 overflow
2019-01-16 16:48:03 +08:00
bingoohuang
219838db87
fail fast when failed to write local volume
2019-01-15 15:47:43 +08:00
Chris Lu
2ff95ead57
Merge pull request #832 from PapaYofen/fix-830
...
Fix https://github.com/chrislusf/seaweedfs/issues/830
2019-01-12 17:26:51 -08:00
chenwanli
b71d6f4b88
Fix https://github.com/chrislusf/seaweedfs/issues/830
2019-01-12 10:07:19 +08:00
chenwanli
80cf99db1b
Set rpc dial timeout to 5s
2019-01-11 18:23:31 +08:00
Chris Lu
8613e4f558
Merge pull request #827 from suilongfei/master
...
change log_dir to logdir for the "flag redefined:log_dir" error when use another package with "github.com/golang/glog"
2019-01-10 09:10:07 -08:00
Chris Lu
2d23d86fd3
no timeout for volume vacuum
...
revert changes on volume vacuum timemout from https://github.com/chrislusf/seaweedfs/pull/829
2019-01-10 09:07:40 -08:00
chenwanli
39c7455881
Set http timeout to 5s
2019-01-10 20:21:08 +08:00
chenwanli
0a3e83a36a
Set timeout for master and volume non-streaming rpc
2019-01-10 19:41:03 +08:00
隋龙飞@视频结构化
b864cf7e07
change log_dir flag to logdir
...
change log_dir flag to logdir
2019-01-10 17:17:32 +08:00
隋龙飞@视频结构化
ea4f29d1e7
change log_dir flag to logdir
...
change log_dir flag to logdir
2019-01-10 17:16:58 +08:00
Chris Lu
2a75a36b27
set cassandra ttl with entry.TTLSec
2019-01-08 20:26:19 -08:00
byungjo.yoon
58fd2e5a19
Set redis key ttl with entry.TTLSec
2019-01-09 11:48:19 +09:00
Chris Lu
badd8fdf8f
shortcut for empty file
2019-01-08 09:03:28 -08:00
chenwanli
41fe31b5d0
Speed up heartbeat to new master leader
2019-01-07 16:09:15 +08:00
Chris Lu
e768e64fbc
1.20
2019-01-06 10:52:26 -08:00
Chris Lu
bd32108a90
disable async file deletion
2019-01-05 22:51:50 -08:00
Chris Lu
be9a7592a1
incrementally calculate visible intervals
2019-01-05 22:23:44 -08:00
Chris Lu
6b5d6bb5a6
adjust error names
2019-01-05 19:52:38 -08:00
Chris Lu
9383c91eb1
wait to read again if the volume is compacting
2019-01-05 19:52:17 -08:00
Chris Lu
fe50224ea0
refactoring
2019-01-05 15:21:56 -08:00
Chris Lu
6740427638
weed mount: reduce default chunk size
2019-01-05 15:17:03 -08:00
Chris Lu
d9f9aca453
refactoring
2019-01-05 15:16:39 -08:00
Chris Lu
251b596bc5
increase batch deletion size to 1024
2019-01-03 22:21:57 -08:00
Chris Lu
aac11fb832
reduce directory list cache usage
2019-01-03 22:21:39 -08:00
Chris Lu
7f74577db1
add Last-Modified to HEAD requests
...
to work better with restic
2019-01-02 14:23:25 -08:00
Chris Lu
ceafb7d145
1.19
2019-01-02 12:59:20 -08:00
Chris Lu
28a41fda3e
assign new file id even on filer PUT operations
2019-01-02 12:58:26 -08:00
Chris Lu
d67f7ddfaf
adjust log
2019-01-02 12:58:06 -08:00
Chris Lu
e49a38842a
set etag in response
2019-01-02 12:57:54 -08:00
Chris Lu
d5ebfd5b0c
fix s3cmd put
...
1. fix volume put data size
2019-01-02 12:57:33 -08:00
Chris Lu
3339325334
fix s3 ListAllMyBucketsResult to work with s3cmd
2019-01-02 11:36:29 -08:00
Chris Lu
43db7ac123
fix spelling
2019-01-02 02:38:32 -08:00
Chris Lu
9539823c35
fix log
2019-01-01 03:04:44 -08:00
Chris Lu
525db94d9a
async file chunk deletion
2019-01-01 02:33:57 -08:00
Chris Lu
ffb5d3f93a
get bytes from sync pool
2019-01-01 02:14:40 -08:00
Chris Lu
832ac8129a
reduce pointer usage
2018-12-31 15:10:14 -08:00
Chris Lu
1478d7ea21
reduce file seek when writing
2018-12-31 15:08:32 -08:00
Chris Lu
81904ad336
debugging: track all memory allocations
2018-12-31 14:54:13 -08:00
Chris Lu
03cfb4267f
adjust vaccum logging
2018-12-31 00:06:52 -08:00
Chris Lu
d6181076bb
FUSE remove adjust error
2018-12-30 22:29:27 -08:00
Chris Lu
16e8610426
1.18
2018-12-30 00:52:20 -08:00
Chris Lu
0388d421d2
caching visible intervals for read
...
speeds up 4x in single thread mode
speeds up 30% in 32 threads mode
2018-12-30 00:51:44 -08:00
Chris Lu
55f7d8f801
remove extra log
2018-12-29 18:00:19 -08:00
Chris Lu
170ed53da5
weed mount: mac add AutoXattr
2018-12-29 13:55:38 -08:00
Chris Lu
d8c7844d2e
1.17
2018-12-29 13:16:38 -08:00
Chris Lu
9f3836072a
weed mount: no mac finder broswe mode
2018-12-29 13:16:23 -08:00
Chris Lu
d7bf6c5b91
switching_to_seaweedfs_fuse
2018-12-29 10:31:36 -08:00
Chris Lu
0c932d1738
add volume delete grpc API
...
fix https://github.com/chrislusf/seaweedfs/issues/808
2018-12-29 00:03:30 -08:00
Chris Lu
03c7447ad6
set mount point to existing permissions
...
fix https://github.com/chrislusf/seaweedfs/issues/806
2018-12-28 23:36:13 -08:00
Chris Lu
a8af1e3f5f
set attributes include crtime
2018-12-28 22:37:18 -08:00
Chris Lu
ba9b7b62d7
1.16
2018-12-28 15:10:49 -08:00
Chris Lu
79168ab0bb
adjust error and log
2018-12-28 15:10:23 -08:00
Chris Lu
308ac1d0d2
reuse buffer by sync pool
2018-12-28 03:27:48 -08:00
Chris Lu
260b038441
fix url
2018-12-27 14:43:36 -08:00
Chris Lu
2a19511ba8
avoid gzip benchmark data
...
related to https://github.com/chrislusf/seaweedfs/issues/804
2018-12-27 13:10:46 -08:00
Chris Lu
d3660ffce8
avoid gzipping files without file extensions
...
fix https://github.com/chrislusf/seaweedfs/issues/804
2018-12-27 12:17:05 -08:00
Chris Lu
253f190f48
weed mount add symlink support
2018-12-25 22:45:44 -08:00
Chris Lu
9eb2bee86a
avoid error log if not found
2018-12-24 17:45:26 -08:00
Chris Lu
ba923e2864
error if the last arguement does not end with forward slash
2018-12-23 18:20:11 -08:00
Chris Lu
332668a3fd
1.15
2018-12-23 12:54:41 -08:00
Chris Lu
c043fd17cb
detect more gzippable content
2018-12-22 15:05:31 -08:00
Chris Lu
49f40cd145
adjust help message
2018-12-22 15:05:15 -08:00
Chris Lu
852ee21835
avoid .gz auto decompression
2018-12-22 13:58:16 -08:00
Chris Lu
be946c9e54
filer store original data size instead of data size after gzip
2018-12-22 13:11:07 -08:00
Chris Lu
141d302492
fix binarySearchCompactSection
2018-12-22 11:52:58 -08:00
Chris Lu
d3839fe279
go fmt
2018-12-22 11:11:57 -08:00
Chris Lu
5333f2984a
streaming updates for large entries or large index file
...
fix https://github.com/chrislusf/seaweedfs/issues/801
2018-12-22 11:10:08 -08:00
Chris Lu
36d13355bb
compact map fix bug when iterating
2018-12-22 11:05:29 -08:00