mirror/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-12-25 18:27:54 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,024 Commits 32 Branches 296 Tags 153 MiB
59017da4f2
Commit Graph

194 Commits

Author SHA1 Message Date
chrislusf
ba972694c7 Add filer option to redirect instead of proxying to volume server on file GET requests. 2014-12-08 20:27:26 -08:00
Chris Lu
7ce628bf09 Clean raft configurations if "peers" option is set. 2014-10-27 01:09:45 -07:00
Chris Lu
179d36ba0e formatting code by: goimports -w=true . 2014-10-26 11:34:55 -07:00
Chris Lu
f527fc1d5e adjust visibility 2014-10-25 23:45:31 -07:00
Chris Lu
30bcda7136 fix typo 2014-10-25 18:10:32 -07:00
bmcquee
bd664def45 Revert "fix func name HasWriableVolume" 
This reverts commit bff7b71389.
 2014-10-19 23:08:01 -07:00
bmcquee
02ae8b98a5 Revert "change wriable to writeable" 
This reverts commit 626b896448.
 2014-10-19 23:07:58 -07:00
bmcquee
626b896448 change wriable to writeable 2014-10-19 23:01:15 -07:00
bmcquee
7ca10d8dcf add another logging line verbosity 2 2014-10-19 20:03:00 -07:00
bmcquee
bff7b71389 fix func name HasWriableVolume 2014-10-19 08:51:07 -07:00
wyy
4126280d55 use github.com/chrislusf instead of github.com/aszxqw 2014-09-25 16:57:22 +08:00
wyy
1cd19447e3 use github.com/aszxqw instead of code.google.com/p 2014-09-25 00:47:09 +08:00
Chris Lu
b9aee2defb add TTL support 
The volume TTL and file TTL are not necessarily the same. as long as
file TTL is smaller than volume TTL, it'll be fine.

volume TTL is used when assigning file id, e.g.
http://.../dir/assign?ttl=3h

file TTL is used when uploading
 2014-09-20 12:38:59 -07:00
Chris Lu
57a4549d86 wrap etag value with double quotes 2014-08-26 10:15:12 -07:00
Chris Lu
ce4acecaa8 Fix filer proxing http status code 
Double quote etag value.
 2014-08-25 12:02:04 -07:00
Chris Lu
df78466a12 remove uploading stated from volume server. 2014-08-05 18:14:12 -07:00
Chris Lu
530927db64 Add Etag support 2014-07-22 00:24:50 -07:00
Chris Lu
5d88cec2df 1. pass through http response headers 
2. set http status 201 for creating files
 2014-07-21 14:25:51 -07:00
Chris Lu
a3fb644d86 fix wrong error printing that caused panic 2014-07-21 13:42:15 -07:00
Chris Lu
a0b2582a75 comments change 2014-07-20 23:17:29 -07:00
Chris Lu
77fd5ecd98 Add /admin/mv to move a file or a folder 2014-07-20 23:12:49 -07:00
Chris Lu
38231b6891 return image size when client image processing 2014-07-05 00:43:41 -07:00
Chris Lu
cb28c26398 Setting application/json for json result. 
Setting application/javascript for jsonp result.
 2014-06-13 18:16:03 -07:00
Chris Lu
d7f6af09e6 Better guessing mime type with octstream 2014-06-08 21:02:20 -07:00
Chris Lu
e60af7b82e Add partial content request support. 2014-05-26 21:15:05 -07:00
Chris Lu
625f880b15 Adjust "weed server" parameters. 2014-05-26 17:34:54 -07:00
Chris Lu
34e03e7cf6 iphone usually has upper cased .JPG extension 
refactor
 2014-05-15 01:56:08 -07:00
Chris Lu
dcd12576c6 Add option to auto fix jpg orientation 2014-05-15 01:08:00 -07:00
Chris Lu
f7d6909b6f 1. refactor, move image resizing to its own package 
2. make code compile
 2014-05-14 23:44:19 -07:00
Chris Lu
dc24bad791 releasing 0.58 to handle control+c interrupts. 
compilable now. but FUSE mount is not working.
 2014-05-13 11:25:48 -07:00
Chris Lu
982aaa41b9 Add control+c or INT handling 2014-05-13 00:03:10 -07:00
Chris Lu
68ceea3f8d support file names with a comma inside. 2014-05-12 22:59:00 -07:00
Chris Lu
1c30a780a7 fix image serving performance problem introduced in last release. 2014-05-07 12:52:42 -07:00
Chris Lu
87b98711f7 A hidden feature: dynamically resize image. 
Adding width=xxx or height=xxx, or both, can dynamically resize a
gif,jpg,png. But the performance is bad. So, not recommending, but you
can use it if you insist. :)
 2014-04-25 22:28:01 -07:00
Chris Lu
d344e87de0 Adjust command line options. 
1. switch to use -publicIp instead of -publicUrl
2. -ip can be empty. It will listen to all available interfaces.
3. For "weed master", these options are changed:
  -masterPort => -master.port
  -peers => -master.peers
  -mdir => -master.dir
  -volumeSizeLimitMB => -master.volumeSizeLimitMB
  -conf => -master.conf
  -defaultReplicaPlacement => -master.defaultReplicaPlacement
  -port => -volume.port
  -max => -volume.max
 2014-04-25 22:09:42 -07:00
Chris Lu
1818a2a2da Change to protocol buffer for volume-join-masster message 
Reduced size to about 1/5 of the previous json format message
 2014-04-21 02:11:10 -07:00
Chris Lu
637469e656 log the volume server connected to which master server 2014-04-20 23:28:05 -07:00
Chris Lu
83c0c9843d Add option to recursively delete a folder. 2014-04-17 22:33:21 -07:00
Chris Lu
51939efeac 1. volume server now sends master server its max file key, so that 
master server does not need to store the sequence on disk any more
2. fix raft server's failure to init cluster during bootstrapping
 2014-04-16 23:43:27 -07:00
Chris Lu
9653a54766 added typed join result 2014-04-16 17:29:58 -07:00
Chris Lu
da0480ad72 adjust to upgraded Raft library 2014-04-15 17:56:47 -07:00
Chris Lu
4ecf5956d7 Add types to uploading 2014-04-15 10:01:13 -07:00
Chris Lu
7ad6cd35e8 Use type ClusterStatusResult for writing and reading results 2014-04-15 09:30:08 -07:00
Chris Lu
68021c6fc3 Use type AssignResult when writing and reading result. 2014-04-15 09:20:04 -07:00
Chris Lu
cbc5a76e80 Added batch file deleting. 2014-04-15 09:09:40 -07:00
Chris Lu
56a3d30e75 batch delete on volume servers 2014-04-14 01:00:09 -07:00
Chris Lu
460923f094 use fileId as the official name for the file identifier 2014-04-14 00:28:48 -07:00
Chris Lu
85894160c6 refactor: split master handler into 2 files 2014-04-14 00:23:52 -07:00
Chris Lu
7337c29b90 refactor: split volume handlers into 3 files 2014-04-14 00:13:18 -07:00
Chris Lu
5878f7c3a1 refactor lookup result types into package "operation" 2014-04-13 23:56:15 -07:00
Chris Lu
f20ef922fd 1. add batched volume lookup handler 
2. working-in-progress batch delete
 2014-04-13 23:41:34 -07:00
Chris Lu
f7f582ec86 1. refactoring, merge "replication" logic into "topology" package 
2. when growing volumes, additional preferred "rack" and "dataNode"
paraemters are also provided. Previously only "dataCenter" paraemter is
provided.
 2014-04-13 01:29:52 -07:00
Chris Lu
008aee0dc1 Add retrying logic to wait for other peers during cluster bootstrapping. 2014-04-11 16:23:58 -07:00
Chris Lu
5f4dc11409 1. root dir has id of 0 
2. only delete empty folders
3. correct listing files under a folder
 2014-04-09 21:01:48 -07:00
Chris Lu
abde40377c a correct implementation of filer 2014-04-09 09:44:58 -07:00
Chris Lu
67be8a5af8 adding filer!!! 2014-03-30 20:57:25 -07:00
Chris Lu
d6aa6239de fix to avoid empty sub directory 2014-03-30 13:32:24 -07:00
Chris Lu
51fafdb525 more robust filer 2014-03-30 13:26:44 -07:00
Chris Lu
2861275fb6 working filer server! 2014-03-30 11:28:04 -07:00
Chris Lu
59f6a13609 adding lots of different stats 2014-03-26 13:22:27 -07:00
Chris Lu
39b774a131 1. adding statistics reporting 
2. refactor version to util package
 2014-03-25 13:46:59 -07:00
Chris Lu
7c5c94785c switch to idle timeout instead of read timeout 2014-03-20 11:07:15 -07:00
Chris Lu
463589da01 adjusting logs 2014-03-19 04:46:42 -07:00
Chris Lu
f8b1d48f82 deal with empty learder() cases 2014-03-16 13:50:46 -07:00
Chris Lu
1c044280d6 reusing http connections in raft server 2014-03-16 13:49:49 -07:00
Chris Lu
41143b3b78 toughen weedfs clustering, adding synchronizing max volume id among 
peers in order to avoid the same volume id being assigned twice
1. moving raft.Server to topology
2. adding max volume id command for raft
 2014-03-15 23:03:49 -07:00
Chris Lu
fb75fe852c ignore "-peers" option if cluster is already bootstrapped 2014-03-15 00:36:51 -07:00
Chris Lu
946aa6d1e7 error message change 2014-03-13 12:11:50 -07:00
Chris Lu
d30052ce85 adjusting error message 2014-03-12 14:08:57 -07:00
Chris Lu
054374c765 in progress, trying to make benchmark working better to reuse http 
connections.
 2014-03-12 10:30:57 -07:00
Chris Lu
6f2d590617 fix error message 2014-03-12 06:23:07 -07:00
Chris Lu
cd10c277b2 can now delete a collection! Is this a dangerous feature? Only enabling 
deleting "benchmark" collections for now.
 2014-03-10 11:43:54 -07:00
Chris Lu
a121453188 benchmarking writing data to a specific collection 2014-03-09 23:54:07 -07:00
Chris Lu
7283d68e32 fixed redirection error 2014-03-03 08:20:46 -08:00
Chris Lu
ab9206c38e spelling error with parameter name! 2014-03-02 23:32:54 -08:00
Chris Lu
27c74a7e66 Major: 
change replication_type to ReplicaPlacement, hopefully cleaner code
works for 9 possible ReplicaPlacement
xyz
x : number of copies on other data centers
y : number of copies on other racks
z : number of copies on current rack
x y z each can be 0,1,2

Minor:
weed server "-mdir" default to "-dir" if empty
 2014-03-02 22:16:54 -08:00
Chris Lu
edae676913 1. volume server auto detect clustered master nodes 
2. remove operation package dependency on storage
 2014-02-14 17:10:49 -08:00
Chris Lu
ef4c2c0d1e cleaner cluster messages 2014-02-09 23:37:29 -08:00
Chris Lu
91829057c5 set to 400 Bad Request when failed to parse file id, recommended by 
claudiu
 2014-02-06 12:03:25 -08:00
Chris Lu
f68e15da89 set to 404 when failed to read file id 2014-02-06 12:00:58 -08:00
Chris Lu
d0147a16a9 avoid index out of range exception 2014-02-06 11:44:54 -08:00
Chris Lu
69a7de1ad8 optimize for submission from clustered master nodes 2014-02-05 10:49:05 -08:00
Chris Lu
e7585548a4 working auto fail-over master node 2014-02-05 01:54:52 -08:00
Chris Lu
d6fbd741fd a stable working clustering master node implementation 2014-02-05 00:25:23 -08:00
Chris Lu
af4b9c3aee go fmt 2014-02-04 01:11:28 -08:00
Chris Lu
6887e55f6a minor adjustment for weed master nodes clustering 2014-02-04 01:10:07 -08:00
Chris Lu
bf56bce5e9 Issue 62: Latest raft update breaks the build 2014-01-28 11:15:24 -08:00
Chris Lu
1bf75f7f73 toughen up error handling for invalid fid 2013-12-09 13:53:24 -08:00
Chris Lu
512899e6a6 disable raft logging 2013-12-09 13:34:28 -08:00
Chris Lu
da9abc2a93 a start for distributed master support, not working yet 2013-12-09 13:34:05 -08:00
Chris Lu
11e91bd549 mux router cannot handle "/" correctly. switching it off for volume 
servers
 2013-12-09 13:27:09 -08:00
Chris Lu
2e2f426fe2 clean up etcd backing for sequence persistent storage. It uses some OS 
specific calls and is not OS-agnostic.
 2013-12-03 23:30:55 -08:00
Chris Lu
a234789c59 switch to glog debugging 2013-12-02 01:54:05 -08:00
Chris Lu
c38eee73ca refactoring to separate master and volume server, so that these servers 
can be embedded into other applications
 2013-12-02 01:37:36 -08:00