Commit Graph

64 Commits

Author SHA1 Message Date
Chris Lu
982aaa41b9 Add control+c or INT handling 2014-05-13 00:03:10 -07:00
Chris Lu
68ceea3f8d support file names with a comma inside. 2014-05-12 22:59:00 -07:00
Chris Lu
1c30a780a7 fix image serving performance problem introduced in last release. 2014-05-07 12:52:42 -07:00
Chris Lu
87b98711f7 A hidden feature: dynamically resize image.
Adding width=xxx or height=xxx, or both, can dynamically resize a
gif,jpg,png. But the performance is bad. So, not recommending, but you
can use it if you insist. :)
2014-04-25 22:28:01 -07:00
Chris Lu
d344e87de0 Adjust command line options.
1. switch to use -publicIp instead of -publicUrl
2. -ip can be empty. It will listen to all available interfaces.
3. For "weed master", these options are changed:
  -masterPort => -master.port
  -peers => -master.peers
  -mdir => -master.dir
  -volumeSizeLimitMB => -master.volumeSizeLimitMB
  -conf => -master.conf
  -defaultReplicaPlacement => -master.defaultReplicaPlacement
  -port => -volume.port
  -max => -volume.max
2014-04-25 22:09:42 -07:00
Chris Lu
1818a2a2da Change to protocol buffer for volume-join-masster message
Reduced size to about 1/5 of the previous json format message
2014-04-21 02:11:10 -07:00
Chris Lu
637469e656 log the volume server connected to which master server 2014-04-20 23:28:05 -07:00
Chris Lu
83c0c9843d Add option to recursively delete a folder. 2014-04-17 22:33:21 -07:00
Chris Lu
51939efeac 1. volume server now sends master server its max file key, so that
master server does not need to store the sequence on disk any more
2. fix raft server's failure to init cluster during bootstrapping
2014-04-16 23:43:27 -07:00
Chris Lu
9653a54766 added typed join result 2014-04-16 17:29:58 -07:00
Chris Lu
da0480ad72 adjust to upgraded Raft library 2014-04-15 17:56:47 -07:00
Chris Lu
4ecf5956d7 Add types to uploading 2014-04-15 10:01:13 -07:00
Chris Lu
7ad6cd35e8 Use type ClusterStatusResult for writing and reading results 2014-04-15 09:30:08 -07:00
Chris Lu
68021c6fc3 Use type AssignResult when writing and reading result. 2014-04-15 09:20:04 -07:00
Chris Lu
cbc5a76e80 Added batch file deleting. 2014-04-15 09:09:40 -07:00
Chris Lu
56a3d30e75 batch delete on volume servers 2014-04-14 01:00:09 -07:00
Chris Lu
460923f094 use fileId as the official name for the file identifier 2014-04-14 00:28:48 -07:00
Chris Lu
85894160c6 refactor: split master handler into 2 files 2014-04-14 00:23:52 -07:00
Chris Lu
7337c29b90 refactor: split volume handlers into 3 files 2014-04-14 00:13:18 -07:00
Chris Lu
5878f7c3a1 refactor lookup result types into package "operation" 2014-04-13 23:56:15 -07:00
Chris Lu
f20ef922fd 1. add batched volume lookup handler
2. working-in-progress batch delete
2014-04-13 23:41:34 -07:00
Chris Lu
f7f582ec86 1. refactoring, merge "replication" logic into "topology" package
2. when growing volumes, additional preferred "rack" and "dataNode"
paraemters are also provided. Previously only "dataCenter" paraemter is
provided.
2014-04-13 01:29:52 -07:00
Chris Lu
008aee0dc1 Add retrying logic to wait for other peers during cluster bootstrapping. 2014-04-11 16:23:58 -07:00
Chris Lu
5f4dc11409 1. root dir has id of 0
2. only delete empty folders
3. correct listing files under a folder
2014-04-09 21:01:48 -07:00
Chris Lu
abde40377c a correct implementation of filer 2014-04-09 09:44:58 -07:00
Chris Lu
67be8a5af8 adding filer!!! 2014-03-30 20:57:25 -07:00
Chris Lu
d6aa6239de fix to avoid empty sub directory 2014-03-30 13:32:24 -07:00
Chris Lu
51fafdb525 more robust filer 2014-03-30 13:26:44 -07:00
Chris Lu
2861275fb6 working filer server! 2014-03-30 11:28:04 -07:00
Chris Lu
59f6a13609 adding lots of different stats 2014-03-26 13:22:27 -07:00
Chris Lu
39b774a131 1. adding statistics reporting
2. refactor version to util package
2014-03-25 13:46:59 -07:00
Chris Lu
7c5c94785c switch to idle timeout instead of read timeout 2014-03-20 11:07:15 -07:00
Chris Lu
463589da01 adjusting logs 2014-03-19 04:46:42 -07:00
Chris Lu
f8b1d48f82 deal with empty learder() cases 2014-03-16 13:50:46 -07:00
Chris Lu
1c044280d6 reusing http connections in raft server 2014-03-16 13:49:49 -07:00
Chris Lu
41143b3b78 toughen weedfs clustering, adding synchronizing max volume id among
peers in order to avoid the same volume id being assigned twice
1. moving raft.Server to topology
2. adding max volume id command for raft
2014-03-15 23:03:49 -07:00
Chris Lu
fb75fe852c ignore "-peers" option if cluster is already bootstrapped 2014-03-15 00:36:51 -07:00
Chris Lu
946aa6d1e7 error message change 2014-03-13 12:11:50 -07:00
Chris Lu
d30052ce85 adjusting error message 2014-03-12 14:08:57 -07:00
Chris Lu
054374c765 in progress, trying to make benchmark working better to reuse http
connections.
2014-03-12 10:30:57 -07:00
Chris Lu
6f2d590617 fix error message 2014-03-12 06:23:07 -07:00
Chris Lu
cd10c277b2 can now delete a collection! Is this a dangerous feature? Only enabling
deleting "benchmark" collections for now.
2014-03-10 11:43:54 -07:00
Chris Lu
a121453188 benchmarking writing data to a specific collection 2014-03-09 23:54:07 -07:00
Chris Lu
7283d68e32 fixed redirection error 2014-03-03 08:20:46 -08:00
Chris Lu
ab9206c38e spelling error with parameter name! 2014-03-02 23:32:54 -08:00
Chris Lu
27c74a7e66 Major:
change replication_type to ReplicaPlacement, hopefully cleaner code
works for 9 possible ReplicaPlacement
xyz
x : number of copies on other data centers
y : number of copies on other racks
z : number of copies on current rack
x y z each can be 0,1,2

Minor:
weed server "-mdir" default to "-dir" if empty
2014-03-02 22:16:54 -08:00
Chris Lu
edae676913 1. volume server auto detect clustered master nodes
2. remove operation package dependency on storage
2014-02-14 17:10:49 -08:00
Chris Lu
ef4c2c0d1e cleaner cluster messages 2014-02-09 23:37:29 -08:00
Chris Lu
91829057c5 set to 400 Bad Request when failed to parse file id, recommended by
claudiu
2014-02-06 12:03:25 -08:00
Chris Lu
f68e15da89 set to 404 when failed to read file id 2014-02-06 12:00:58 -08:00