chrislusf
71e9b302d4
Fix empty public url
2015-04-08 11:08:08 -07:00
chrislusf
1b6ab2f6af
Add boltdb for volume needle map
...
boltdb is fairly slow to write, about 6 minutes for recreating index
for 1553934 files. Boltdb loads 1,553,934 x 16 = 24,862,944bytes from
disk, and generate the boltdb as large as 134,217,728 bytes in 6
minutes.
To compare, for leveldb, it recreates index in leveldb as large as
27,188,148 bytes in 8 seconds.
For in memory version, it loads the index in
To test the memory consumption, the leveldb or boltdb index are
created. And the server is restarted. Using the benchmark tool to read
lots of files. There are 7 volumes in benchmark collection, each with
about 1553K files.
For leveldb, the memory starts at 142,884KB, and stays at 179,340KB.
For boltdb, the memory starts at 73,756KB, and stays at 144,564KB.
For in-memory, the memory starts at 368,152KB, and stays at 448,032KB.
2015-03-29 11:04:32 -07:00
chrislusf
020ba6c9a8
add leveldb support for needle map
...
This supposedly should reduce memory consumption. However, for tests
with millions of, this shows consuming more memories. Need to see
whether this will work out. If not, later boltdb will be tested.
2015-03-27 16:34:58 -07:00
chrislusf
f511b507a5
Add read only public port on volume server
...
Add read only public port on volume server
2015-03-09 01:10:04 -07:00
chrislusf
e282a9b06a
Fix compilation error
2015-02-12 19:51:48 -08:00
chrislusf
3b1b955fc5
ensure non empty volume publicUrl
2015-02-12 17:51:13 -08:00
chrislusf
e381356af9
change CLI option from publicIp to publicUrl
...
Now the publicUrl is free style text.
2015-02-02 15:51:25 -08:00
Chris Lu
7b4a53b2c1
Add optional admin port to volume server, to seperate admin operations from normal file operations.
2015-01-18 17:03:38 -08:00
Chris Lu
af416189f1
Cleanup error printing.
2015-01-13 17:04:41 -08:00
Chris Lu
5afdc469a3
Separate into admin and public mux for volume servers.
2015-01-13 00:45:26 -08:00
Chris Lu
09bc196958
Refactoring volume server options.
2015-01-13 00:36:44 -08:00
Chris Lu
ef191f2901
Refactoring volume server options.
2015-01-13 00:27:51 -08:00
yanyiwu
7d810a15c0
fix bug about : writed needle into localfile twice when replicating, because of the ip is not equal : ":8080" != "127.0.0.1:8080"
2015-01-07 16:47:57 +08:00
Chris Lu
a3e4145e8a
refactoring for later security changes
2015-01-05 14:20:04 -08:00
Chris Lu
179d36ba0e
formatting code by: goimports -w=true .
2014-10-26 11:34:55 -07:00
Chris Lu
b5aa2ef605
Add master bind ip address option.
2014-10-21 01:28:17 -07:00
wyy
4126280d55
use github.com/chrislusf instead of github.com/aszxqw
2014-09-25 16:57:22 +08:00
wyy
1cd19447e3
use github.com/aszxqw instead of code.google.com/p
2014-09-25 00:47:09 +08:00
Chris Lu
ba179b1542
Add "-ip.bind" option when starting volume servers.
...
Also some Weed->Seaweed changes.
2014-09-20 23:30:35 -07:00
Chris Lu
8ff0d17d6a
defauting images.fix.orientation option to true
2014-05-15 01:16:56 -07:00
Chris Lu
dcd12576c6
Add option to auto fix jpg orientation
2014-05-15 01:08:00 -07:00
Chris Lu
dac95464b8
better handling of os signals
2014-05-13 15:04:04 -07:00
Chris Lu
029923329d
add os.Kill signal to handle.
...
go fmt some code.
2014-05-13 11:32:10 -07:00
Chris Lu
750e1aaaa5
Add control+c or INT handling
2014-05-13 00:05:18 -07:00
Chris Lu
7e0ae72b07
Add control+c or INT handling
2014-05-13 00:04:28 -07:00
Chris Lu
d344e87de0
Adjust command line options.
...
1. switch to use -publicIp instead of -publicUrl
2. -ip can be empty. It will listen to all available interfaces.
3. For "weed master", these options are changed:
-masterPort => -master.port
-peers => -master.peers
-mdir => -master.dir
-volumeSizeLimitMB => -master.volumeSizeLimitMB
-conf => -master.conf
-defaultReplicaPlacement => -master.defaultReplicaPlacement
-port => -volume.port
-max => -volume.max
2014-04-25 22:09:42 -07:00
Chris Lu
3b5035c468
1. v0.54
...
2. go vet found many printing format errors
2014-04-17 00:16:44 -07:00
Chris Lu
39b774a131
1. adding statistics reporting
...
2. refactor version to util package
2014-03-25 13:46:59 -07:00
Chris Lu
7c5c94785c
switch to idle timeout instead of read timeout
2014-03-20 11:07:15 -07:00
Chris Lu
097aac2328
adjusting default read time out
2014-03-12 15:05:07 -07:00
Chris Lu
6d7556b31f
help message adjustment
2014-02-05 11:47:26 -08:00
Chris Lu
11e91bd549
mux router cannot handle "/" correctly. switching it off for volume
...
servers
2013-12-09 13:27:09 -08:00
Chris Lu
eeeccf2f78
ssue 59: Multi Ip Enviromment support + publicUrl is disregarded by
...
master
2013-12-02 22:58:27 -08:00
Chris Lu
e449a4a517
use glog
2013-12-02 01:59:04 -08:00
Chris Lu
c38eee73ca
refactoring to separate master and volume server, so that these servers
...
can be embedded into other applications
2013-12-02 01:37:36 -08:00
Chris Lu
bc2f3b26e7
refactoring, start to use gorilla/mux
2013-12-01 14:41:47 -08:00
Chris Lu
47aea42d66
fix filename not set error
2013-11-18 23:16:21 -08:00
Chris Lu
3b68711139
support for collections!
2013-11-12 02:21:22 -08:00
Chris Lu
82b74c7940
issue 43 "go fmt" chagnes from "Ryan S. Brown" <sb@ryansb.com>
...
some basic changes to parse upload url
2013-09-01 23:58:21 -07:00
Chris Lu
2e70cc8be7
default to use os.TempDir() instead of hard coded "/tmp"
2013-08-28 10:39:15 -07:00
Chris Lu
e45c6b5e21
add white list to both master and volume servers
...
prepare for v0.41
2013-08-13 09:31:19 -07:00
Chris Lu
3572e1140e
adjusting parameter names
2013-08-13 09:22:06 -07:00
Chris Lu
078118ecba
v0.40
2013-08-12 23:48:10 -07:00
Chris Lu
11b4e0c77d
fix syntax error
2013-08-12 21:43:13 -07:00
Chris Lu
e0951dd44f
added write whiteList, to make it a bit easier to secure volume servers
...
on hosting environments.
2013-08-12 21:27:47 -07:00
Chris Lu
ed154053c8
switching to temporarily use glog library
2013-08-08 23:57:22 -07:00
Chris Lu
f457eef144
add /submit handler for both master and volume server
2013-08-06 13:23:10 -07:00
Chris Lu
d51c8d37bd
Issue 6: upload file without id specified
2013-08-06 12:13:10 -07:00
Chris Lu
54906c48f3
report errors when upload timeouts
2013-08-05 13:37:41 -07:00
Chris Lu
5e3b6e968a
escaping upload file name special characters
...
if already gzipped, avoid gzipping again
2013-07-15 17:26:00 -07:00
