mirror/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-12-21 15:28:14 +08:00
Code Issues Packages Projects Releases Wiki Activity
860 Commits 32 Branches 296 Tags 152 MiB
c65b9588e2
Commit Graph

64 Commits

Author SHA1 Message Date
Stuart P. Bentley
f0c2a2dcb3 Change all chrislusf/weed-fs links to point to chrislu/seaweedfs 2015-04-16 19:18:06 +00:00
chrislusf
71e9b302d4 Fix empty public url 2015-04-08 11:08:08 -07:00
chrislusf
1b6ab2f6af Add boltdb for volume needle map 
boltdb is fairly slow to write, about 6 minutes for recreating index
for 1553934 files. Boltdb loads 1,553,934 x 16 = 24,862,944bytes from
disk, and generate the boltdb as large as 134,217,728 bytes in 6
minutes.

To compare, for leveldb, it recreates index in leveldb as large as
27,188,148 bytes in 8 seconds.
For in memory version, it loads the index in

To test the memory consumption, the leveldb or boltdb index are
created. And the server is restarted. Using the benchmark tool to read
lots of files. There are 7 volumes in benchmark collection, each with
about 1553K files.
For leveldb, the memory starts at 142,884KB, and stays at 179,340KB.
For boltdb, the memory starts at 73,756KB, and stays at 144,564KB.
For in-memory, the memory starts at 368,152KB, and stays at 448,032KB.
 2015-03-29 11:04:32 -07:00
chrislusf
020ba6c9a8 add leveldb support for needle map 
This supposedly should reduce memory consumption. However, for tests
with millions of, this shows consuming more memories. Need to see
whether this will work out. If not, later boltdb will be tested.
 2015-03-27 16:34:58 -07:00
chrislusf
f511b507a5 Add read only public port on volume server 
Add read only public port on volume server
 2015-03-09 01:10:04 -07:00
chrislusf
e282a9b06a Fix compilation error 2015-02-12 19:51:48 -08:00
chrislusf
3b1b955fc5 ensure non empty volume publicUrl 2015-02-12 17:51:13 -08:00
chrislusf
e381356af9 change CLI option from publicIp to publicUrl 
Now the publicUrl is free style text.
 2015-02-02 15:51:25 -08:00
Chris Lu
7b4a53b2c1 Add optional admin port to volume server, to seperate admin operations from normal file operations. 2015-01-18 17:03:38 -08:00
Chris Lu
af416189f1 Cleanup error printing. 2015-01-13 17:04:41 -08:00
Chris Lu
5afdc469a3 Separate into admin and public mux for volume servers. 2015-01-13 00:45:26 -08:00
Chris Lu
09bc196958 Refactoring volume server options. 2015-01-13 00:36:44 -08:00
Chris Lu
ef191f2901 Refactoring volume server options. 2015-01-13 00:27:51 -08:00
yanyiwu
7d810a15c0 fix bug about : writed needle into localfile twice when replicating, because of the ip is not equal : ":8080" != "127.0.0.1:8080" 2015-01-07 16:47:57 +08:00
Chris Lu
a3e4145e8a refactoring for later security changes 2015-01-05 14:20:04 -08:00
Chris Lu
179d36ba0e formatting code by: goimports -w=true . 2014-10-26 11:34:55 -07:00
Chris Lu
b5aa2ef605 Add master bind ip address option. 2014-10-21 01:28:17 -07:00
wyy
4126280d55 use github.com/chrislusf instead of github.com/aszxqw 2014-09-25 16:57:22 +08:00
wyy
1cd19447e3 use github.com/aszxqw instead of code.google.com/p 2014-09-25 00:47:09 +08:00
Chris Lu
ba179b1542 Add "-ip.bind" option when starting volume servers. 
Also some Weed->Seaweed changes.
 2014-09-20 23:30:35 -07:00
Chris Lu
8ff0d17d6a defauting images.fix.orientation option to true 2014-05-15 01:16:56 -07:00
Chris Lu
dcd12576c6 Add option to auto fix jpg orientation 2014-05-15 01:08:00 -07:00
Chris Lu
dac95464b8 better handling of os signals 2014-05-13 15:04:04 -07:00
Chris Lu
029923329d add os.Kill signal to handle. 
go fmt some code.
 2014-05-13 11:32:10 -07:00
Chris Lu
750e1aaaa5 Add control+c or INT handling 2014-05-13 00:05:18 -07:00
Chris Lu
7e0ae72b07 Add control+c or INT handling 2014-05-13 00:04:28 -07:00
Chris Lu
d344e87de0 Adjust command line options. 
1. switch to use -publicIp instead of -publicUrl
2. -ip can be empty. It will listen to all available interfaces.
3. For "weed master", these options are changed:
  -masterPort => -master.port
  -peers => -master.peers
  -mdir => -master.dir
  -volumeSizeLimitMB => -master.volumeSizeLimitMB
  -conf => -master.conf
  -defaultReplicaPlacement => -master.defaultReplicaPlacement
  -port => -volume.port
  -max => -volume.max
 2014-04-25 22:09:42 -07:00
Chris Lu
3b5035c468 1. v0.54 
2. go vet found many printing format errors
 2014-04-17 00:16:44 -07:00
Chris Lu
39b774a131 1. adding statistics reporting 
2. refactor version to util package
 2014-03-25 13:46:59 -07:00
Chris Lu
7c5c94785c switch to idle timeout instead of read timeout 2014-03-20 11:07:15 -07:00
Chris Lu
097aac2328 adjusting default read time out 2014-03-12 15:05:07 -07:00
Chris Lu
6d7556b31f help message adjustment 2014-02-05 11:47:26 -08:00
Chris Lu
11e91bd549 mux router cannot handle "/" correctly. switching it off for volume 
servers
 2013-12-09 13:27:09 -08:00
Chris Lu
eeeccf2f78 ssue 59: Multi Ip Enviromment support + publicUrl is disregarded by 
master
 2013-12-02 22:58:27 -08:00
Chris Lu
e449a4a517 use glog 2013-12-02 01:59:04 -08:00
Chris Lu
c38eee73ca refactoring to separate master and volume server, so that these servers 
can be embedded into other applications
 2013-12-02 01:37:36 -08:00
Chris Lu
bc2f3b26e7 refactoring, start to use gorilla/mux 2013-12-01 14:41:47 -08:00
Chris Lu
47aea42d66 fix filename not set error 2013-11-18 23:16:21 -08:00
Chris Lu
3b68711139 support for collections! 2013-11-12 02:21:22 -08:00
Chris Lu
82b74c7940 issue 43 "go fmt" chagnes from "Ryan S. Brown" <sb@ryansb.com> 
some basic changes to parse upload url
 2013-09-01 23:58:21 -07:00
Chris Lu
2e70cc8be7 default to use os.TempDir() instead of hard coded "/tmp" 2013-08-28 10:39:15 -07:00
Chris Lu
e45c6b5e21 add white list to both master and volume servers 
prepare for v0.41
 2013-08-13 09:31:19 -07:00
Chris Lu
3572e1140e adjusting parameter names 2013-08-13 09:22:06 -07:00
Chris Lu
078118ecba v0.40 2013-08-12 23:48:10 -07:00
Chris Lu
11b4e0c77d fix syntax error 2013-08-12 21:43:13 -07:00
Chris Lu
e0951dd44f added write whiteList, to make it a bit easier to secure volume servers 
on hosting environments.
 2013-08-12 21:27:47 -07:00
Chris Lu
ed154053c8 switching to temporarily use glog library 2013-08-08 23:57:22 -07:00
Chris Lu
f457eef144 add /submit handler for both master and volume server 2013-08-06 13:23:10 -07:00
Chris Lu
d51c8d37bd Issue 6: upload file without id specified 2013-08-06 12:13:10 -07:00
Chris Lu
54906c48f3 report errors when upload timeouts 2013-08-05 13:37:41 -07:00