Commit Graph

581 Commits

Author SHA1 Message Date
Mohanson
3c9ef6245e fix bug : master cann't redirect urlquery string
There is a bug that master can not redirect urlquery to slave volumn.
so i fix it, and it run good now.
2015-12-25 16:32:50 +08:00
chrislusf
7ae7029154 adjust usage text to fit the display 2015-12-14 22:52:52 -08:00
chrislusf
e921cb1a9d format changes 2015-12-14 22:38:58 -08:00
tnextday
031d26527f update 2015-12-15 13:08:09 +08:00
tnextday
521be17a9e verbose log 2015-12-15 13:05:59 +08:00
tnextday
f925374db6 Move write response content into a function 2015-12-15 11:26:16 +08:00
tnextday
90d410d627 verbose log 2015-12-15 00:30:18 +08:00
tnextday
b177afc326 weed download command use stream download the large file. 2015-12-15 00:14:02 +08:00
tnextday
aa44028b46 update 2015-12-14 22:14:57 +08:00
tnextday
f240c57f16 Rename ChunkManifest.GetData to ChunkManifest.Marshal 2015-12-14 22:01:30 +08:00
tnextday
82e6d67ccc update 2015-12-03 21:35:33 +08:00
tnextday
4fda5f8bfd update 2015-12-03 18:21:58 +08:00
tnextday
daac5de1ba more check in http_util.Delete
add status code in `DeleteResult` struct
operation.DeleteFiles maybe unsafe, so `ChunkManifest.DeleteChunks` manually delete each chunks
2015-12-03 16:27:02 +08:00
tnextday
a9a336fdff delete file return needle size 2015-12-02 21:45:26 +08:00
tnextday
34963de458 returen chunks file size when delete a chunkmanifest 2015-12-02 21:35:50 +08:00
tnextday
662915e691 Delete all chunks when delete a ChunkManifest
LoadChunkManifest can uncompress buffer
move compress.go from storage to operation because of import cycle
MakeFile add cross complete command
2015-12-02 21:27:29 +08:00
tnextday
520875d455 update 2015-12-02 18:25:18 +08:00
tnextday
d0e2475ece FilePart.Upload use base name instead of full path
fix chunked file download error
2015-12-02 16:35:16 +08:00
tnextday
2c0a7fe75e complete submit chunked file 2015-12-02 15:00:46 +08:00
tnextday
de5e07ce3e rename FlagChunkedFile to FlagChunkManifest 2015-12-01 20:53:44 +08:00
tnextday
6b0894d806 update ChunkedFile to seekable reader, so we can use io.* to read data 2015-12-01 20:23:50 +08:00
tnextday
f825d23789 fix build error 2015-11-30 00:21:42 +08:00
tnextday
1817864a45 add chunk file helper to support large file 2015-11-29 23:49:41 +08:00
chrislusf
020dd480ed fix 2015-11-22 10:11:25 -08:00
chrislusf
70d050416b fix
set HTTP_X_FORWARDED_FOR when proxying

https://github.com/chrislusf/seaweedfs/issues/214
2015-11-22 09:31:43 -08:00
chrislusf
805740069a go fmt 2015-10-19 22:03:18 -07:00
tianshimao
3c48d871d1 [bug fix]weed daemon exit due to hangup signal when terminal close 2015-10-19 14:39:11 +08:00
chrislusf
5feae4f74c enable collection deletion 2015-10-17 09:02:59 -07:00
Pawel Szymanski
bbcde8a19d server_filer_fix 2015-09-27 16:00:23 +01:00
Steve Kemp
2a777a970c Allow whitelisting by CIDR range, not just literally.
This allows you to write something like this:

         /usr/local/bin/weed master -mdir /srv/weed/master -whiteList=192.168.0.0/24,127.0.0.1

This will whitelist all the 192.168.0.XX hosts, as well as localhost.
2015-09-05 10:00:13 +03:00
chrislusf
91db227b27 avoid using empty fileId to delete
fix https://github.com/chrislusf/seaweedfs/issues/183
2015-08-21 14:09:36 -07:00
Timur Nurutdinov
4b0904e9c4 fix extract collection name from .dat file 2015-08-18 19:58:45 +03:00
chrislusf
7d1e9a6b8a add option to redirect moved or non-local volumes
fix https://github.com/chrislusf/seaweedfs/issues/168
2015-08-03 14:43:15 -07:00
chrislusf
320e946d50 fix ttl change detection
https://github.com/chrislusf/seaweedfs/issues/166
2015-07-17 19:30:25 -07:00
chrislusf
c4897df09c Revert "adjust symlink"
This reverts commit 8b1f83a0ed.
2015-07-13 11:13:47 -07:00
chrislusf
8b1f83a0ed adjust symlink
as recommended in https://github.com/chrislusf/seaweedfs/issues/160
2015-07-12 21:50:44 -07:00
chrislusf
430f371a97 fix wrong logic 2015-07-11 12:20:39 -07:00
chrislusf
9b8f8f4bb9 add logging 2015-07-11 12:20:09 -07:00
chrislusf
d8bb3845ae fix glog format 2015-07-11 09:55:45 -07:00
Chris Lu
9bf10975bd Merge branch 'master' of github.com:chrislusf/weed-fs 2015-07-11 01:07:12 -07:00
Chris Lu
a6aa79aab2 merge with latest glog 2015-07-11 01:06:58 -07:00
chrislusf
2c595d2d16 skip isFileUnchanged checking since ttl always change
skip checking since ttl always change. Fixing
https://github.com/chrislusf/seaweedfs/issues/166
2015-07-10 09:43:49 -07:00
chrislusf
a4d3f2da3d Avoid nil case when fixing data 2015-07-08 23:21:56 -07:00
chrislusf
3476d31e50 Add Ext format when exporting files. 2015-07-08 23:21:56 -07:00
chrislusf
95855da282 Adjust for window path
fix https://github.com/chrislusf/seaweedfs/issues/161
2015-07-08 01:43:26 -07:00
chrislusf
3b2645979d Use request host info for master url if possible
Fix https://github.com/chrislusf/seaweedfs/issues/148
2015-06-24 09:50:41 -07:00
chrislusf
418878edce In case lastNode==0, need to set it to -1
Fix https://github.com/chrislusf/seaweedfs/issues/156
2015-06-23 22:49:09 -07:00
chrislusf
30242409f4 allowing proxy to leader for volume id lookup then redirect to volume server
Fix https://github.com/chrislusf/seaweedfs/issues/154
2015-06-22 11:41:51 -07:00
chrislusf
fd2e6bcf5d Easier variable names 2015-06-02 00:33:13 -07:00
chrislusf
26cdd11d8f Fix compilation error!!! 2015-06-02 00:23:41 -07:00
chrislusf
51aac49e82 each command use its own options to avoid parameter collision
fix https://github.com/chrislusf/seaweedfs/issues/152
2015-06-01 19:25:01 -07:00
chrislusf
e09f45f5ed Fix compilation error.
Fix for https://github.com/chrislusf/seaweedfs/issues/150
2015-05-30 13:28:39 -07:00
chrislusf
32ba7fc6c0 Fix a possible index out of range error. Remove unnecessary caching. 2015-05-26 10:29:49 -07:00
chrislusf
86cd40fba8 Add "weed backup" command.
This is a pre-cursor for asynchronous replication.
2015-05-26 00:58:41 -07:00
chrislusf
7272af8ec4 Adjust dir parameter default value. 2015-05-25 23:53:45 -07:00
chrislusf
c86ae76e02 Remove old file 2015-05-25 23:51:41 -07:00
chrislusf
c89b4fd18b Add ParseUint64 function 2015-05-25 23:51:12 -07:00
chrislusf
36a31771f1 Add Key String() function 2015-05-25 23:50:19 -07:00
chrislusf
8f88d382a5 Rename variables 2015-05-23 10:16:01 -07:00
chrislusf
d3d23e779a Adjust log message 2015-05-23 10:15:16 -07:00
chrislusf
3afa3bea73 Adjust log message 2015-05-23 10:14:18 -07:00
chrislusf
85bfab612c Add comments 2015-05-23 10:13:26 -07:00
chrislusf
dc2c1aedcc Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2015-05-22 09:13:10 -07:00
chrislusf
c7cf4fa46c Fix looking for master nodes. 2015-05-22 08:12:51 -07:00
Denis Yeldandi
4e1c30b60a Added -newer argument, which takes a date/time in RFC3339 format and
exports only files newer than this time
2015-05-20 15:11:12 +03:00
chrislusf
99aee22e08 Adjust admin url pattern 2015-05-17 13:19:43 -07:00
yanyiwu
96b73e3e94 if mt != "application/octet-stream"
became
if !strings.HasPrefix(mt, "application/octet-stream")

In our situation,
    mt can be 'application/octet-stream;charset=ISO-8859-1',
    so I think HasPrefix will be more accurate.
2015-05-16 18:55:58 +08:00
chrislusf
3188382ea7 More debug information for connecting to master 2015-05-14 21:46:59 -07:00
chrislusf
b8314fb054 Textual changes. 2015-05-08 23:44:11 -07:00
chrislusf
66317b8438 Increase compact revision during each compaction 2015-05-08 23:43:59 -07:00
chrislusf
dac3b592ed Add compact revision in volume super block 2015-05-08 23:34:14 -07:00
chrislusf
49b1ba5bbf break away from code.google.com 2015-05-03 12:37:49 -07:00
yanyiwu
dc47db5512 unittest: TestSortVolumeInfos 2015-04-21 01:22:13 +08:00
yanyiwu
b7a18580b8 Sort VolumeInfos by VolumeId in Store.Status();
Ordered VolumeInfos is more Human-readable,
especially when there is a lot of volumes.
2015-04-21 01:21:21 +08:00
yanyiwu
eaad4fa3c4 BUG FIXED: RoundRobinCounter.Add will cause a out of range crash
when index >= len(rrc.Values)
2015-04-20 22:05:20 +08:00
yanyiwu
c65b9588e2 [ui] BUG FIXED: Concurrent Connections incorrect. 2015-04-20 21:50:07 +08:00
yanyiwu
9cd221cc33 More readable peers usage:
other master nodes in comma separated ip:port list, example:
127.0.0.1:9333,127.0.0.1:9334

Add example to prompt ip:port list is split by ','
2015-04-20 14:47:41 +08:00
chrislusf
5c81fa1075 Prepend prefix "0" for odd number of hex characters. 2015-04-19 18:54:05 -07:00
yanyiwu
6f96862662 FIXED: When RaftServer cannot find a leader, Return a more readable error.
Before:
curl -F "file=1234" "http://127.0.0.1:9333/submit"
{"error":"Post http:///dir/assign: http: no Host in request URL"}
After:
curl -F "file=1234" "http://127.0.0.1:9333/submit"
{"error":"Raft Server not initialized!"}
2015-04-19 19:07:06 +08:00
yanyiwu
3f253a587c [ui] seaweedfs logo and icon 2015-04-18 02:26:27 +08:00
Stuart P. Bentley
86e80aa9a0 Fix a couple more weedfs -> SeaweedFS instances
Apparently I forgot to save these files before submitting #121
2015-04-16 21:46:37 +00:00
Stuart P. Bentley
1a194a578c More consistency with SeaweedFS name
Among the changes, this replaces a couple instances of "Seaweed File System"
with "SeaweedFS", for the same reason that nobody says "Mongo Data Base".
2015-04-16 21:11:25 +00:00
chrislusf
e736963f3c Merge pull request #119 from stuartpb/fix-namesapce
Fix flat_namespace_filer.go implementing "FlatNamesapceFiler"
2015-04-16 13:27:13 -07:00
Stuart P. Bentley
03d99503bb Fix flat_namespace_filer.go implementing "FlatNamesapceFiler" 2015-04-16 20:18:34 +00:00
Stuart P. Bentley
f0c2a2dcb3 Change all chrislusf/weed-fs links to point to chrislu/seaweedfs 2015-04-16 19:18:06 +00:00
chrislusf
41f29e9d8c Adjust versioning. Beta version should not have a date. 2015-04-16 11:51:38 -07:00
chrislusf
c1bc529654 Use public url for returned file url result 2015-04-16 11:37:05 -07:00
chrislusf
087b839354 Nomalize url before redirecting. 2015-04-16 10:02:53 -07:00
chrislusf
67146ffa78 Adjust publicUrl to volume server only.
Remove publicUrl from master server.
2015-04-16 09:29:20 -07:00
chrislusf
53b663af35 Adjust publicUrl to volume server only. 2015-04-16 09:16:43 -07:00
chrislusf
2a7972e8ea Avoid system exit if only logging failed. 2015-04-15 18:02:02 -07:00
chrislusf
7cc1f473b6 Adjust log message for glog. 2015-04-15 00:01:32 -07:00
chrislusf
49d639ecab Add error checking for file reads. 2015-04-14 23:05:33 -07:00
chrislusf
c28d55d343 0.70 beta start 2015-04-14 10:10:50 -07:00
chrislusf
3a024d62df skip directory listing when paginating files. 2015-04-14 10:09:46 -07:00
Chris Lu
4483732b2c releasing 0.69 2015-04-13 23:50:33 -07:00
chrislusf
830a44a84a Add compression test 2015-04-13 23:39:11 -07:00
chrislusf
98aa9cc068 Adding filer option disableDirListing 2015-04-13 23:38:49 -07:00
yanyiwu
fcfa4d4ca9 log image Decode error for some kind of pictures 2015-04-10 22:05:17 +08:00
chrislusf
71e9b302d4 Fix empty public url 2015-04-08 11:08:08 -07:00