Commit Graph

80 Commits

Author SHA1 Message Date
tnextday
b177afc326 weed download command use stream download the large file. 2015-12-15 00:14:02 +08:00
tnextday
aa44028b46 update 2015-12-14 22:14:57 +08:00
tnextday
f240c57f16 Rename ChunkManifest.GetData to ChunkManifest.Marshal 2015-12-14 22:01:30 +08:00
tnextday
82e6d67ccc update 2015-12-03 21:35:33 +08:00
tnextday
daac5de1ba more check in http_util.Delete
add status code in `DeleteResult` struct
operation.DeleteFiles maybe unsafe, so `ChunkManifest.DeleteChunks` manually delete each chunks
2015-12-03 16:27:02 +08:00
tnextday
662915e691 Delete all chunks when delete a ChunkManifest
LoadChunkManifest can uncompress buffer
move compress.go from storage to operation because of import cycle
MakeFile add cross complete command
2015-12-02 21:27:29 +08:00
tnextday
520875d455 update 2015-12-02 18:25:18 +08:00
tnextday
d0e2475ece FilePart.Upload use base name instead of full path
fix chunked file download error
2015-12-02 16:35:16 +08:00
tnextday
2c0a7fe75e complete submit chunked file 2015-12-02 15:00:46 +08:00
tnextday
6b0894d806 update ChunkedFile to seekable reader, so we can use io.* to read data 2015-12-01 20:23:50 +08:00
tnextday
f825d23789 fix build error 2015-11-30 00:21:42 +08:00
tnextday
1817864a45 add chunk file helper to support large file 2015-11-29 23:49:41 +08:00
chrislusf
32ba7fc6c0 Fix a possible index out of range error. Remove unnecessary caching. 2015-05-26 10:29:49 -07:00
chrislusf
86cd40fba8 Add "weed backup" command.
This is a pre-cursor for asynchronous replication.
2015-05-26 00:58:41 -07:00
Stuart P. Bentley
f0c2a2dcb3 Change all chrislusf/weed-fs links to point to chrislu/seaweedfs 2015-04-16 19:18:06 +00:00
chrislusf
c1bc529654 Use public url for returned file url result 2015-04-16 11:37:05 -07:00
chrislusf
3ece066700 change count to uint64 to fix #109
fix https://github.com/chrislusf/weed-fs/issues/109
2015-04-06 14:17:36 -07:00
chrislusf
23012deccf Add better error message. 2015-03-19 10:48:28 -07:00
chrislusf
b07d81fb08 follow golint suggestions 2015-03-10 00:20:34 -07:00
chrislusf
f511b507a5 Add read only public port on volume server
Add read only public port on volume server
2015-03-09 01:10:04 -07:00
Chris Lu
f7998f8652 merge conflicts 2015-02-07 15:35:28 -08:00
chrislusf
cc724305b6 Using Url instead of PublicUrl for volume server
Originally there are only url(ip + port), and publicUrl. Because ip was
used to listen for http service, it has less flexibility and volume
server has to be accessed via publicUrl.

Recently we added ip.bind, for binding http service.

With this change, url can be used to connect to volume servers. And
publicUrl becomes a free style piece of url information, it does not
even need to be unique.
2015-02-02 10:16:50 -08:00
yanyiwu
2f10f2960b use proto "github.com/golang/protobuf/proto" 2015-01-30 15:09:37 +08:00
Chris Lu
7b4a53b2c1 Add optional admin port to volume server, to seperate admin operations from normal file operations. 2015-01-18 17:03:38 -08:00
Chris Lu
352ef2830c Add caching volume locations to batch volume id lookup. 2015-01-11 23:01:31 -08:00
yanyiwu
cacfc85869 add some String() to make codes easier to read and debug 2015-01-08 15:54:50 +08:00
yanyiwu
5b7628cf08 use github.com/golang/protobuf/proto instead of code.google.com/p/goprotobuf/proto 2014-12-26 16:59:53 +08:00
Chris Lu
179d36ba0e formatting code by: goimports -w=true . 2014-10-26 11:34:55 -07:00
wyy
4126280d55 use github.com/chrislusf instead of github.com/aszxqw 2014-09-25 16:57:22 +08:00
wyy
1cd19447e3 use github.com/aszxqw instead of code.google.com/p 2014-09-25 00:47:09 +08:00
Chris Lu
b9aee2defb add TTL support
The volume TTL and file TTL are not necessarily the same. as long as
file TTL is smaller than volume TTL, it'll be fine.

volume TTL is used when assigning file id, e.g.
http://.../dir/assign?ttl=3h

file TTL is used when uploading
2014-09-20 12:38:59 -07:00
Chris Lu
a437d77431 only set lookup cache when successful 2014-06-02 09:22:23 -07:00
Chris Lu
b5f99b26eb Add volume id lookup caching 2014-05-25 14:01:54 -07:00
Chris Lu
1818a2a2da Change to protocol buffer for volume-join-masster message
Reduced size to about 1/5 of the previous json format message
2014-04-21 02:11:10 -07:00
Chris Lu
9653a54766 added typed join result 2014-04-16 17:29:58 -07:00
Chris Lu
4ecf5956d7 Add types to uploading 2014-04-15 10:01:13 -07:00
Chris Lu
7ad6cd35e8 Use type ClusterStatusResult for writing and reading results 2014-04-15 09:30:08 -07:00
Chris Lu
cb56322937 minor textual change 2014-04-15 09:20:28 -07:00
Chris Lu
68021c6fc3 Use type AssignResult when writing and reading result. 2014-04-15 09:20:04 -07:00
Chris Lu
cbc5a76e80 Added batch file deleting. 2014-04-15 09:09:40 -07:00
Chris Lu
b771f060f1 rename variable name 2014-04-14 01:07:11 -07:00
Chris Lu
2eb9014606 rename file from lookup_volume_id.go to lookup.go 2014-04-14 01:05:57 -07:00
Chris Lu
5878f7c3a1 refactor lookup result types into package "operation" 2014-04-13 23:56:15 -07:00
Chris Lu
51fafdb525 more robust filer 2014-03-30 13:26:44 -07:00
Chris Lu
2861275fb6 working filer server! 2014-03-30 11:28:04 -07:00
Chris Lu
7251e357e7 enhance deletion operation 2014-03-20 13:30:34 -07:00
Chris Lu
3dbebfd1e1 Thread-safe fixes:
1. avoid sharing []byte
2. switch to use ReadAt()
2014-03-19 04:41:16 -07:00
Chris Lu
7a8bc2e19e avoid sharing same err variable 2014-03-12 15:17:23 -07:00
Chris Lu
c3ce024fc1 reusing http connections 2014-03-12 14:07:01 -07:00
Chris Lu
466a55b06d fix error message 2014-03-12 10:25:05 -07:00