Commit Graph

280 Commits

Author SHA1 Message Date
Chris Lu
bf270d9e8c filer: able to tail meta data changes 2020-04-05 00:51:16 -07:00
Chris Lu
50a5018b7f writing meta logs is working 2020-03-30 01:19:33 -07:00
Chris Lu
5ebf232e79 HDFS: 1.2.6 2020-03-29 01:40:04 -07:00
Chris Lu
b656e05aaf HDFS: support chunk cache 2020-03-29 00:55:40 -07:00
Chris Lu
ae2309dc58 Update SeaweedRead.java 2020-03-28 23:58:59 -07:00
Chris Lu
3d3bab2447 add notes 2020-03-28 23:43:24 -07:00
Chris Lu
c4bea45099 S3 API: fix DeleteMultipleObjectsHandler
fix https://github.com/chrislusf/seaweedfs/issues/1241
2020-03-20 14:17:31 -07:00
Chris Lu
de1ba85346 HDFS support encrypted data storage 2020-03-14 00:27:57 -07:00
Chris Lu
2e3f6ad3a9 filer: remember content is gzipped or not 2020-03-08 21:39:33 -07:00
Chris Lu
13e215ee5c filer: option to encrypt data on volume server 2020-03-06 00:49:47 -08:00
Chris Lu
555413d9fc weed queue starts 2020-02-27 00:07:13 -08:00
Chris Lu
0841bedb15 move filer assign volume grpc errror to response 2020-02-25 17:15:09 -08:00
Chris Lu
bc38b72a20 s3: implemented DeleteMultipleObjects 2020-02-25 14:38:36 -08:00
Chris Lu
6ab7368ef2 filer: dynamically create bucket under /buckets folder 2020-02-24 22:28:45 -08:00
Chris Lu
d8dec2323b s3: move buckets folder configuration to filer 2020-02-24 14:34:14 -08:00
Chris Lu
c48fc8b4de grpc send error via response instead of grpc error 2020-01-25 09:17:19 -08:00
Chris Lu
6a5c037099 fix http range requests 2020-01-22 22:59:12 -08:00
Chris Lu
d4e75a0d18 filer: option to create file only if it is new, O_EXCL 2020-01-22 11:42:40 -08:00
Chris Lu
69ffcbdcc0 HCFS: release 1.2.4 2019-12-14 11:04:36 -08:00
Chris Lu
987108a2b1 HCFS: streaming list files 2019-12-13 10:04:53 -08:00
Chris Lu
0fa1269bc7 filer: streaming file listing 2019-12-13 00:22:37 -08:00
Chris Lu
e9dd5a602a HCFS: 1.2.3
shade org.apache.http in https://github.com/chrislusf/seaweedfs/issues/1080
2019-10-11 23:56:04 -07:00
Chris Lu
7057e7a076 HCFS: 1.22
fix put gives java.lang.NoSuchFieldError: INSTANCE related to Cloudera CDH Hadoop https://github.com/chrislusf/seaweedfs/issues/1080
2019-10-11 21:44:44 -07:00
Chris Lu
15f968b054 HCFS: avoid possible jar problem 2019-10-09 18:09:08 -07:00
Chris Lu
a999ed94d0 update hdfs client 2019-10-08 22:49:10 -07:00
Chris Lu
ae53f63680 filer: recursive deletion optionally ignoring any errors
fix https://github.com/chrislusf/seaweedfs/issues/1062
2019-09-11 20:26:20 -07:00
Chris Lu
d361ecb23b HCFS: 1.1.6 2019-09-03 01:31:31 -07:00
Chris Lu
fd509c3844 HCFS: working with HBase 2019-09-03 00:50:28 -07:00
Chris Lu
60c9215a00 HCFS: avoid verbose file not found exception stack trace 2019-09-01 21:40:26 -07:00
Chris Lu
af8b413a9c HCFS: fix mkdirs NPE 2019-09-01 12:25:06 -07:00
Chris Lu
cb299dfaa2 HCFS: use latest grpc versions, separate hadoop2 and hadoop3 2019-09-01 03:46:51 -07:00
Chris Lu
170ee6ef0f tmp 2019-08-29 23:29:10 -07:00
Chris Lu
8da5d5b094 filer.copy: use filer settings, avoid unnecessary command line options
fix https://github.com/chrislusf/seaweedfs/issues/968
2019-06-23 01:57:35 -07:00
Chris Lu
82b0759493 filer: migrating filer store from persisting shorter structured file id instead of a string 2019-05-17 02:03:23 -07:00
Chris Lu
b3b42bc947 replicate need to include new entry path 2019-04-16 00:44:31 -07:00
Chris Lu
97406333a5 support atomic renaming for mysql/postgres filer store 2019-03-30 23:08:29 -07:00
Chris Lu
097b7a321e HDFS: move to 1.0.8 2019-02-20 00:57:31 -08:00
Chris Lu
6ed69de6bd HDFS: add jwt auth for uploading 2019-02-19 14:26:59 -08:00
Chris Lu
58d4088db4 HDFS: add tls secured grpc 2019-02-19 11:57:25 -08:00
Chris Lu
74fb237727 benchmark can work in secure mode 2019-02-15 00:09:19 -08:00
Chris Lu
9123d799b8 refactor 2018-12-27 23:40:23 -08:00
Chris Lu
319ab6d98f refactoring 2018-12-27 23:29:51 -08:00
Chris Lu
253f190f48 weed mount add symlink support 2018-12-25 22:45:44 -08:00
Chris Lu
9546104961 HCFS 1.05 2018-12-18 20:23:40 -08:00
Chris Lu
2c72447078 HCFS: bug fix for listEntries
fix https://github.com/chrislusf/seaweedfs/issues/797
2018-12-18 20:22:51 -08:00
Chris Lu
e716ec9908 HCFS 1.04 2018-12-17 20:40:10 -08:00
Chris Lu
cab7fc7738 fix directory creation
fix https://github.com/chrislusf/seaweedfs/issues/794
2018-12-17 20:37:55 -08:00
Chris Lu
d11cfdb356 paginate through large folders 2018-12-17 01:25:02 -08:00
Chris Lu
21315f709d HCFS 1.0.2 2018-12-14 09:16:21 -08:00
Chris Lu
36d1e739e6 1.11 2018-12-08 00:32:34 -08:00
Chris Lu
adf12c8825 refactoring 2018-12-07 02:23:45 -08:00
Chris Lu
1bfb96f34d optimization for reading whole chunk with gzip encoding 2018-12-07 01:57:55 -08:00
Chris Lu
6946c51430 avoid range request for gzipped content 2018-12-07 01:23:30 -08:00
Chris Lu
6b39effe7f add a local test 2018-12-07 01:23:02 -08:00
Chris Lu
09383860e9 HCFS recursively delete files 2018-12-04 22:57:23 -08:00
Chris Lu
060ce1d9a2 HCFS: adjust file modification time to milliseconds 2018-12-04 01:11:13 -08:00
Chris Lu
5f8c8caec6 HCFS: chmod 2018-12-04 01:10:25 -08:00
Chris Lu
d5197d6a50 HCFS support chown 2018-12-04 00:48:11 -08:00
Chris Lu
091f6297c4 add debug 2018-12-04 00:28:10 -08:00
Chris Lu
aea86cbf89 add @Override 2018-12-04 00:28:03 -08:00
Chris Lu
ce566f579e add juint 2018-12-03 22:12:31 -08:00
Chris Lu
c85ee7c0fd HCFS: read concatenated files 2018-12-03 22:12:20 -08:00
Chris Lu
4119c61df8 HCFS can read files 2018-12-03 20:25:57 -08:00
Chris Lu
5b50182658 put file is working 2018-12-03 01:37:29 -08:00
Chris Lu
d3be8e022f HCFS can ls, mkdir 2018-12-02 22:44:49 -08:00
Chris Lu
4263805c78 resolve java jar dependencies 2018-12-02 15:16:49 -08:00
Chris Lu
c6a567acab add SeaweedInputStream 2018-11-29 01:04:40 -08:00
Chris Lu
021f5d689b copy the visible chunks logic from Go implementation 2018-11-26 00:32:04 -08:00
Chris Lu
b089f1a492 SeaweedWrite close http client 2018-11-26 00:00:55 -08:00
Chris Lu
11eb014311 SeaweedFileSystem add SeaweedOutputStream to write 2018-11-25 23:49:05 -08:00
Chris Lu
f970abf14a WIP: adding SeaweedOutputStream for write 2018-11-25 18:01:57 -08:00
Chris Lu
6ecefad692 SeaweedFileSystem add rename 2018-11-25 14:48:17 -08:00
Chris Lu
1cbd53c01c WIP SeaweedFileSystem added mkdirs, getFileStatus, listStatus, delete 2018-11-25 13:43:26 -08:00
Chris Lu
d9871e92d2 adjust module name 2018-11-24 03:24:40 -08:00
Chris Lu
76cba561cf starting with hadoop compatible 2018-11-24 03:22:25 -08:00
Chris Lu
2697d6a4fb fix deleting bucket 2018-11-08 22:15:21 -08:00
Chris Lu
70008b093e test deletes 2018-11-08 22:08:11 -08:00
Chris Lu
a4ceb051a7 use MD5 for ETag to be consistent with Amazon S3 2018-11-08 21:41:02 -08:00
Chris Lu
f6d8525d1d working S3 multipart uploads 2018-09-12 00:46:12 -07:00
Chris Lu
73f331df84 add java example of copying to weed s3 end point 2018-09-02 14:19:24 -07:00