mirror/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-12-22 08:07:55 +08:00
Code Issues Packages Projects Releases Wiki Activity
6,513 Commits 32 Branches 296 Tags 152 MiB
7336990639
Commit Graph

187 Commits

Author SHA1 Message Date
Chris Lu
d493d626ba use basic file object to parse path 
fix https://github.com/chrislusf/seaweedfs/issues/1825
 2021-02-21 19:27:38 -08:00
Chris Lu
821c46edf1 Merge branch 'master' into support_ssd_volume 2021-02-09 11:37:07 -08:00
Chris Lu
ad36c7b0d7 refactoring: only expose FilerClient class 2021-02-08 02:28:45 -08:00
Chris Lu
35ba277a97 Java: fix filerProxy mode 2021-02-05 22:43:56 -08:00
Chris Lu
8f3a51f2b8 Java: 1.5.8 additional fixes 2021-02-05 10:42:20 -08:00
Chris Lu
694df89331 java: add configurable volume access mode 2021-02-04 22:21:55 -08:00
Chris Lu
8c3177d835 java: resolve parent directory if started with seaweedfs:// 2021-02-04 21:41:19 -08:00
Chris Lu
9fa7977714 Java: SeaweedOutputStream refactoring 2021-02-04 20:30:49 -08:00
Chris Lu
ce416d765f Java: SeaweedOutputStream add replication option 2021-02-04 20:22:40 -08:00
Chris Lu
82c167aaca Java: supportFlush set to true 2021-02-04 20:18:33 -08:00
Chris Lu
7f90d14f10 Java: add SeaweedOutputStream example 2021-02-04 20:16:08 -08:00
Chris Lu
502554887f Java: add SeaweedInputStream example 2021-02-04 18:44:57 -08:00
Chris Lu
6f4aab51f9 refactoring SeaweedInputStream 2021-01-30 06:16:02 -08:00
Chris Lu
043c2d7960 refactoring SeaweedOutputStream 2021-01-30 05:39:09 -08:00
Chris Lu
94525aa0fd allocate volume by disk type 2020-12-13 23:08:21 -08:00
Chris Lu
0d2ec832e2 rename from volumeType to diskType 2020-12-13 11:59:32 -08:00
Chris Lu
e9cd798bd3 adding volume type 2020-12-13 00:58:58 -08:00
Chris Lu
3857f9c840 Hadoop: switch to ByteBuffer 
fix https://github.com/chrislusf/seaweedfs/issues/1645
 2020-12-02 23:45:39 -08:00
Chris Lu
f4abd01adf filer: cache small file to filer store 2020-11-30 04:34:04 -08:00
Chris Lu
dc304342b2 fs.configure: configurable volume growth 2020-11-17 01:00:02 -08:00
Chris Lu
5f19e81dab filer confi: support hierachical configuration 2020-11-16 16:50:12 -08:00
Chris Lu
fe01059675 volume id cache: reduce cache time 2020-11-15 21:27:21 -08:00
Chris Lu
61d96fde01 protect against edge cases when locations expires 2020-11-15 21:26:04 -08:00
Chris Lu
95c0de285d refactoring 2020-11-15 16:58:48 -08:00
Chris Lu
3e362451d2 add example of watch files 2020-11-13 12:10:55 -08:00
Chris Lu
a2962604ad add volume id cache 2020-11-12 23:25:11 -08:00
Chris Lu
a4dfa00030 adjust filer conf 2020-11-12 00:39:59 -08:00
Chris Lu
c32b6f4d9d prepare for path based configuration 2020-11-11 23:46:45 -08:00
Chris Lu
f375b93aef renaming 2020-10-25 15:32:43 -07:00
Chris Lu
596d476e3d HCFS: 1.5.2 2020-10-25 14:44:18 -07:00
Chris Lu
6c92fa349d filer: support default rack 
fix https://github.com/chrislusf/seaweedfs/issues/1546
 2020-10-20 17:41:39 -07:00
Chris Lu
ace0ea3d28 s3: avoid duplicated bucket 2020-10-15 10:52:20 -07:00
Chris Lu
d5fcb0f474 Hadoop: printout the entry creation error message 2020-10-11 15:11:16 -07:00
Chris Lu
ea13e0523b fix logging 2020-10-11 14:59:48 -07:00
Chris Lu
9449100757 adjust throwing exception 2020-10-10 01:06:54 -07:00
Chris Lu
d3d3609a03 adjust logging 2020-10-10 01:04:31 -07:00
Chris Lu
6fc272f913 adjust throwing exception 2020-10-10 01:03:04 -07:00
Chris Lu
00a75d7c99 Hadoop: fix reading file tail 2020-10-10 00:57:57 -07:00
Chris Lu
e1a3ffcdbf Hadoop: add exponential back off for failed reads 2020-10-10 00:57:57 -07:00
Chris Lu
1012df7bb5 switch hardlink id from int64 to bytes 2020-09-24 11:11:42 -07:00
Chris Lu
5e239afdfc hardlink works now 2020-09-24 03:06:48 -07:00
Chris Lu
cb427d48fa filer report metrics configuration 2020-09-17 06:46:51 -07:00
Chris Lu
387ab6796f filer: cross cluster synchronization 2020-09-09 11:21:23 -07:00
Chris Lu
bba90ff3c8 read filer signature 2020-09-05 22:52:15 -07:00
Chris Lu
ca658a97c5 add signatures to messages to avoid double processing 2020-08-28 23:48:48 -07:00
Chris Lu
13bfe5deef same logic for reading random access files from Go 2020-08-16 21:14:39 -07:00
Chris Lu
15dc0a704d Revert "add read ahead input stream" 
This reverts commit b3089dcc8e.
 2020-08-03 09:11:24 -07:00
Chris Lu
b3089dcc8e add read ahead input stream 2020-08-03 09:06:09 -07:00
Chris Lu
53190a9972 fix compilation 2020-08-03 09:05:49 -07:00
Chris Lu
d6073f6386 ensure GC 2020-08-03 00:40:23 -07:00
Chris Lu
9981748498 only try to cache chunk manifest chunks 2020-08-02 23:50:44 -07:00
Chris Lu
0ed1f43d29 decompress after decrypt if necessary 
skip any decompress error
 2020-08-02 23:50:23 -07:00
Chris Lu
e1f070a9a1 Hadoop: 1.4.4 2020-08-01 12:42:41 -07:00
Chris Lu
4d9da157bc HDFS: read gzip content 2020-08-01 11:36:29 -07:00
Chris Lu
8cc35e2c13 fix wrong decompression logic 2020-08-01 11:19:57 -07:00
Chris Lu
5080bc1d69 debug 2020-07-29 18:26:26 -07:00
Chris Lu
daf8c0c8ce cache vid locations 2020-07-29 18:25:52 -07:00
Chris Lu
b684c312d2 minor 2020-07-29 18:25:35 -07:00
Chris Lu
735912e0f5 enable read cache 2020-07-29 17:39:44 -07:00
Chris Lu
648ef566c4 HCFS: avoid lock bottleneck 2020-07-22 22:54:06 -07:00
Chris Lu
6839f96c0c simplify 2020-07-22 22:52:49 -07:00
Chris Lu
64926d2345 disable ChunkCache 2020-07-20 21:18:58 -07:00
Chris Lu
b380b9e5d7 shared http client 2020-07-20 18:27:11 -07:00
Chris Lu
0e341a2a9a error logging 2020-07-20 18:26:59 -07:00
Chris Lu
cacc601cc8 ensure changing buffer size requirements 2020-07-20 18:26:48 -07:00
Chris Lu
aee6d89350 before writing and after reading file chunks 2020-07-20 18:26:17 -07:00
Chris Lu
6debe3c3ec use 1000 as merge factor 2020-07-20 18:25:26 -07:00
Chris Lu
1d724ab237 hdfs: support read write chunk manifest 2020-07-20 03:29:17 -07:00
Chris Lu
d6d95765f9 reduce chunk cache size 2020-07-16 16:19:01 -07:00
Chris Lu
64d7d5fe89 increase inbound message size 2020-07-16 00:33:54 -07:00
Chris Lu
7bca72deed reuse bytebuffer 2020-07-15 23:33:31 -07:00
Chris Lu
2286d27730 rename 2020-07-15 14:19:15 -07:00
Chris Lu
86c8137546 1.3.4 2020-07-15 13:49:06 -07:00
Chris Lu
22f8aae028 fix compilation 2020-07-15 13:27:10 -07:00
Chris Lu
316e853e0e option to disable chunk cache 2020-07-15 09:51:51 -07:00
Chris Lu
0db4204c81 add is_file_chunks to filer.proto 2020-07-14 22:42:52 -07:00
Chris Lu
fc9af962ec 1.3.2 2020-07-12 14:51:24 -07:00
Chris Lu
4bd8f3281e 1.3.0 
* add option to include last entry
*
 2020-07-11 22:24:02 -07:00
Chris Lu
578f316173 refactoring 2020-07-11 15:33:31 -07:00
Chris Lu
70d8a3a1d3 add SubscribeLocalMetadata without checking persisted meta logs 2020-07-05 15:50:07 -07:00
Chris Lu
37d5b3ba12 replication: pass isFromOtherCluster also to EventNotification 
EventNotification is consistent with message queue and metadata logs.
 2020-07-01 08:06:20 -07:00
Chris Lu
31e23e9783 filer: support active<=>active filer replication 2020-06-30 22:53:57 -07:00
Chris Lu
97239ce6f1 rename filechunk is_gzipped to is_compressed 2020-06-20 08:15:49 -07:00
Chris Lu
ca3516ac6d adjust protoc 2020-06-20 08:00:25 -07:00
Chris Lu
222f93e816 possibly fix concurrent access to entry object in SeaweedOutputStream 2020-06-17 14:59:43 -07:00
Chris Lu
8dfaaeabfd HCFS: 1.2.8 fix hbase related bugs 
1. SeaweedFileSystem.listStatus need to work with file also
2. SeaweedRead readChunkView has wrong len
 2020-05-24 17:07:34 -07:00
Chris Lu
dfccc3c263 able to read chan and write chan 2020-05-08 02:47:22 -07:00
Chris Lu
1e3e4b3072 add broker connects to filer 2020-05-05 02:05:28 -07:00
Chris Lu
b52b8ec685 Hadoop: fix entry not found for HCFS 
also fix cipher related changes.
 2020-04-26 05:21:54 -07:00
Chris Lu
e24b25de78 async meta caching: can stream updates now 2020-04-21 21:16:13 -07:00
Chris Lu
bda82f61bc filer: able to append to a file 2020-04-17 02:28:09 -07:00
Chris Lu
7764e0465c refactoring 2020-04-12 21:00:55 -07:00
Chris Lu
6f948e4887 remove configurable topics folder location 2020-04-12 13:07:59 -07:00
Chris Lu
ec2eb8bc48 add If-None-Match and If-Modified-Since 
fix https://github.com/chrislusf/seaweedfs/issues/1269
 2020-04-08 08:12:00 -07:00
Chris Lu
2d43f85577 watch entries with common path prefix 2020-04-05 12:51:21 -07:00
Chris Lu
bf270d9e8c filer: able to tail meta data changes 2020-04-05 00:51:16 -07:00
Chris Lu
50a5018b7f writing meta logs is working 2020-03-30 01:19:33 -07:00
Chris Lu
b656e05aaf HDFS: support chunk cache 2020-03-29 00:55:40 -07:00
Chris Lu
ae2309dc58 Update SeaweedRead.java 2020-03-28 23:58:59 -07:00
Chris Lu
3d3bab2447 add notes 2020-03-28 23:43:24 -07:00