Commit Graph

4136 Commits

Author SHA1 Message Date
Chris Lu
9981748498 only try to cache chunk manifest chunks 2020-08-02 23:50:44 -07:00
Chris Lu
0ed1f43d29 decompress after decrypt if necessary
skip any decompress error
2020-08-02 23:50:23 -07:00
Chris Lu
1b3a80dd3d non-fatal error 2020-08-01 13:46:52 -07:00
Chris Lu
bbbea8159c http request use gzip if possible 2020-08-01 13:20:52 -07:00
Chris Lu
2f03481cb2 in case when content is not compressed 2020-08-01 13:08:10 -07:00
Chris Lu
e1f070a9a1 Hadoop: 1.4.4 2020-08-01 12:42:41 -07:00
Chris Lu
4d9da157bc HDFS: read gzip content 2020-08-01 11:36:29 -07:00
Chris Lu
8cc35e2c13 fix wrong decompression logic 2020-08-01 11:19:57 -07:00
Chris Lu
49199c69d4 volume: avoid special logic for .gz files 2020-08-01 11:19:57 -07:00
Chris Lu
f89186a3cf better logging 2020-08-01 11:19:57 -07:00
Chris Lu
49d6dcfbc6 dynamically change the log level for reading the disk status 2020-08-01 11:19:57 -07:00
Chris Lu
90ddd7ec92
Merge pull request #1408 from hilimd/master
fix spark read s3 bug (sc.binaryFiles)
2020-08-01 00:13:00 -07:00
limd
b41b7ea4d0 fix spark read s3 bug (sc.binaryFiles) 2020-08-01 01:08:30 +08:00
hilimd
28764f237c
Merge pull request #9 from chrislusf/master
1.87
2020-08-01 01:04:17 +08:00
Chris Lu
a6b59d50f7 1.87 2020-07-30 13:52:04 -07:00
hilimd
d48c53f5eb
Merge pull request #8 from chrislusf/master
Hadoop file system: 1.4.3
2020-07-30 13:36:53 +08:00
Chris Lu
6b41c5250b Hadoop file system: 1.4.3
added buffered fs input stream
2020-07-29 21:33:10 -07:00
hilimd
d9af6e851b
Merge pull request #7 from chrislusf/master
sync
2020-07-30 11:43:00 +08:00
Chris Lu
703057bff9 mirror changes from hdfs2 2020-07-29 20:15:43 -07:00
Chris Lu
a6d0f962e8 add buffered seaweed input stream 2020-07-29 20:10:04 -07:00
hilimd
4a88cca543
Merge pull request #6 from chrislusf/master
sync
2020-07-30 09:46:44 +08:00
Chris Lu
5080bc1d69 debug 2020-07-29 18:26:26 -07:00
Chris Lu
daf8c0c8ce cache vid locations 2020-07-29 18:25:52 -07:00
Chris Lu
b684c312d2 minor 2020-07-29 18:25:35 -07:00
Chris Lu
735912e0f5 enable read cache 2020-07-29 17:39:44 -07:00
Chris Lu
6095b4c407
Merge pull request #1406 from mwpeterson/add-5byte-arm-builds
add 5-byte large disk builds for arm and arm64
2020-07-29 14:29:35 -07:00
mwpeterson
80fb139a10 add 5_byte_arm63 to release 2020-07-29 14:07:04 -04:00
mwpeterson
9f6ecfbd42 add 5-byte large disk builds for arm and arm64 2020-07-28 15:57:49 -04:00
Chris Lu
eed525b717 FUSE mount: remove DirListCacheLimit
outdated parameter
2020-07-28 09:24:39 -07:00
Chris Lu
a566bfc6e1 s3: use bucket in the domain
fix https://github.com/chrislusf/seaweedfs/issues/1405
2020-07-28 08:47:27 -07:00
Chris Lu
bfa07af326
Merge pull request #1404 from hilimd/master
S3 PutObject: fix create folder bug
2020-07-27 10:35:37 -07:00
limd
92c32f9d46 PutObject: fix create folder bug 2020-07-28 00:58:42 +08:00
hilimd
f9ba5cd986
Merge pull request #5 from chrislusf/master
sync
2020-07-28 00:50:50 +08:00
Chris Lu
37e964d4bd update gorilla mux 2020-07-26 14:08:22 -07:00
Chris Lu
54cd582653 refactor 2020-07-26 12:58:58 -07:00
Chris Lu
c50ec1599c auth for presigned put object part 2020-07-26 12:09:50 -07:00
Chris Lu
ea0180de4e auth for presigned put operation 2020-07-26 12:06:45 -07:00
Chris Lu
3faa0aa448 rename 2020-07-25 20:09:19 -07:00
Chris Lu
023a1efdf2 set filename in Content-Disposition header 2020-07-25 20:06:40 -07:00
Chris Lu
54eebf538f
Merge pull request #1402 from popstk/master
fix s3api bug
2020-07-25 10:08:23 -07:00
popstk
a09fcfcf20 fix s3api auth bug 2020-07-25 17:14:49 +08:00
popstk
feb52400be fix s3api copy object handler SerializationError 2020-07-25 15:52:31 +08:00
Chris Lu
fa0e2ff498
Update README.md 2020-07-24 22:26:33 -07:00
Chris Lu
48f60a370d
Update README.md 2020-07-24 14:22:36 -07:00
Chris Lu
f4abe284ae adjust go.mod
seems not useful any more
2020-07-24 10:18:44 -07:00
Chris Lu
d40de39e75 FUSE: do not change crtime, uid, gid on save 2020-07-24 10:13:45 -07:00
Chris Lu
8dfeba8023 FUSE: skip changing to empty uid and gid during flush
Skip uid and gid changes if request uid and gid are zero

mongodb lock file, and many interim files, has empty uid and gid

I0724 10:05:51 93643 filehandle.go:173] /db/diagnostic.data/metrics.interim fh 1333342842031408359 flush Flush [ID=0x3 Node=0x50 Uid=0 Gid=0 Pid=178] 0x10 fl=0x0 lk=0x0
2020-07-24 10:06:43 -07:00
Chris Lu
dd29b8c81d fix compilation 2020-07-24 09:36:05 -07:00
Chris Lu
5788f1f6bf remove fsnode cache
fix https://github.com/chrislusf/seaweedfs/issues/1400
2020-07-24 09:25:54 -07:00
Chris Lu
6962ca48d3 fix compilation 2020-07-23 21:31:23 -07:00