Commit Graph

71 Commits

Author SHA1 Message Date
Chris Lu
4d2855476c Hadoop: add BufferedByteBufferReadableInputStream
fix https://github.com/chrislusf/seaweedfs/issues/1645
2020-12-03 00:08:05 -08:00
Chris Lu
3857f9c840 Hadoop: switch to ByteBuffer
fix https://github.com/chrislusf/seaweedfs/issues/1645
2020-12-02 23:45:39 -08:00
Chris Lu
a9efaa6385 HDFS: implement ByteBufferReadable
fix https://github.com/chrislusf/seaweedfs/issues/1645
2020-12-01 17:20:31 -08:00
Chris Lu
f4abd01adf filer: cache small file to filer store 2020-11-30 04:34:04 -08:00
Chris Lu
da04bb3d1b 1.5.6 2020-11-18 01:46:38 -08:00
limd
4737df597d HCFS:
1. add replication parameter
2. fix close sequence
2020-11-17 19:05:57 +08:00
hilimd
218561c206
Merge pull request #37 from chrislusf/master
sync
2020-11-16 16:30:19 +08:00
Chris Lu
7d24980840 HCFS: 1.5.4 2020-11-13 11:37:53 -08:00
hilimd
a38efe2e7b
Merge pull request #35 from chrislusf/master
sync
2020-11-11 10:16:39 +08:00
Chris Lu
4f676aa7d3 2.09 2020-11-08 22:06:06 -08:00
hilimd
546f1bcb90
Merge pull request #34 from chrislusf/master
sync
2020-11-05 12:02:47 +08:00
Chris Lu
c709059b69 HCFS: add close() to SeaweedFileSystem.java 2020-11-03 00:46:00 -08:00
hilimd
843865f2ca
Merge pull request #33 from chrislusf/master
sync
2020-10-26 22:01:50 +08:00
Chris Lu
f375b93aef renaming 2020-10-25 15:32:43 -07:00
Chris Lu
596d476e3d HCFS: 1.5.2 2020-10-25 14:44:18 -07:00
hilimd
6e63e5eaf0
Merge pull request #29 from chrislusf/master
sync
2020-10-19 09:42:43 +08:00
Chris Lu
b7c224cf61 HCFS: 1.5.1 2020-10-18 14:30:01 -07:00
Chris Lu
459de70a77 Hadoop: more accurate block size 2020-10-18 14:13:46 -07:00
hilimd
a911375798
Merge pull request #26 from chrislusf/master
sync
2020-10-14 16:39:45 +08:00
Chris Lu
253323ce6d Hadoop 1.5.0 2020-10-12 11:13:38 -07:00
hilimd
2ff727a32d
Merge pull request #25 from chrislusf/master
sync
2020-10-12 11:01:13 +08:00
Chris Lu
8e2f3b510e Hadoop client: 1.4.9 2020-10-10 15:43:04 -07:00
hilimd
b9a446839a
Merge pull request #24 from chrislusf/master
sync
2020-10-10 16:20:26 +08:00
Chris Lu
912ef2bc53 Hadoop: remove unused variable bufferSize 2020-10-10 01:14:17 -07:00
hilimd
411e49f964
Merge pull request #23 from chrislusf/master
sync
2020-10-10 13:07:57 +08:00
limd
ac162fc857 hdfs: Hadoop on SeaweedFS: create empty file 2020-10-10 13:07:27 +08:00
Chris Lu
436ab7d811 HCFS: 1.4.8 2020-09-27 23:20:08 -07:00
Chris Lu
4929d0634e Hadoop on SeaweedFS: create empty file
fix https://github.com/chrislusf/seaweedfs/issues/1494
2020-09-25 10:57:43 -07:00
limd
95bfec4931 hadoop: filesystem cannot create file
issues: https://github.com/chrislusf/seaweedfs/issues/1494
2020-09-26 01:38:48 +08:00
Chris Lu
5eee4983f3 1.4.7 hdfs configurable fs.seaweed.buffer.size 2020-09-16 17:18:18 -07:00
Chris Lu
48ed7f8a32 generated files 2020-08-16 21:25:24 -07:00
Chris Lu
f5d6b8b777 Hadoop HCFS 1.4.6 random access file 2020-08-16 21:17:03 -07:00
Chris Lu
13bfe5deef same logic for reading random access files from Go 2020-08-16 21:14:39 -07:00
Chris Lu
4f195a54ca 1.4.5
change the scope for hadoop depencies to provided
2020-08-09 16:34:47 -07:00
Chris Lu
15dc0a704d Revert "add read ahead input stream"
This reverts commit b3089dcc8e.
2020-08-03 09:11:24 -07:00
Chris Lu
b3089dcc8e add read ahead input stream 2020-08-03 09:06:09 -07:00
Chris Lu
e1f070a9a1 Hadoop: 1.4.4 2020-08-01 12:42:41 -07:00
Chris Lu
6b41c5250b Hadoop file system: 1.4.3
added buffered fs input stream
2020-07-29 21:33:10 -07:00
Chris Lu
703057bff9 mirror changes from hdfs2 2020-07-29 20:15:43 -07:00
Chris Lu
6f058b3791 HCFS: 1.4.1 2020-07-22 22:56:53 -07:00
Chris Lu
6839f96c0c simplify 2020-07-22 22:52:49 -07:00
Chris Lu
54f9f9138e HCFS: 1.4.0 2020-07-20 23:25:08 -07:00
Chris Lu
ae3e6d8244 remove changing buffer size 2020-07-20 20:27:19 -07:00
Chris Lu
1d724ab237 hdfs: support read write chunk manifest 2020-07-20 03:29:17 -07:00
Chris Lu
f90d2c93c9 1.3.9 remove logs 2020-07-17 16:11:57 -07:00
Chris Lu
3abd74b1d7 1.3.8 2020-07-17 15:46:20 -07:00
Chris Lu
54445b207d Hadoop: 1.3.6 2020-07-16 16:20:01 -07:00
Chris Lu
2629da2cb9 simplify inputstream 2020-07-16 10:54:29 -07:00
李明达
74456b3d5e 1、Add SeaweedFS implementation of Hadoop AbstractFileSystem. The implementation delegates to the existing SeaweedFS FileSystem and is only necessary for use with Hadoop 2.x/3.x. Configuration example in Hadoop core-site.xml file:
<property>
    <name>fs.AbstractFileSystem.seaweedfs.impl</name>
    <value>seaweed.hdfs.SeaweedAbstractFileSystem</value>
 </property>

2、Fix hiveserver2 startup NullPointerException
2020-07-16 16:47:09 +08:00
Chris Lu
7bca72deed reuse bytebuffer 2020-07-15 23:33:31 -07:00