mirror/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-12-04 11:09:03 +08:00
Code Issues Packages Projects Releases Wiki Activity
10,765 Commits 32 Branches 296 Tags 149 MiB
545c3f83bf
Commit Graph

391 Commits

Author SHA1 Message Date
chrislu
4fd5f96598 filer: remove replication, collection, disk_type info from entry metadata 
these metadata can change and are not used
 2022-06-06 00:39:35 -07:00
chrislu
a2b101a737 subscribe metadata between a range 2022-05-30 15:04:19 -07:00
chrislu
ca16fbf0ef shell: cluster.ps display filer group 2022-05-29 16:37:14 -07:00
chrislu
b4be56bb3b add timing info during ping operation 2022-04-16 12:45:49 -07:00
Chris Lu
7a02fab289
Merge pull request #2910 from chrislusf/dependabot/maven/other/java/hdfs3/org.apache.hadoop-hadoop-common-3.2.3 
Bump hadoop-common from 3.1.4 to 3.2.3 in /other/java/hdfs3
 2022-04-13 12:22:02 -07:00
dependabot[bot]
1b1c8e4af5
Bump hadoop-common from 3.2.2 to 3.2.3 in /other/java/hdfs-over-ftp 
Bumps hadoop-common from 3.2.2 to 3.2.3.

---
updated-dependencies:
- dependency-name: org.apache.hadoop:hadoop-common
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-04-12 22:01:02 +00:00
dependabot[bot]
2c0e2e11df
Bump hadoop-common from 3.1.4 to 3.2.3 in /other/java/hdfs3 
Bumps hadoop-common from 3.1.4 to 3.2.3.

---
updated-dependencies:
- dependency-name: org.apache.hadoop:hadoop-common
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-04-12 22:00:58 +00:00
chrislu
743ad690b6 filer supports grpc ping 2022-04-01 16:44:58 -07:00
chrislu
4042fdf3bb rename to skipCheckParentDir 
related to https://github.com/chrislusf/seaweedfs/pull/2761

It's better to default to false.
 2022-03-16 23:55:31 -07:00
chrislu
be3fc77391 mount2: use consistent inode 2022-02-25 00:53:27 -08:00
chrislu
ceaf993a27 mount2: add rdev 2022-02-24 14:51:25 -08:00
Chris Lu
0c1f42f4eb
Merge pull request #2654 from chrislusf/dependabot/maven/other/java/hdfs3/org.apache.hadoop-hadoop-common-3.1.4 
Bump hadoop-common from 3.1.1 to 3.1.4 in /other/java/hdfs3
 2022-02-09 16:15:33 -08:00
Chris Lu
439f0f834d
Merge pull request #2655 from chrislusf/dependabot/maven/other/java/hdfs-over-ftp/org.apache.hadoop-hadoop-common-3.2.2 
Bump hadoop-common from 3.2.1 to 3.2.2 in /other/java/hdfs-over-ftp
 2022-02-09 16:15:21 -08:00
Chris Lu
47c04db9b3
Merge pull request #2656 from chrislusf/dependabot/maven/other/java/hdfs2/org.apache.hadoop-hadoop-common-2.10.1 
Bump hadoop-common from 2.9.2 to 2.10.1 in /other/java/hdfs2
 2022-02-09 16:15:06 -08:00
dependabot[bot]
7a5a717063
Bump hadoop-common from 2.9.2 to 2.10.1 in /other/java/examples 
Bumps hadoop-common from 2.9.2 to 2.10.1.

---
updated-dependencies:
- dependency-name: org.apache.hadoop:hadoop-common
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-02-09 22:35:39 +00:00
dependabot[bot]
f955096e92
Bump hadoop-common from 2.9.2 to 2.10.1 in /other/java/hdfs2 
Bumps hadoop-common from 2.9.2 to 2.10.1.

---
updated-dependencies:
- dependency-name: org.apache.hadoop:hadoop-common
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-02-09 22:32:07 +00:00
dependabot[bot]
2065715712
Bump hadoop-common from 3.2.1 to 3.2.2 in /other/java/hdfs-over-ftp 
Bumps hadoop-common from 3.2.1 to 3.2.2.

---
updated-dependencies:
- dependency-name: org.apache.hadoop:hadoop-common
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-02-09 22:29:49 +00:00
dependabot[bot]
1236efb039
Bump hadoop-common from 3.1.1 to 3.1.4 in /other/java/hdfs3 
Bumps hadoop-common from 3.1.1 to 3.1.4.

---
updated-dependencies:
- dependency-name: org.apache.hadoop:hadoop-common
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-02-09 22:29:27 +00:00
chrislu
b1063162b6 display bucket quota 2022-01-21 00:55:04 -08:00
chrislu
19555385f7 2.85 2022-01-09 19:30:23 -08:00
dependabot[bot]
46237ea31a
Bump protobuf-java from 3.9.1 to 3.16.1 in /other/java/client 
Bumps [protobuf-java](https://github.com/protocolbuffers/protobuf) from 3.9.1 to 3.16.1.
- [Release notes](https://github.com/protocolbuffers/protobuf/releases)
- [Changelog](https://github.com/protocolbuffers/protobuf/blob/master/generate_changelog.py)
- [Commits](https://github.com/protocolbuffers/protobuf/compare/v3.9.1...v3.16.1)

---
updated-dependencies:
- dependency-name: com.google.protobuf:protobuf-java
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-01-07 22:37:10 +00:00
chrislu
5799a20f71 2.84 2022-01-02 17:05:19 -08:00
chrislu
5c87fcc6d2 add client id for all metadata listening clients 2021-12-30 00:23:57 -08:00
banjiaojuhao
083bf3a137 filer server: add "datacenter, rack and datanode" for path specific configuration 2021-12-23 23:25:05 +08:00
Chris Lu
4e73705533
Merge pull request #2530 from banjiaojuhao/filer-upload-file-to-node 
filer server: allow upload file to specific dataNode
 2021-12-22 12:49:15 -08:00
banjiaojuhao
08336be92e filer server: allow upload file to specific dataNode 2021-12-22 21:57:26 +08:00
chrislu
8dca561bd1 adjust the name to be consistent 
comes from https://github.com/chrislusf/seaweedfs/pull/2511
 2021-12-14 19:39:08 -08:00
ErikCoder07
560a057941 feat: Added a volume heartbeat graph to grafana dashboard 
In the current dashboard there is no way to know the status of
volume servers, as prometheus only accepts push information, if
any server volume goes offline, the last information sent will
be read continuously by grafana.

Added a graph that calculates the delta between the information
of the last push timestamp with the timestamp of 15 seconds ago,
if the timestamp has not been changed, server state will be 0,
if volume server sent any information the server state will be 1.

-This graph will have to be modified if the time interval of pushs
is modified, a suggestion for improvement is to send the interval
in seconds along with the metrics.

-Only local tests were run, maybe if the latency between pushgateway
and volume server is too high, the delta calculation could be
affected.
 2021-12-14 20:24:00 -03:00
chrislu
5ea9715721 2.81 
also sync java client version to SeaweedFS version
 2021-12-05 18:05:24 -08:00
chrislu
df9a72b87f fix compilation 2021-12-05 17:24:13 -08:00
chrislu
c7c60d1f8a Java: add retry on write 2021-12-05 17:15:01 -08:00
Chris Lu
5ea86ef1da Revert "master: rename grpc function KeepConnected() to SubscribeVolumeLocationUpdates()" 
This reverts commit af71ae11aa.
 2021-11-05 17:52:15 -07:00
Chris Lu
6fb6480a3b Java: 1.7.0 
update org.apache.httpcomponents to 4.5.13
update grpc API to use cacheRemoteObjectToLocalCluster
 2021-11-03 01:36:26 -07:00
Chris Lu
af71ae11aa master: rename grpc function KeepConnected() to SubscribeVolumeLocationUpdates() 2021-11-03 01:09:48 -07:00
Chris Lu
24858507cc rename API to avoid confusion 2021-10-30 19:27:25 -07:00
Chris Lu
8cd7a0365b 1.6.9 2021-10-17 18:41:23 -07:00
Chris Lu
cca62fdb30 mount: streaming renaming folders 2021-10-17 04:22:42 -07:00
Chris Lu
7336990639 faster file read for large files 2021-10-16 16:03:16 -07:00
Chris Lu
5ca0a551ac java: adjust cache expiration policy for long running java processes 2021-10-09 05:38:15 -07:00
Chris Lu
20ac710ceb 2.68 2021-09-13 02:16:09 -07:00
Chris Lu
e5fc35ed0c change server address from string to a type 2021-09-12 22:47:52 -07:00
Chris Lu
0128239c0f handle ipv6 addresses 2021-09-07 16:43:54 -07:00
Chris Lu
fe4794fe92 minor 2021-09-06 11:40:51 -07:00
Chris Lu
728ed21a80 just in case 2021-09-06 11:39:10 -07:00
Chris Lu
9fb278c92c Hadoop: avoid case insensitive on windows 2021-09-06 11:33:56 -07:00
Chris Lu
43fd11278e support follow additional path prefixes 2021-08-31 23:23:08 -07:00
Chris Lu
05f32376eb add cluster id in filer configuration response 2021-08-29 21:02:10 -07:00
Chris Lu
268de45aa5 reset volume id cache if not found 2021-08-29 20:27:11 -07:00
nivekuil
a7383a8a1c grafana dashboard updates 2021-08-28 16:50:09 -07:00
Chris Lu
dc936921aa ensure the following logic are executed 2021-08-26 18:20:14 -07:00
Chris Lu
05a648bb96 refactor: separating out remote.proto 2021-08-26 15:18:34 -07:00
Chris Lu
c08ac536ed cloud drive: add support for Wasabi 
* disable md5, sha256 checking to avoid reading one chunk twice
* single threaded upload to avoid chunk swapping (to be enhanced later)
 2021-08-25 17:34:29 -07:00
Chris Lu
a7a914f120 cloud drive: add support for Baidu BOS 2021-08-24 23:46:33 -07:00
Chris Lu
a19c728034 cloud drive: add support for Tencent COS 2021-08-24 23:19:45 -07:00
Chris Lu
19a81d25af cloud drive: add support for Aliyun OSS 2021-08-24 23:14:24 -07:00
Chris Lu
47d775cf68 cloud drive: add support for BackBlaze 2021-08-24 22:30:06 -07:00
Chris Lu
e9ebe24f2e cloud drive: add support for Azure 2021-08-24 01:18:30 -07:00
Chris Lu
2ead7adaff Java: FilerProto.Entry can read size via attributes 2021-08-23 12:19:02 -07:00
Chris Lu
00c4e06caa cloud drive: s3 configurable force path style 2021-08-23 03:30:41 -07:00
Chris Lu
2836a58d87 cloud drive: S3 supports storage class 2021-08-23 02:18:59 -07:00
Chris Lu
258063de26 cloud drive: add google cloud storage 2021-08-23 00:29:27 -07:00
Chris Lu
3ada61c875 rename 2021-08-14 21:50:35 -07:00
Chris Lu
c34747c79d rename, fix wrong logic. 2021-08-14 21:46:34 -07:00
Chris Lu
e9128e75d0 Java: 1.6.7 Support Mounted Remote Storage 2021-08-09 22:46:12 -07:00
Chris Lu
713c035a6e shell: remote.cache remote.uncache 2021-08-09 14:35:18 -07:00
Chris Lu
46b0cb8c86 Merge branch 'master' into add_remote_storage 2021-08-07 15:41:27 -07:00
Chris Lu
d2b3416d1c java: use empty value as replication default 2021-08-07 14:54:00 -07:00
Chris Lu
899963ac20 remote storage location changed to struct 2021-07-29 02:08:55 -07:00
Chris Lu
1752eeb538 remote.mount saves the mapping 2021-07-27 03:26:35 -07:00
Chris Lu
4b94b03d90 directory to remote storage mapping 2021-07-27 01:16:28 -07:00
Chris Lu
99b599aa8a remote.mount 2021-07-26 22:53:44 -07:00
Chris Lu
70effac0d3 configure and store remote configurations 2021-07-21 02:24:34 -07:00
Chris Lu
450222dd64 add remote to filer.Entry and filer_pb entry, add RemoteConf 2021-07-19 02:47:27 -07:00
Chris Lu
8dc5def435 proto: add remote 2021-07-19 01:12:31 -07:00
Chris Lu
b194f91f47 add version to filer configuration response 2021-07-12 01:23:20 -07:00
Jerome Barotin
30156e142a Change java client MIN_BUFFER_SIZE to 1MB 2021-07-05 16:07:33 +02:00
Chris Lu
215b169562 mount: recursively rename locally 2021-07-01 01:19:31 -07:00
Jonas Falck
829b195084 Add process metrics of weed itself 2021-06-22 13:09:42 +02:00
Chris Lu
ab606dec2a filer: add path-specific option to enforce readonly 2021-06-04 01:03:41 -07:00
Chris Lu
2d85ffe7c5 java 1.6.6 2021-05-23 00:51:02 -07:00
Chris Lu
085a61cb8f minor 2021-05-21 01:50:20 -07:00
Chris Lu
4d0b894d37 Java Client: throw exception when assign fails 2021-05-21 01:49:25 -07:00
Chris Lu
2d237f7b50 Java client: fix passing replication value 2021-05-21 01:43:25 -07:00
Chris Lu
6c1c72b1f4 java client 1.6.5 2021-05-17 23:18:37 -07:00
Jérôme Barotin
89b2ef8d05 handle "/" in exist 2021-05-07 10:05:48 +02:00
Jérôme Barotin
a46be0ca56 Add exists() to java client 2021-05-07 09:33:03 +02:00
Chris Lu
9b5f54e367 java: filer client add modified time to touch() function 2021-05-06 11:38:23 -07:00
Chris Lu
28d58bac62 another simple example 2021-05-06 11:25:36 -07:00
Jérôme Barotin
9c97b17291 make SeaweedInputStream throw FileNotFoundException 2021-05-06 19:21:23 +02:00
limd
6b8892c5ac add HCFS over ftp 2021-04-06 13:42:51 +08:00
Chris Lu
a4db1fe32f patch https://github.com/advisories/GHSA-5mg8-w23w-74h3 
https://github.com/advisories/GHSA-5mg8-w23w-74h3
 2021-03-30 02:30:34 -07:00
dependabot[bot]
9401890f18
Bump guava from 28.0-jre to 29.0-jre in /other/java/client 
Bumps [guava](https://github.com/google/guava) from 28.0-jre to 29.0-jre.
- [Release notes](https://github.com/google/guava/releases)
- [Commits](https://github.com/google/guava/commits)

Signed-off-by: dependabot[bot] <support@github.com>
 2021-03-30 07:46:34 +00:00
Chris Lu
be25bc6766 Java client 1.6.4 2021-03-30 00:17:35 -07:00
Chris Lu
e72e3453e8 Java client: ByteBuffer.clear supports higher JDK versions 2021-03-29 21:42:28 -07:00
Chris Lu
5f0e68c21e revert wrong change 2021-03-22 23:28:40 -07:00
Chris Lu
b5e10bf511 Java client 1.6.3 2021-03-22 23:25:47 -07:00
Chris Lu
5a78c6ca99 Java client: support windows 2021-03-22 23:20:41 -07:00
Chris Lu
c276117fef Java: 1.6.2 2021-02-25 08:24:30 -08:00
Chris Lu
1d848641d7 Java client: ByteBuffer.clear supports higher JDK versions 
fix https://github.com/chrislusf/seaweedfs/issues/1836
 2021-02-24 07:40:37 -08:00
Chris Lu
d493d626ba use basic file object to parse path 
fix https://github.com/chrislusf/seaweedfs/issues/1825
 2021-02-21 19:27:38 -08:00