Commit Graph

388 Commits

Author SHA1 Message Date
chrislu
c4e862e908 3.23 2022-08-21 19:13:26 -07:00
chrislu
fa4d0093e1 3.22 2022-08-15 16:48:23 -07:00
chrislu
7c029b2183 3.21 2022-08-15 00:32:15 -07:00
chrislu
0854171d22 3.20 2022-08-07 14:42:28 -07:00
ginn13
28a1f42962
Helm chart monitoring improvements (#3406) 2022-08-04 09:08:40 -07:00
Kaiwalya Joshi
6e9d39ac72
feat: Add support for initContainers 2022-08-03 12:21:36 -07:00
chrislu
03c6f978f4 3.19 2022-07-31 17:16:51 -07:00
C2D
1c2c7a3a65 Added details on database requirements 2022-08-01 00:11:40 +00:00
Kaiwalya Joshi
f6e66f4a19
fix: Remove unused values. 2022-07-26 03:34:26 -07:00
Kaiwalya Joshi
1f99bb4e4e
feat: Add PVC Storage option for Master data and logs. 2022-07-26 03:27:41 -07:00
Kaiwalya Joshi
53e3536975
feat: Add PVC Storage option to Filer Logs. 2022-07-26 02:53:48 -07:00
chrislu
475185fb72 3.18 2022-07-25 22:41:38 -07:00
chrislu
dbe4849ffd 3.17 2022-07-24 18:46:50 -07:00
chrislu
56ec89625a 3.16 2022-07-18 00:53:05 -07:00
chrislu
93ccc6e05f 3.15 2022-07-11 00:50:07 -07:00
liubaojiang
106dd13306 fix the spelling error 2022-07-08 16:36:45 +08:00
chrislu
3c79c77056 3.14 2022-07-04 13:15:49 -07:00
chrislu
40a9634c3d 3.13 2022-06-26 20:13:52 -07:00
chrislu
4dc27e1ed5 3.12 2022-06-20 19:07:00 -07:00
chrislu
d4ef06cdcf 3.11 2022-06-14 12:14:52 -07:00
chrislu
e437ec5a68 3.10 2022-06-12 19:30:27 -07:00
chrislu
4a046e4de7 3.09 2022-06-05 19:00:24 -07:00
chrislu
8a49240d64 3.08 2022-05-31 11:57:41 -07:00
chrislu
fbd99d53c1 3.07 2022-05-31 00:36:24 -07:00
chrislu
2f846777bb 3.06 2022-05-23 01:21:48 -07:00
chrislu
acc318e12b 3.05 2022-05-22 21:43:59 -07:00
Kaiwalya Joshi
bee482d49e
fix: Remove invalid serviceName from s3-deployments template.
Remove `deployments.spec.serviceName` from the s3 deployment template.

`serviceName` isn't a valid field and causes issues when deploying the
chart.

This is the full output for `kubectl explain deployments.spec`
```
KIND:     Deployment
VERSION:  apps/v1

RESOURCE: spec <Object>

DESCRIPTION:
     Specification of the desired behavior of the Deployment.

     DeploymentSpec is the specification of the desired behavior of the
     Deployment.

FIELDS:
   minReadySeconds      <integer>
     Minimum number of seconds for which a newly created pod should be ready
     without any of its container crashing, for it to be considered available.
     Defaults to 0 (pod will be considered available as soon as it is ready)

   paused       <boolean>
     Indicates that the deployment is paused.

   progressDeadlineSeconds      <integer>
     The maximum time in seconds for a deployment to make progress before it is
     considered to be failed. The deployment controller will continue to process
     failed deployments and a condition with a ProgressDeadlineExceeded reason
     will be surfaced in the deployment status. Note that progress will not be
     estimated during the time a deployment is paused. Defaults to 600s.

   replicas     <integer>
     Number of desired pods. This is a pointer to distinguish between explicit
     zero and not specified. Defaults to 1.

   revisionHistoryLimit <integer>
     The number of old ReplicaSets to retain to allow rollback. This is a
     pointer to distinguish between explicit zero and not specified. Defaults to
     10.

   selector     <Object> -required-
     Label selector for pods. Existing ReplicaSets whose pods are selected by
     this will be the ones affected by this deployment. It must match the pod
     template's labels.

   strategy     <Object>
     The deployment strategy to use to replace existing pods with new ones.

   template     <Object> -required-
     Template describes the pods that will be created.
```
2022-05-19 15:01:27 -07:00
chrislu
9ff0d99002 3.04 2022-05-15 21:32:21 -07:00
chrislu
cd2d10118c 3.03 2022-05-15 18:17:07 -07:00
chrislu
a4ca3ed1f0 3.02 2022-05-08 22:28:32 -07:00
vincent
da2fe78ac2 fix filer helm pvc configuration 2022-05-07 14:47:13 +08:00
chrislu
73961e24d8 3.01 2022-05-01 23:33:45 -07:00
chrislu
2aef5b8b32 3.00 2022-04-24 21:46:03 -07:00
vincent
1093e8e6d7 fix filer using leveldb2 may lose data 2022-04-18 18:31:45 +08:00
chrislu
9ae66f55fc 2.99 2022-04-17 23:01:42 -07:00
chrislu
c6ec5269f4 2.98 2022-04-10 18:56:40 -07:00
chrislu
a9b4f0df04 default volumeSizeLimitMB to 1000
change it to 1GB, to be consistent with docker images. On k8s and docker, the initial disk spaces usually are not large enough, causing many new users asking about the "no free volume" question.
2022-04-10 13:23:55 -07:00
chrislu
71e837d6f1 remove old comment 2022-04-09 09:47:20 -07:00
chrislu
bc74b57a0b reduce volume size to increase volume count 2022-04-09 09:45:33 -07:00
chrislu
77a7d7253f 2.97 2022-04-03 19:08:01 -07:00
chrislu
0490ee87ef 2.96 2022-03-27 16:11:17 -07:00
chrislu
8f0410af2c 2.95 2022-03-21 01:47:03 -07:00
chrislu
2eda3a686f 2.94 2022-03-14 00:55:01 -07:00
chrislu
0ba4e4cd23 2.93 2022-03-06 18:54:12 -08:00
chrislu
ba14307319 2.92 2022-02-28 15:22:19 -08:00
dave-b-code
6a698713fa
Fix liveness and readiness probe endpoint
Uses endpoint from #2245
2022-02-27 15:01:18 +00:00
chrislu
09cd00f356 2.91 2022-02-27 04:03:39 -08:00
chrislu
497ebbbd45 2.90 2022-02-20 22:00:13 -08:00
chrislu
6a40fd1c65 2.89 2022-02-14 01:52:16 -08:00
Konstantin Lebedev
22a3ef56f2 graceful stop cluster http server default timeout 60 sec
https://github.com/chrislusf/seaweedfs/issues/2630
2022-02-08 13:07:28 +05:00
chrislu
7270067289 2.88 2022-01-30 20:25:26 -08:00
chrislu
e185d90d24 2.87 2022-01-23 16:18:55 -08:00
chrislu
9b77f0054e 2.86 2022-01-17 23:38:03 -08:00
chrislu
19555385f7 2.85 2022-01-09 19:30:23 -08:00
chrislu
5799a20f71 2.84 2022-01-02 17:05:19 -08:00
chrislu
c935b9669e 2.83 2021-12-25 01:01:34 -08:00
Konstantin Lebedev
761ffdc405 helm add auditLogConfig option 2021-12-14 18:05:22 +05:00
chrislu
c3b73ec23b 2.82 2021-12-12 23:25:24 -08:00
chrislu
5ea9715721 2.81
also sync java client version to SeaweedFS version
2021-12-05 18:05:24 -08:00
chrislu
73e3e77904 deprecate all cronjob module related code
related to https://github.com/chrislusf/seaweedfs/issues/2483
2021-12-05 01:20:47 -08:00
Chris Lu
7227cfddf5 2.80 2021-11-29 00:57:08 -08:00
zer0def
01558a0bd5 Update resource API versions up to K8S 1.22 2021-11-22 07:11:53 +01:00
Chris Lu
f3c789d662 2.79 2021-11-21 18:40:24 -08:00
Chris Lu
100c654ec3 2.78 2021-11-14 23:29:59 -08:00
Chris Lu
5cf332357b 2.77 2021-11-07 13:52:45 -08:00
Chris Lu
c4e22b5a9a filer: deprecate "-peers" option 2021-11-06 14:36:45 -07:00
Chris Lu
fc9e246592 2.76 2021-10-31 18:08:28 -07:00
Chris Lu
c9d3fb4a30 2.75 2021-10-24 18:15:59 -07:00
Chris Lu
182f43ae5f 2.74 2021-10-18 14:23:54 -07:00
Chris Lu
cd4fa7561b 2.73 2021-10-18 10:47:48 -07:00
Chris Lu
97c963bac9 2.72 2021-10-17 17:40:27 -07:00
Chris Lu
3d586be552 2.71 2021-10-10 22:40:44 -07:00
Janikio
ca04c59ac9
ignore ServiceMonitor when monitoring is disabled 2021-10-03 18:35:04 +02:00
Janikio
1d2dfe593c
added namespace to ingress 2021-10-03 18:34:47 +02:00
Chris Lu
ec3351a4ec adjust comments 2021-10-01 16:24:53 -07:00
Chris Lu
cee4d20bc1 2.70 2021-09-26 17:37:46 -07:00
Chris Lu
fa7c65bd4b 2.69 2021-09-19 21:44:06 -07:00
Chris Lu
20ac710ceb 2.68 2021-09-13 02:16:09 -07:00
Chris Lu
8c6d706328 2.67 2021-09-07 00:08:03 -07:00
Chris Lu
6022db6d6a 2.66 2021-09-05 16:21:14 -07:00
Chris Lu
bec3f63298 2.65 2021-08-28 05:27:33 -07:00
Chris Lu
95a6e0226d move readme 2021-08-23 13:37:40 -07:00
Chris Lu
7eeff1d8a1 rename directory 2021-08-23 13:37:09 -07:00
Chris Lu
ff7dc3b44c 2.64 2021-08-23 00:39:15 -07:00
Chris Lu
1f35d32be0 2.63 2021-08-15 23:14:59 -07:00
Chris Lu
8cfd487608 2.62 2021-08-08 23:33:12 -07:00
Chris Lu
56ee1d5ef1 2.61 2021-08-01 15:50:19 -07:00
Chris Lu
5dede5d38d 2.60 2021-07-25 22:09:09 -07:00
Chris Lu
a45bbc0b75 2.59 2021-07-15 15:52:22 -07:00
Chris Lu
297b41266b 2.58 2021-07-12 01:33:47 -07:00
Chris Lu
5bcc77b46c volume: default readMode to proxy 2021-07-03 15:55:56 -07:00
Chris Lu
f5fa0b08fd 2.57 2021-07-03 15:10:57 -07:00
Chris Lu
a2979aa051 2.56 2021-06-27 23:33:45 -07:00
Chris Lu
05af54ad10 2.55
trigger migrated travis build
2021-06-23 00:41:04 -07:00
Chris Lu
b3eb4fecc7 2.54 2021-06-19 03:48:15 -07:00
Chris Lu
7a81caa31e 2.53 2021-06-13 17:12:34 -07:00
Chris Lu
76f24af79a 2.52 2021-06-07 12:13:23 -07:00
Chris Lu
c8dea3dd89 2.51 2021-06-06 21:54:00 -07:00
陈杨文
5403ada150
use string version
the helm package will build number version  2.50 to 2.5
2021-06-05 21:54:33 +08:00
Chris Lu
4233ad3f07 2.50 2021-05-30 20:40:30 -07:00
Chris Lu
42fb03a66e 2.49 2021-05-23 00:51:47 -07:00
Chris Lu
45a762223a 2.48 2021-05-14 10:26:42 -07:00
Chris Lu
0f7b43af99 2.47 2021-05-11 10:12:15 -07:00
Chris Lu
4596e64710 2.46 2021-05-10 21:58:37 -07:00
Chris Lu
fe2edd4b50 2.45 2021-05-10 13:53:03 -07:00
Chris Lu
aa6949ef25 2.44 2021-05-09 23:28:48 -07:00
Chris Lu
c48ef78670 2.43 2021-05-01 00:39:04 -07:00
Chris Lu
84312e6799 2.42 2021-04-30 03:14:07 -07:00
Chris Lu
86185262bb 2.41 2021-04-24 16:54:36 -07:00
Chris Lu
e983f91b03 2.40 2021-04-18 13:58:01 -07:00
zhanghc
606c6ae8e8 fix volume-service helm template indentation 2021-04-14 18:58:32 +08:00
Chris Lu
742ab1ec81 2.39 2021-04-11 19:47:11 -07:00
Chris Lu
a37eca78cd 2.38 2021-04-05 19:41:54 -07:00
Chris Lu
6eee200c13 2.37 2021-04-04 18:45:48 -07:00
Chris Lu
6b7aa9633f 2.36 2021-03-28 19:09:06 -07:00
Chris Lu
1dd5bc134c 2.35 2021-03-22 00:05:09 -07:00
Chris Lu
9672f9e1b2 2.34 2021-03-16 03:01:15 -07:00
Chris Lu
91a3ac9731 2.33 2021-03-16 00:36:06 -07:00
Chris Lu
9f00f95bfb 2.32 2021-03-14 21:32:00 -07:00
Chris Lu
f5b5e4da2d 2.31 2021-03-09 12:52:16 -08:00
Chris Lu
d888e9a90f 2.30 2021-03-07 15:01:19 -08:00
Chris Lu
f29ae0db76 2.29 2021-02-28 18:08:26 -08:00
LazyDBA247-Anyvision
02be7ea2fc Volume:
PVC support + Host Path
idx support on ssd
2021-02-24 10:25:11 +02:00
LazyDBA247-Anyvision
b1b21e0564 make internal filter svc - internal k8s lb 2021-02-24 09:55:17 +02:00
LazyDBA247-Anyvision
9d6b6a4aea add filter Pattern only if configured 2021-02-24 09:54:42 +02:00
Chris Lu
37f104f88f 2.28 2021-02-22 22:54:34 -08:00
Chris Lu
151c281f36 2.27 2021-02-21 19:29:27 -08:00
Chris Lu
71f0c19515 2.26 2021-02-15 13:38:38 -08:00
Chris Lu
8726ef34c1 2.25 2021-02-14 22:23:43 -08:00
LazyDBA247-Anyvision
1a11967fd9 update README to be more k8s newbie friendly :) 2021-02-09 12:04:19 +02:00
LazyDBA247-Anyvision
73a31789b4 forgot to upload (git add) the s3 secret for auth (previous pr) 2021-02-09 12:03:44 +02:00
Chris Lu
a6e8d606b4 Update README.md 2021-02-09 00:30:19 -08:00
LazyDBA247-Anyvision
b373c1de93 remove collectionPattern if is empty string / null 2021-02-09 10:07:25 +02:00
LazyDBA247-Anyvision
259c66d978 volume: set minFreeSpacePercent to 7%
when k8s node have less than 5% free space, the k8s will start killing pods...
2021-02-09 09:57:09 +02:00
LazyDBA247-Anyvision
91a3314d36 filer/s3: enable/disable s3 and peers
enable/disable s3 pods
launch s3 in filer pod, to reduce network/latency between pods when using s3
disable/enable the peers option (with external backend DB is not needed)
added option to create s3 admin+read users
2021-02-09 09:55:58 +02:00
LazyDBA247-Anyvision
2646f5a784 cronjob: fix and update
enable/disable fix.replication & support for CollectionPrefix filtering
fix toleration and nodeSelector helm templating issues
2021-02-09 09:46:21 +02:00
LazyDBA247-Anyvision
b6fba0c03f filer: make k8s service ClusterIP type
easier to patch/expose ( probably LoadBalancer will be better, but that also works)
2021-02-09 09:43:55 +02:00
Chris Lu
5e4b5109dd 2.24 2021-02-07 22:29:43 -08:00
Chris Lu
318a3d2efc 2.23 2021-01-31 20:18:06 -08:00
Chris Lu
2c5eac5705 2.22 2021-01-24 14:06:09 -08:00
Chris Lu
c7197470fd 2.21 2021-01-18 01:25:04 -08:00
LazyDBA247-Anyvision
5581d08702 K8S mysql connection pool
set max lifetime to 10 minutes, keeping connection "fresh"
and eliminating mysql/memsql closing old connection (causing filer errors)
2021-01-14 09:48:12 +02:00
LazyDBA247-Anyvision
95982e0856 correct master service
should have also:
publishNotReadyAddresses: true
2021-01-13 22:27:27 +02:00
LazyDBA247-Anyvision
d595b35ca7 filer peers & client service
in order to start several filers with peers setting, they need to be discoverable by dns name, we need a service with
- tolerate-unready-endpoints: "true"
- publishNotReadyAddresses: true

so the filer will start and "See" each other...

added "client" service which expose only ready and line filer
changed s3 config to use the new service
2021-01-13 22:26:50 +02:00
LazyDBA247-Anyvision
c1ed647daf increase timeout
reduce unwanted k8s pod restarts on slow response
2021-01-13 22:23:44 +02:00
LazyDBA247-Anyvision
e57e6d6677 s3 logs
set logs to hostpath same as other pods
2021-01-13 22:18:24 +02:00
LazyDBA247-Anyvision
9ca1787e7e s3 allowEmptyFolder
enable setting allowEmptyFolder for s3 server
2021-01-13 22:17:34 +02:00
LazyDBA247-Anyvision
5e62f77681 dir.idx volume config
enable setting dir.idx for volume server
2021-01-13 22:16:39 +02:00
LazyDBA247-Anyvision
cfc2033bf8 shell.toml
enable running shell from each pod with default
filer & master config
2021-01-13 22:15:47 +02:00
LazyDBA247-Anyvision
8491fbf1c7 fix cronjob reschedule
avoid errors of "more than 100 jobs skipped/failed"
and stopping of job by k8s
2021-01-13 22:13:07 +02:00
LazyDBA247-Anyvision
8b55331247 appVersion
start publishing and using appVersion as the image tag,
so its clear that the appVersion of the chart and containers are the same.
2021-01-13 22:11:50 +02:00
Chris Lu
2ce86f308e 2.19 2021-01-03 17:24:02 -08:00
Chris Lu
d2ead72918 2.18 2020-12-28 12:37:10 -08:00
Chris Lu
515b7632d7 2.17 2020-12-25 23:58:22 -08:00
Chris Lu
6912bf94ae 2.16 2020-12-20 15:30:12 -08:00
Chris Lu
813453f3e1 2.15 2020-12-13 03:45:35 -08:00
Chris Lu
46b91228af 2.14 2020-12-06 18:56:58 -08:00
Chris Lu
0e99531dbf 2.13 2020-11-29 17:00:03 -08:00
Chris Lu
d3be2ceedd 2.12 2020-11-22 17:17:33 -08:00
Chris Lu
c13db8de80 remove deprecated options 2020-11-16 17:00:28 -08:00
Chris Lu
98827d68d9 2.11 2020-11-15 20:25:56 -08:00
Chris Lu
15956d8a8e 2.10 2020-11-10 23:17:13 -08:00
Chris Lu
4f676aa7d3 2.09 2020-11-08 22:06:06 -08:00
LazyDBA247-Anyvision
e7e3d8df7c fix reading the correct Values.yaml for s3 metricsPort 2020-11-08 02:07:47 +02:00
LazyDBA247-Anyvision
de277418bf remove extra curly brace
helm read/need only 2
2020-11-08 02:07:16 +02:00
LazyDBA247-Anyvision
5779265992 naming typo fix 2020-11-07 18:00:59 +02:00
LazyDBA247-Anyvision
e92780b91e grafana dashboard - use Helm Files.Get
easier to use "original" json without escaping and tabs
updated json to latest from:
https://raw.githubusercontent.com/chrislusf/seaweedfs/master/other/metrics/grafana_seaweedfs.json
2020-11-07 17:40:59 +02:00
Chris Lu
9b10d1ac33 2.08 2020-11-01 12:45:20 -08:00
Chris Lu
44921220b0 2.07 2020-10-25 22:03:46 -07:00
Chris Lu
27ba0a2be3 2.06 2020-10-25 12:36:47 -07:00
Konstantin Lebedev
186e42345e use collection optionaly 2020-10-25 20:34:55 +05:00
Konstantin Lebedev
3239425c19 use collection optionaly 2020-10-25 20:20:49 +05:00
Konstantin Lebedev
37e282e9a7 use dataCenter 2020-10-25 20:16:09 +05:00
Konstantin Lebedev
68c8d496d8 fix null 2020-10-25 20:11:58 +05:00
Konstantin Lebedev
c2fb1d2490 add k8s cronjob 2020-10-25 20:10:23 +05:00
Chris Lu
898db14729 2.05 2020-10-17 02:42:33 -07:00
Konstantin Lebedev
6f501a9f0e add service monitors 2020-10-15 18:10:22 +05:00
Chris Lu
bbd0afd37e 2.04 2020-10-11 21:25:30 -07:00
Chris Lu
4fc673341f 2.03 2020-10-04 21:58:22 -07:00
Chris Lu
f1e879fe7a 2.02 2020-10-01 07:15:49 -07:00
Chris Lu
75aca5e13d 2.01 2020-09-27 23:02:41 -07:00
Chris Lu
9cac9c4001 2.00 2020-09-20 00:47:04 -07:00
Chris Lu
f8fea19669 1.99 2020-09-12 13:46:33 -07:00
Chris Lu
ba984a4e29 1.98 2020-09-12 04:13:02 -07:00
Chris Lu
ab201c2798 1.97 2020-09-11 13:47:50 -07:00
Chris Lu
19537c9d21 1.96 2020-09-10 19:52:07 -07:00
Chris Lu
660d7c0edd 1.95 2020-09-10 01:32:05 -07:00
LazyDBA247-Anyvision
56a0e1c54f remove anyvision specific schema builder pod config 2020-09-10 09:29:00 +03:00
LazyDBA247-Anyvision
31fb2de957 fix grafana dashboard header 2020-09-10 09:28:21 +03:00
LazyDBA247-Anyvision
138e5918fb update and add options to the master statefulset & master cmd
support "global" setting for replication, effecting filer&master from "global" in values.yaml
2020-09-10 09:27:51 +03:00
LazyDBA247-Anyvision
2bed15f1dc update and add options to the filer statefulset & filer cmd 2020-09-10 09:26:12 +03:00
LazyDBA247-Anyvision
e73f0d4e81 change default livens & readiness probe timings to allow less pod restarts on large
clusters
2020-09-10 09:24:08 +03:00
LazyDBA247-Anyvision
229eeb8301 add more volume parameters and values in values.yaml & in sts of volume server 2020-09-10 09:21:09 +03:00
LazyDBA247-Anyvision
1d6c443b17 add podManagementPolicy to start all volume server in parallel
fix indent & remove spaces
2020-09-10 09:19:49 +03:00
Chris Lu
c18ea21f7a 1.94 2020-09-07 13:13:53 -07:00
Chris Lu
432fe3d926 1.93 2020-09-06 12:12:09 -07:00
Chris Lu
dd52037c27 1.92 2020-08-30 22:56:35 -07:00
Chris Lu
81a8aa6581 1.91 2020-08-23 17:28:40 -07:00
Chris Lu
ff200398bb 1.90 2020-08-16 21:18:50 -07:00
Chris Lu
b71df82292 1.89 2020-08-16 00:57:28 -07:00