From fbe969922cd054adc6ef9e65b96d58d23ac23554 Mon Sep 17 00:00:00 2001 From: boshen-dev <68277460+boshen-dev@users.noreply.github.com> Date: Wed, 2 Dec 2020 19:44:14 +0800 Subject: [PATCH] Updated Run Presto on SeaweedFS (markdown) --- Run-Presto-on-SeaweedFS.md | 38 +++++++++++++++++++++++++++++++++++++- 1 file changed, 37 insertions(+), 1 deletion(-) diff --git a/Run-Presto-on-SeaweedFS.md b/Run-Presto-on-SeaweedFS.md index 2595ca8..75b2b9a 100644 --- a/Run-Presto-on-SeaweedFS.md +++ b/Run-Presto-on-SeaweedFS.md @@ -51,5 +51,41 @@ Follow instructions for installation of Presto: ### Configure Presto to support SeaweedFS 1. Copy the seaweedfs-hadoop2-client-1.5.6.jar to Presto directory,for example: ``` -cp seaweedfs-hadoop2-client-1.5.6.jar /opt/presto-server-344/plugin/hive-hadoop2 +cp seaweedfs-hadoop2-client-1.5.6.jar /opt/presto-server-347/plugin/hive-hadoop2/ ``` +2. Modify core-site.xml + +modify /opt/presto-server-347/etc/catalog/core-site.xml to support SeaweedFS, 30888 is the filer port +``` + + + fs.defaultFS + seaweedfs://10.0.100.51:30888 + + + fs.seaweedfs.impl + seaweed.hdfs.SeaweedFileSystem + + + fs.AbstractFileSystem.seaweedfs.impl + seaweed.hdfs.SeaweedAbstractFileSystem + + + fs.seaweed.buffer.size + 4194304 + + + +``` +3. Modify hive.properties + +hive.metastore.uri is the service address of the previously deployed Hive Metastore +hive.config.resources points to the core-site.xml above +``` +connector.name=hive-hadoop2 +hive.metastore.uri=thrift://10.0.100.51:39768 +hive.allow-drop-table=true +hive.max-partitions-per-scan=1000000 +hive.compression-codec=NONE +hive.config.resources=/opt/presto-server-347/etc/catalog/core-site.xml +``` \ No newline at end of file