install kylin(#4 excute)

docker상에서 kylin 설치 그리고 superset으로 데이터 확인

1. 환경준비

    centos 7.6

    docker

2. kylin 설치 확인

## 지난 post(#2 kylin)에서 만들어진 docker images

[root@kylin client-conf]# docker images
REPOSITORY                TAG                 IMAGE ID            CREATED             SIZE
sungminyun/kylin-docker   101                 c2b10010123b        About an hour ago   2.98 GB
<none>                    <none>              2a2f553239a3        2 hours ago         714 MB
<none>                    <none>              0d2144e6aa11        2 hours ago         146 MB
<none>                    <none>              abf10a4befb2        2 hours ago         120 MB
<none>                    <none>              2c0f973a58ad        2 hours ago         256 MB
<none>                    <none>              3ec37054afd8        6 hours ago         2.14 GB
docker.io/ubuntu          16.04               5e13f8dd4c1a        3 weeks ago         120 MB
[root@kylin client-conf]#

## Kylin 서버를 시작.

[root@kylin kylin-docker]# docker run -i -t -p 7070:7070 sungminyun/kylin-docker:101 /etc/bootstrap.sh -bash
Retrieving hadoop conf dir...
KYLIN_HOME is set to /usr/local/kylin
-mkdir: java.net.UnknownHostException: MASTER-NODE-HOSTNAME
Usage: hadoop fs [generic options] -mkdir [-p] <path> ...
Failed to create /kylin. Please make sure the user has right to access /kylin

***change MASTER-NODE-HOSTNAME -> localhost 


***Error: EACCES: permission denied, scandir '/home/superset/superset/assets'

[root@kylin docker]# docker-compose up
WARNING: The Docker Engine you're using is running in swarm mode.

Compose does not use swarm mode to deploy services to multiple nodes in a swarm. All containers will be scheduled on the current node.

To deploy your application across the swarm, use `docker stack deploy`.

superset_postgres_1 is up-to-date
superset_redis_1 is up-to-date
Creating superset_superset_1 ... done
Attaching to superset_postgres_1, superset_redis_1, superset_superset_1
superset_1  | + '[' 0 -ne 0 ']'
superset_1  | + '[' development = development ']'
superset_1  | + celery worker --app=superset.sql_lab:celery_app --pool=gevent -Ofair
superset_1  | + cd superset/assets/
superset_1  | + npm ci
redis_1     | 1:C 18 Aug 14:57:22.683 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf
redis_1     |                 _._
redis_1     |            _.-``__ ''-._
redis_1     |       _.-``    `.  `_.  ''-._           Redis 3.2.12 (00000000/0) 64 bit
postgres_1  | The files belonging to this database system will be owned by user "postgres".
postgres_1  | This user must also own the server process.
postgres_1  | The database cluster will be initialized with locale "en_US.utf8".
redis_1     |   .-`` .-```.  ```\/    _.,_ ''-._
redis_1     |  (    '      ,       .-`  | `,    )     Running in standalone mode
postgres_1  | The default database encoding has accordingly been set to "UTF8".
postgres_1  | The default text search configuration will be set to "english".
postgres_1  | Data page checksums are disabled.
redis_1     |  |`-._`-...-` __...-.``-._|'` _.-'|     Port: 6379
redis_1     |  |    `-._   `._    /     _.-'    |     PID: 1
redis_1     |   `-._    `-._  `-./  _.-'    _.-'
redis_1     |  |`-._`-._    `-.__.-'    _.-'_.-'|
redis_1     |  |    `-._`-._        _.-'_.-'    |           http://redis.io
redis_1     |   `-._    `-._`-.__.-'_.-'    _.-'
redis_1     |  |`-._`-._    `-.__.-'    _.-'_.-'|
postgres_1  | fixing permissions on existing directory /var/lib/postgresql/data ... ok
redis_1     |  |    `-._`-._        _.-'_.-'    |
postgres_1  | creating subdirectories ... ok
redis_1     |   `-._    `-._`-.__.-'_.-'    _.-'
redis_1     |       `-._    `-.__.-'    _.-'
postgres_1  | selecting default max_connections ... 100
postgres_1  | selecting default shared_buffers ... 128MB
postgres_1  | selecting default timezone ... Etc/UTC
postgres_1  | selecting dynamic shared memory implementation ... posix
redis_1     |           `-._        _.-'
redis_1     |               `-.__.-'
postgres_1  | creating configuration files ... ok
postgres_1  | running bootstrap script ... ok
redis_1     | 1:M 18 Aug 14:57:22.689 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.
redis_1     | 1:M 18 Aug 14:57:22.690 # Server started, Redis version 3.2.12
redis_1     | 1:M 18 Aug 14:57:22.690 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
redis_1     | 1:M 18 Aug 14:57:22.690 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo never > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled.
redis_1     | 1:M 18 Aug 14:57:22.691 * The server is now ready to accept connections on port 6379
postgres_1  | performing post-bootstrap initialization ... ok
postgres_1  | syncing data to disk ... ok
postgres_1  | Success. You can now start the database server using:
postgres_1  |     pg_ctl -D /var/lib/postgresql/data -l logfile start
postgres_1  | WARNING: enabling "trust" authentication for local connections
postgres_1  | You can change this by editing pg_hba.conf or using the option -A, or
postgres_1  | --auth-local and --auth-host, the next time you run initdb.
postgres_1  | waiting for server to start....2019-08-18 14:57:25.395 UTC [44] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
postgres_1  | 2019-08-18 14:57:25.430 UTC [45] LOG:  database system was shut down at 2019-08-18 14:57:24 UTC
postgres_1  | 2019-08-18 14:57:25.439 UTC [44] LOG:  database system is ready to accept connections
postgres_1  |  done
postgres_1  | server started
postgres_1  | CREATE DATABASE
postgres_1  | /usr/local/bin/docker-entrypoint.sh: ignoring /docker-entrypoint-initdb.d/*
postgres_1  | waiting for server to shut down....2019-08-18 14:57:25.922 UTC [44] LOG:  received fast shutdown request
postgres_1  | 2019-08-18 14:57:25.925 UTC [44] LOG:  aborting any active transactions
postgres_1  | 2019-08-18 14:57:25.932 UTC [44] LOG:  worker process: logical replication launcher (PID 51) exited with exit code 1
postgres_1  | 2019-08-18 14:57:25.932 UTC [46] LOG:  shutting down
postgres_1  | 2019-08-18 14:57:25.953 UTC [44] LOG:  database system is shut down
postgres_1  |  done
postgres_1  | server stopped
postgres_1  | PostgreSQL init process complete; ready for start up.
postgres_1  | 2019-08-18 14:57:26.061 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
postgres_1  | 2019-08-18 14:57:26.061 UTC [1] LOG:  listening on IPv6 address "::", port 5432
postgres_1  | 2019-08-18 14:57:26.068 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
postgres_1  | 2019-08-18 14:57:26.113 UTC [62] LOG:  database system was shut down at 2019-08-18 14:57:25 UTC
postgres_1  | 2019-08-18 14:57:26.163 UTC [1] LOG:  database system is ready to accept connections
superset_1  | Error: EACCES: permission denied, scandir '/home/superset/superset/assets'