When life's bad on Docker...

Russell Bateman
December 2018
last update:

This is where I'm going to jot down bad stuff that happens to me and how I fix it.

When life's bad on Docker...

I keep doing this to myself. I reboot, then the Filebeat container won't come up. I use a /tmp link to /home/russ/dev/logs. That's gone when I bounce my box and I forget to recreate it. Then, after despairing and begging for help, I see this:

[email protected]:~/dev/orchestration$ docker service ls
ID            NAME           MODE         REPLICAS  IMAGE
42uuxvag1d9g  acme-consul    replicated   1/1       server-containers-virtual.artifactory.acme.net/consul:latest
vplpdaol5q0s  acme-etcd      replicated   1/1       server-containers-virtual.artifactory.acme.net/coreos/etcd:latest
yyf85gi8qrnx  acme_filebeat  global       0/1       server-containers-virtual.artifactory.acme.net/acme-filebeat:latest
.
.
.
[email protected]:~/dev/orchestration$ docker service ps acme_filebeat
ID            NAME                                        DESIRED STATE  CURRENT STATE                     ERROR
6sxuqgstde6g  acme_filebeat.fw17z9s7l7lx5ukvcka04epzj     Ready          Preparing less than a second ago
qnnu4tainvq6  \_ acme_filebeat.fw17z9s7l7lx5ukvcka04epzj  Shutdown       Rejected 3 seconds ago            "invalid mount config for type..."
ytirpcbev5p9  \_ acme_filebeat.fw17z9s7l7lx5ukvcka04epzj  Shutdown       Rejected 8 seconds ago            "invalid mount config for type..."
sj5su4rc6r20  \_ acme_filebeat.fw17z9s7l7lx5ukvcka04epzj  Shutdown       Rejected 13 seconds ago           "invalid mount config for type..."
w0yze0zlqbmd  \_ acme_filebeat.fw17z9s7l7lx5ukvcka04epzj  Shutdown       Rejected 18 seconds ago           "invalid mount config for type..."

"Invalid mount config for type..." is code for, "Duh, are you trying to mount something that doesn't even exist?" It asks the question, "What's in your docker-compose.yaml file?"

More "when life's bad on Docker"...

I don't know how to look for every error yet:

task: non-zero exit(1)

Is this EPERM? I haven't changed anything; what does the container have no permissions to touch/do?

[email protected]:~/dev/orchestration$ docker service ps acme_filebeat
ID            NAME                                        IMAGE                      NODE   DESIRED STATE CURRENT STATE         ERROR
bmj1te600mbe  \_ acme_filebeat.fw17z9s7l7lx5ukvcka04epzj  .../acme-filebeat:latest   moria  Shutdown      Failed 2 seconds ago  "task: non-zero exit (1)"

Look at the container logs:

[email protected]:~/dev/orchestration$ docker-ps
e470135464dc  server-containers-virtual.artifactory.acme.net/acme-filebeat:latest   Created
6205b9d64e57  server-containers-virtual.artifactory.acme.net/acme-filebeat:latest   Exited (1) 5 seconds ago
2d8d8b49d933  server-containers-virtual.artifactory.acme.net/acme-filebeat:latest   Exited (1) 12 seconds ago
b18f849d2e78  server-containers-virtual.artifactory.acme.net/acme-filebeat:latest   Exited (1) 20 seconds ago
dd25165456af  server-containers-virtual.artifactory.acme.net/acme-filebeat:latest   Exited (1) 27 seconds ago
[email protected]:~/dev/orchestration$ docker logs 6205b9d64e57
.
.
.
2018-12-21T22:15:34.966Z  ERROR  instance/beat.go:743  Exiting: Error importing Kibana dashboards: fail to create the Kibana loader: Error creat...