Docker sumologic/collector container causing problems with docker service

Follow

Gus Martinka

• January 05, 2018 17:43

After running my Docker host for a couple weeks and not having any problems I decided to use SumoLogic's collector to collect logs and stats. Everything ran well for about a week then the stats stopped coming in. I got on the Docker host and found that  "docker stats" returns "--" for every metric. Also, I can no longer run docker exec, stop, run or restart. I receive "Error response from daemon: Cannot restart container f1a1caecd816: Cannot kill container xxxxx: connection error: desc = "transport: dial unix /var/run/docker/containerd/docker-containerd.sock: connect: connection refused": unknown" for all those command on every container I have and new containers I try and run. The running containers still function fine, my collector is still supplying logs and my app is running fine. I found this topic where someone had the same error when running a script with docker commands. I have not restarted the Docker service yet because our app is processing data and I don't want to get stuck right now. Any help or ideas would be appreciated. Here is my docker info

Containers: 10
 Running: 10
 Paused: 0
 Stopped: 0
Images: 12
Server Version: 17.11.0-ce
Storage Driver: overlay2
 Backing Filesystem: extfs
 Supports d_type: true
 Native Overlay Diff: true
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
 Volume: local
 Network: bridge host macvlan null overlay
 Log: awslogs fluentd gcplogs gelf journald json-file logentries splunk syslog
Swarm: inactive
Runtimes: runc
Default Runtime: runc
Init Binary: docker-init
containerd version: N/A (expected: 992280e8e265f491f7a624ab82f3e238be086e49)
runc version: 0351df1c5a66838d0c392b4ac4cf9450de844e2d
init version: 949e6fa
Security Options:
 apparmor
 seccomp
  Profile: default
Kernel Version: 4.4.0-104-generic
Operating System: Ubuntu 16.04.3 LTS
OSType: linux
Architecture: x86_64
CPUs: 12
Total Memory: 120.7GiB
Name: mydockerserver
ID: xxxxxx
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): false
Registry: https://index.docker.io/v1/
Experimental: false
Insecure Registries:
 x.x.x.x
Live Restore Enabled: false

WARNING: No swap limit support

0

• 

  Harinder Bhandari

  • January 12, 2018 18:21

  Please try downgrading your collector to a lower than 19.209-23 version and see if that fixes docker stats issue. 

  1

  Comment actions Permalink
• 

  Gus Martinka

  • January 12, 2018 21:01

  Downgraded to 19.209-5 via the web ui and now my stats are working again. Thanks for the tip!.

   

   

  0

  Comment actions Permalink

Please sign in to leave a comment.