Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

False address already in use #47944

Open
Tohjuler opened this issue Jun 10, 2024 · 2 comments
Open

False address already in use #47944

Tohjuler opened this issue Jun 10, 2024 · 2 comments
Labels
area/networking/portmapping area/networking kind/bug Bugs are bugs. The cause may or may not be known at triage time so debugging may be needed. status/0-triage version/26.1

Comments

@Tohjuler
Copy link

Description

After a restart of my server, some containers can't start because of Address already in use, but they ran fine before the restart.
And sudo lsof -i -P -n | grep LISTEN says that the port is not in use.

The bug has been there since 26.0.0, but sometime it will be fixed by restarting the server.
I haven't seen this bug on any other server.
I am considering reinstalling the server, but wanted to share the bug first.

Reproduce

docker start

Expected behavior

No response

docker version

Client: Docker Engine - Community
 Version:           26.1.4
 API version:       1.45
 Go version:        go1.21.11
 Git commit:        5650f9b
 Built:             Wed Jun  5 11:29:35 2024
 OS/Arch:           linux/arm64
 Context:           default

Server: Docker Engine - Community
 Engine:
  Version:          26.1.4
  API version:      1.45 (minimum version 1.24)
  Go version:       go1.21.11
  Git commit:       de5c9cf
  Built:            Wed Jun  5 11:29:35 2024
  OS/Arch:          linux/arm64
  Experimental:     true
 containerd:
  Version:          1.6.33
  GitCommit:        d2d58213f83a351ca8f528a95fbd145f5654e957
 runc:
  Version:          1.1.12
  GitCommit:        v1.1.12-0-g51d5e94
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0

docker info

Client: Docker Engine - Community
 Version:    26.1.4
 Context:    default
 Debug Mode: false
 Plugins:
  buildx: Docker Buildx (Docker Inc.)
    Version:  v0.14.1
    Path:     /usr/libexec/docker/cli-plugins/docker-buildx
  compose: Docker Compose (Docker Inc.)
    Version:  v2.27.1
    Path:     /usr/libexec/docker/cli-plugins/docker-compose

Server:
 Containers: 37
  Running: 32
  Paused: 0
  Stopped: 5
 Images: 42
 Server Version: 26.1.4
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Using metacopy: false
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: systemd
 Cgroup Version: 2
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog
 Swarm: inactive
 Runtimes: io.containerd.runc.v2 runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: d2d58213f83a351ca8f528a95fbd145f5654e957
 runc version: v1.1.12-0-g51d5e94
 init version: de40ad0
 Security Options:
  apparmor
  seccomp
   Profile: builtin
  cgroupns
 Kernel Version: 5.15.0-112-generic
 Operating System: Ubuntu 22.04.4 LTS
 OSType: linux
 Architecture: aarch64
 CPUs: 4
 Total Memory: 7.556GiB
 Name: ub-8gb-fsn-P-Web
 ID: 03f37f8c-27b4-4c92-a3d5-f4ffd2e2fc39
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 Experimental: true
 Insecure Registries:
  127.0.0.0/8
 Live Restore Enabled: false

Additional Info

Here is the output from docker inspect on one of the effected containers:

[
    {
        "Id": "cadd4b9aef4c463dfd10d95d82c5c1206fe50b09597f71015e8ddd0eec08eadb",
        "Created": "2024-06-05T18:56:00.114436094Z",
        "Path": "docker-entrypoint.sh",
        "Args": [
            "postgres"
        ],
        "State": {
            "Status": "exited",
            "Running": false,
            "Paused": false,
            "Restarting": false,
            "OOMKilled": false,
            "Dead": false,
            "Pid": 0,
            "ExitCode": 0,
            "Error": "",
            "StartedAt": "2024-06-05T18:56:00.398613396Z",
            "FinishedAt": "2024-06-09T00:00:42.756934746Z"
        },
        "Image": "sha256:f701604050b1a8d036bdaf899d2189602d4acd7d4f396d079c364194512c8b85",
        "ResolvConfPath": "/var/lib/docker/containers/cadd4b9aef4c463dfd10d95d82c5c1206fe50b09597f71015e8ddd0eec08eadb/resolv.conf",
        "HostnamePath": "/var/lib/docker/containers/cadd4b9aef4c463dfd10d95d82c5c1206fe50b09597f71015e8ddd0eec08eadb/hostname",
        "HostsPath": "/var/lib/docker/containers/cadd4b9aef4c463dfd10d95d82c5c1206fe50b09597f71015e8ddd0eec08eadb/hosts",
        "LogPath": "/var/lib/docker/containers/cadd4b9aef4c463dfd10d95d82c5c1206fe50b09597f71015e8ddd0eec08eadb/cadd4b9aef4c463dfd10d95d82c5c1206fe50b09597f71015e8ddd0eec08eadb-json.log",
        "Name": "/postgres",
        "RestartCount": 0,
        "Driver": "overlay2",
        "Platform": "linux",
        "MountLabel": "",
        "ProcessLabel": "",
        "AppArmorProfile": "docker-default",
        "ExecIDs": null,
        "HostConfig": {
            "Binds": null,
            "ContainerIDFile": "",
            "LogConfig": {
                "Type": "json-file",
                "Config": {
                    "max-file": "3",
                    "max-size": "10m"
                }
            },
            "NetworkMode": "postgres_default",
            "PortBindings": {
                "5432/tcp": [
                    {
                        "HostIp": "",
                        "HostPort": "5432"
                    }
                ]
            },
            "RestartPolicy": {
                "Name": "no",
                "MaximumRetryCount": 0
            },
            "AutoRemove": false,
            "VolumeDriver": "",
            "VolumesFrom": null,
            "ConsoleSize": [
                0,
                0
            ],
            "CapAdd": null,
            "CapDrop": null,
            "CgroupnsMode": "private",
            "Dns": [],
            "DnsOptions": [],
            "DnsSearch": [],
            "ExtraHosts": [],
            "GroupAdd": null,
            "IpcMode": "private",
            "Cgroup": "",
            "Links": null,
            "OomScoreAdj": 0,
            "PidMode": "",
            "Privileged": false,
            "PublishAllPorts": false,
            "ReadonlyRootfs": false,
            "SecurityOpt": null,
            "UTSMode": "",
            "UsernsMode": "",
            "ShmSize": 67108864,
            "Runtime": "runc",
            "Isolation": "",
            "CpuShares": 0,
            "Memory": 0,
            "NanoCpus": 0,
            "CgroupParent": "",
            "BlkioWeight": 0,
            "BlkioWeightDevice": null,
            "BlkioDeviceReadBps": null,
            "BlkioDeviceWriteBps": null,
            "BlkioDeviceReadIOps": null,
            "BlkioDeviceWriteIOps": null,
            "CpuPeriod": 0,
            "CpuQuota": 0,
            "CpuRealtimePeriod": 0,
            "CpuRealtimeRuntime": 0,
            "CpusetCpus": "",
            "CpusetMems": "",
            "Devices": null,
            "DeviceCgroupRules": null,
            "DeviceRequests": null,
            "MemoryReservation": 0,
            "MemorySwap": 0,
            "MemorySwappiness": null,
            "OomKillDisable": null,
            "PidsLimit": null,
            "Ulimits": null,
            "CpuCount": 0,
            "CpuPercent": 0,
            "IOMaximumIOps": 0,
            "IOMaximumBandwidth": 0,
            "Mounts": [
                {
                    "Type": "volume",
                    "Source": "postgres_db",
                    "Target": "/var/lib/postgresql/data",
                    "VolumeOptions": {}
                }
            ],
            "MaskedPaths": [
                "/proc/asound",
                "/proc/acpi",
                "/proc/kcore",
                "/proc/keys",
                "/proc/latency_stats",
                "/proc/timer_list",
                "/proc/timer_stats",
                "/proc/sched_debug",
                "/proc/scsi",
                "/sys/firmware",
                "/sys/devices/virtual/powercap"
            ],
            "ReadonlyPaths": [
                "/proc/bus",
                "/proc/fs",
                "/proc/irq",
                "/proc/sys",
                "/proc/sysrq-trigger"
            ]
        },
        "GraphDriver": {
            "Data": {
                "LowerDir": "/var/lib/docker/overlay2/c8f23c263763f80e4d23b72f8f5b4844c1b472b91f0f76430f282e6256d19c14-init/diff:/var/lib/docker/overlay2/1f05fae6e17dace84573debe2273972f89128f8821095019b0fd632d0253c79d/diff:/var/lib/docker/overlay2/33f2cae499ad411ccf29cf65a8b8b07a5644cfa15315abdbc8f14a562bc6dc9e/diff:/var/lib/docker/overlay2/232aaeb01c0a952f3a60f3964bd4562a97acee0ba4d9ad7e0c49d147aef8cd36/diff:/var/lib/docker/overlay2/d11ba90786c313ad4e3c1d560c7b5016b386f60e7592a27514b9f0a85a771399/diff:/var/lib/docker/overlay2/207064b213eb4780295f6ac698f27ccf4cc983e796c6bdf68f47f0b743815349/diff:/var/lib/docker/overlay2/e6ab57dcee61cc32974ab7446a4c7f3c955b768a00e9504facda462299ce7026/diff:/var/lib/docker/overlay2/0eaba95c9b2d0b1227b10d3394ae7355f1fc6ec9790db073fd8d7269409edb30/diff:/var/lib/docker/overlay2/6ba5de9f4afe52bf304c385f3e98b880f792065bcee810d6cf92e086c19f9292/diff:/var/lib/docker/overlay2/ec2ec138d21729525e8169cf14a65c8e19b15a03b8e63ad9009b119406634b83/diff:/var/lib/docker/overlay2/41f8ea1649217a82d53c398b115a361d80f560666723fe00e37076092b2ac035/diff:/var/lib/docker/overlay2/1ac9e1babac59bb59b7b041c22009aa5bda3896227550ea8bf9a78c8aa66d3f0/diff:/var/lib/docker/overlay2/bc6a363a3ccc5a71c3243ad48079f1159407967aef74b0bc85057d9051f42d72/diff:/var/lib/docker/overlay2/c39a5dc941c4bf9392b5d51121d8829ecefbbf4daac4741b0b046d9ba36a7b25/diff:/var/lib/docker/overlay2/4391f814b422c9a60fd1e15fdc3743e8a81133f1e8d3168c22deb6b5de4cb74e/diff",
                "MergedDir": "/var/lib/docker/overlay2/c8f23c263763f80e4d23b72f8f5b4844c1b472b91f0f76430f282e6256d19c14/merged",
                "UpperDir": "/var/lib/docker/overlay2/c8f23c263763f80e4d23b72f8f5b4844c1b472b91f0f76430f282e6256d19c14/diff",
                "WorkDir": "/var/lib/docker/overlay2/c8f23c263763f80e4d23b72f8f5b4844c1b472b91f0f76430f282e6256d19c14/work"
            },
            "Name": "overlay2"
        },
        "Mounts": [
            {
                "Type": "volume",
                "Name": "postgres_db",
                "Source": "/var/lib/docker/volumes/postgres_db/_data",
                "Destination": "/var/lib/postgresql/data",
                "Driver": "local",
                "Mode": "z",
                "RW": true,
                "Propagation": ""
            }
        ],
        "Config": {
            "Hostname": "cadd4b9aef4c",
            "Domainname": "",
            "User": "",
            "AttachStdin": false,
            "AttachStdout": true,
            "AttachStderr": true,
            "ExposedPorts": {
                "5432/tcp": {}
            },
            "Tty": false,
            "OpenStdin": false,
            "StdinOnce": false,
            "Env": [
                "POSTGRES_DB=aninotify",
                "POSTGRES_USER=admin",
                "POSTGRES_PASSWORD=mbd_vtz8thr_bvh7FBR",
                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/lib/postgresql/16/bin",
                "GOSU_VERSION=1.17",
                "LANG=en_US.utf8",
                "PG_MAJOR=16",
                "PG_VERSION=16.3-1.pgdg120+1",
                "PGDATA=/var/lib/postgresql/data"
            ],
            "Cmd": [
                "postgres"
            ],
            "Image": "postgres:latest",
            "Volumes": {
                "/var/lib/postgresql/data": {}
            },
            "WorkingDir": "",
            "Entrypoint": [
                "docker-entrypoint.sh"
            ],
            "OnBuild": null,
            "Labels": {
                "com.docker.compose.config-hash": "b5c07aab92c06fb265df8b12ae23cee235ba48ae5e7408f770d8ec4d049736c2",
                "com.docker.compose.container-number": "1",
                "com.docker.compose.depends_on": "",
                "com.docker.compose.image": "sha256:f701604050b1a8d036bdaf899d2189602d4acd7d4f396d079c364194512c8b85",
                "com.docker.compose.oneoff": "False",
                "com.docker.compose.project": "postgres",
                "com.docker.compose.project.config_files": "/opt/stacks/postgres/compose.yaml",
                "com.docker.compose.project.working_dir": "/opt/stacks/postgres",
                "com.docker.compose.service": "postgres",
                "com.docker.compose.version": "2.21.0"
            },
            "StopSignal": "SIGINT"
        },
        "NetworkSettings": {
            "Bridge": "",
            "SandboxID": "481b146be58d23695ab866b7b9ba5c3a86b9a291c40a55b75a3024dbcfd894b6",
            "SandboxKey": "/var/run/docker/netns/481b146be58d",
            "Ports": {},
            "HairpinMode": false,
            "LinkLocalIPv6Address": "",
            "LinkLocalIPv6PrefixLen": 0,
            "SecondaryIPAddresses": null,
            "SecondaryIPv6Addresses": null,
            "EndpointID": "",
            "Gateway": "",
            "GlobalIPv6Address": "",
            "GlobalIPv6PrefixLen": 0,
            "IPAddress": "",
            "IPPrefixLen": 0,
            "IPv6Gateway": "",
            "MacAddress": "",
            "Networks": {
                "postgres_default": {
                    "IPAMConfig": null,
                    "Links": null,
                    "Aliases": [
                        "postgres",
                        "postgres"
                    ],
                    "MacAddress": "",
                    "NetworkID": "41195c13da2fd73cc99330cfdbc5e82980b023aef1d68e9f83d04efdd7f8181d",
                    "EndpointID": "",
                    "Gateway": "",
                    "IPAddress": "",
                    "IPPrefixLen": 0,
                    "IPv6Gateway": "",
                    "GlobalIPv6Address": "",
                    "GlobalIPv6PrefixLen": 0,
                    "DriverOpts": null,
                    "DNSNames": [
                        "postgres",
                        "cadd4b9aef4c"
                    ]
                }
            }
        }
    }
]

I was told to run sudo ss -tlpn 'sport = :5432' with one of the affected ports, but it did not list anything.
@Tohjuler Tohjuler added kind/bug Bugs are bugs. The cause may or may not be known at triage time so debugging may be needed. status/0-triage labels Jun 10, 2024
@thaJeztah thaJeztah mentioned this issue Jun 10, 2024
Closed
@akerouanton
Copy link
Member

Hi @Tohjuler, could you please enable debug mode (see here: https://docs.docker.com/config/daemon/logs/#enable-debugging) and post all revelant logs you find?

@Tohjuler
Copy link
Author

This is the debug info from one of the containers that can't start

Jun 14 15:08:49 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:49.958275539+02:00" level=debug msg="Calling POST /containers/1144d402810e140df1976774619221b73eb119b62bb61edae565ce1877539794/start" spanID=f57eef0ff94344f4 traceID=9a1b07340b8e6a894392971e51e89b>
Jun 14 15:08:49 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:49.958371020+02:00" level=debug msg="form data: {}" spanID=f57eef0ff94344f4 traceID=9a1b07340b8e6a894392971e51e89bd7
Jun 14 15:08:49 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:49.962975373+02:00" level=debug msg="container mounted via layerStore: /var/lib/docker/overlay2/724c224b16aa530b8b95572833c5d8ebb314ff3ce5195c9757dfaa77052217bc/merged" container=1144d402810e140df>
Jun 14 15:08:49 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:49.963286855+02:00" level=debug msg="Assigning addresses for endpoint pihole-unbound's interface on network bridge"
Jun 14 15:08:49 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:49.963317896+02:00" level=debug msg="RequestAddress(LocalDefault/172.17.0.0/16, <nil>, map[])"
Jun 14 15:08:49 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:49.963351936+02:00" level=debug msg="Request address PoolID:172.17.0.0/16 Bits: 65536, Unselected: 65530, Sequence: (0xf8000000, 1)->(0x0, 2046)->(0x1, 1)->end Curr:6 Serial:false PrefAddress:inva>
Jun 14 15:08:49 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:49.969882704+02:00" level=debug msg="Assigning addresses for endpoint pihole-unbound's interface on network bridge"
Jun 14 15:08:49 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:49.970075985+02:00" level=debug msg="RequestAddress(LocalDefault/fd00:dead:beef:c0::/80, fd00:dead:beef:c0:0:242:ac11:3, map[])"
Jun 14 15:08:49 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:49.970191386+02:00" level=debug msg="Request address PoolID:fd00:dead:beef:c0::/80 Bits: 281474976710656, Unselected: 281474976710651, Sequence: (0xc0000000, 1)->(0x0, 77668059135)->(0x38000000, 1>
Jun 14 15:08:49 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:49.973501450+02:00" level=debug msg="Calling GET /v1.45/containers/json" spanID=46449ffbca046948 traceID=9ad356f69eebe1a1fda046ed7aff4f60
Jun 14 15:08:50 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:50.002976745+02:00" level=debug msg="Calling GET /v1.45/info" spanID=eab1c6352b6335f3 traceID=6211de8906edc067c2af29a8c0555fd3
Jun 14 15:08:50 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:50.011535207+02:00" level=debug msg="Calling GET /v1.45/images/json" spanID=68e3f3d905faf644 traceID=88019a4f1e2d2741af7f37508643ac1d
Jun 14 15:08:50 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:50.019609986+02:00" level=debug msg="Calling GET /v1.45/containers/json?all=1&filters=%7B%22health%22%3A%7B%22healthy%22%3Atrue%7D%7D" spanID=89de5c0022cc1b94 traceID=7cbc8010028e48beb77e7c96b815d>
Jun 14 15:08:50 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:50.022297286+02:00" level=debug msg="Calling GET /v1.45/containers/json?all=1&filters=%7B%22health%22%3A%7B%22unhealthy%22%3Atrue%7D%7D" spanID=baa2055d980d198b traceID=37838012b7850cbd3953b48fa72>
Jun 14 15:08:50 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:50.023735656+02:00" level=debug msg="Calling GET /v1.45/containers/json?all=1&filters=%7B%22health%22%3A%7B%22starting%22%3Atrue%7D%7D" spanID=edad4419017d722f traceID=c0969602387329abd0d35c472fb3>
Jun 14 15:08:50 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:50.024516182+02:00" level=debug msg="Calling GET /v1.45/containers/json?all=1&filters=%7B%22health%22%3A%7B%22none%22%3Atrue%7D%7D" spanID=5ef25539e4679f4b traceID=114fd08817c981ee6ed319e37989a54d
Jun 14 15:08:50 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:50.025892872+02:00" level=debug msg="Releasing addresses for endpoint pihole-unbound's interface on network bridge"
Jun 14 15:08:50 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:50.026136554+02:00" level=debug msg="ReleaseAddress(LocalDefault/172.17.0.0/16, 172.17.0.5)"
Jun 14 15:08:50 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:50.026169514+02:00" level=debug msg="Released address Address:172.17.0.5 Sequence:Bits: 65536, Unselected: 65530, Sequence: (0xf8000000, 1)->(0x0, 2046)->(0x1, 1)->end Curr:6"
Jun 14 15:08:50 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:50.026180594+02:00" level=debug msg="ReleaseAddress(, fd00:dead:beef:c0:0:242:ac11:3)"
Jun 14 15:08:50 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:50.026195434+02:00" level=warning msg="Failed to release ip address fd00:dead:beef:c0:0:242:ac11:3 on delete of endpoint pihole-unbound (28dbbd4b726292f8f65a8fcf557c2f39c39c88b738842db725bb15b5e75>
Jun 14 15:08:50 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:50.030247624+02:00" level=warning msg="error locating sandbox id d2738beed4af0e7b0a36fa9165784ae74caa7384343cff8dfde99474c0c80d3b: sandbox d2738beed4af0e7b0a36fa9165784ae74caa7384343cff8dfde99474c>
Jun 14 15:08:50 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:50.993472765+02:00" level=debug msg="Running health check for container 06bd055971c8945282f4a20fff72fdf62fa17af40f3830daac1c74084336f717 ..."
Jun 14 15:08:50 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:50.993931729+02:00" level=debug msg="starting exec command 25a5596f7dd02c5ef90214ed94fb2137179543dfa3d5b2f2eb7a5f32a577b4eb in container 06bd055971c8945282f4a20fff72fdf62fa17af40f3830daac1c7408433>
Jun 14 15:08:50 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:50.995802822+02:00" level=debug msg="attach: stdout: begin"
Jun 14 15:08:50 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:50.995845743+02:00" level=debug msg="attach: stderr: begin"
Jun 14 15:08:50 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:50.997736237+02:00" level=debug msg=event module=libcontainerd namespace=moby topic=/tasks/exec-added
Jun 14 15:08:51 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:51.000797339+02:00" level=debug msg="Calling GET /v1.45/info" spanID=c97fbb530573d632 traceID=c4088ec78cf722ef8c2faa25b72d9eda
Jun 14 15:08:51 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:51.017985064+02:00" level=debug msg="Calling GET /v1.45/images/json" spanID=0fe03b320fdcca28 traceID=fe5285c0449d6ed33bac5a53d5848faf
Jun 14 15:08:51 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:51.025667000+02:00" level=debug msg=event module=libcontainerd namespace=moby topic=/tasks/exec-started
Jun 14 15:08:51 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:51.026052763+02:00" level=debug msg="Calling GET /v1.45/containers/json?all=1&filters=%7B%22health%22%3A%7B%22healthy%22%3Atrue%7D%7D" spanID=9b32a309774d805d traceID=0be0cbdcf2c5b6c679b4cc81e19c3>
Jun 14 15:08:51 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:51.028515021+02:00" level=debug msg="Calling GET /v1.45/containers/json?all=1&filters=%7B%22health%22%3A%7B%22unhealthy%22%3Atrue%7D%7D" spanID=a066e7d5ecec6d14 traceID=4cab9238533c8b7f982c4671981>
Jun 14 15:08:51 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:51.029626189+02:00" level=debug msg="Calling GET /v1.45/containers/json?all=1&filters=%7B%22health%22%3A%7B%22starting%22%3Atrue%7D%7D" spanID=f2b90fd1c71e7d52 traceID=e86c6a46b3d166c04c5a97639d77>
Jun 14 15:08:51 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:51.030339594+02:00" level=debug msg="Calling GET /v1.45/containers/json?all=1&filters=%7B%22health%22%3A%7B%22none%22%3Atrue%7D%7D" spanID=a4f05827a387da78 traceID=491d091f8b14461f3246a9fb1c69bd90
Jun 14 15:08:51 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:51.372984532+02:00" level=debug msg="Name To resolve: dockerapi." spanID=dc8183af847e8e0b traceID=8eac84f75f84c7b5fb4f93ebd4e9b9d3
Jun 14 15:08:51 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:51.373119973+02:00" level=debug msg="[resolver] lookup for dockerapi.: IP [172.22.1.10]" spanID=dc8183af847e8e0b traceID=8eac84f75f84c7b5fb4f93ebd4e9b9d3
Jun 14 15:08:51 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:51.372999772+02:00" level=debug msg="Name To resolve: dockerapi." spanID=6c2fe79eb3cb5135 traceID=a79f54a139789c205d6f76abb79e59c9
Jun 14 15:08:51 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:51.373284934+02:00" level=debug msg="[resolver] lookup for dockerapi.: IP [fd4d:6169:6c63:6f77::c]" spanID=6c2fe79eb3cb5135 traceID=a79f54a139789c205d6f76abb79e59c9
Jun 14 15:08:52 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:52.000922429+02:00" level=debug msg="Calling GET /v1.45/info" spanID=f545c17e062377ef traceID=d81496edd927bac313c5064c330302f6
Jun 14 15:08:52 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:52.011032703+02:00" level=debug msg="Calling GET /v1.45/images/json" spanID=ecda2e45a98c0e8f traceID=c4cb701c82118057d9c53ce3246c9e74
Jun 14 15:08:52 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:52.019881927+02:00" level=debug msg="Calling GET /v1.45/containers/json?all=1&filters=%7B%22health%22%3A%7B%22healthy%22%3Atrue%7D%7D" spanID=0f240ffa68cf3d35 traceID=a4251dfb5a094002c1cb09021b8ea>
Jun 14 15:08:52 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:52.022120304+02:00" level=debug msg="Calling GET /v1.45/containers/json?all=1&filters=%7B%22health%22%3A%7B%22unhealthy%22%3Atrue%7D%7D" spanID=50f22149c2023ac2 traceID=e6dd1bbd5712f1ff1885991e400>
Jun 14 15:08:52 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:52.023369113+02:00" level=debug msg="Calling GET /v1.45/containers/json?all=1&filters=%7B%22health%22%3A%7B%22starting%22%3Atrue%7D%7D" spanID=0c58bd093a3f07fc traceID=7576ba138209853d2b4435f79523>
Jun 14 15:08:52 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:52.024169959+02:00" level=debug msg="Calling GET /v1.45/containers/json?all=1&filters=%7B%22health%22%3A%7B%22none%22%3Atrue%7D%7D" spanID=2d7beaefaa9117ae traceID=f492424ca8362078ebacd940697b2a86
Jun 14 15:08:52 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:52.462933037+02:00" level=debug msg="Running health check for container 1c8b6cbb74374b3a025f7c34c94ed60eb0efcdd661f22a2da0443d345ceace0d ..."
Jun 14 15:08:52 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:52.463100078+02:00" level=debug msg="starting exec command aca1a6d989190dba5853f6fe251b03f7dd12e701411ead6c857a9519409ea1f9 in container 1c8b6cbb74374b3a025f7c34c94ed60eb0efcdd661f22a2da0443d345ce>
Jun 14 15:08:52 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:52.464688370+02:00" level=debug msg="attach: stdout: begin"
Jun 14 15:08:52 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:52.464764570+02:00" level=debug msg="attach: stderr: begin"
Jun 14 15:08:52 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:52.465873378+02:00" level=debug msg=event module=libcontainerd namespace=moby topic=/tasks/exec-added
Jun 14 15:08:52 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:52.497259567+02:00" level=debug msg=event module=libcontainerd namespace=moby topic=/tasks/exec-started
Jun 14 15:08:52 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:52.508079046+02:00" level=debug msg=event module=libcontainerd namespace=moby topic=/tasks/exit
Jun 14 15:08:52 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:52.508179647+02:00" level=debug msg="attach: stdout: end"
Jun 14 15:08:52 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:52.508224167+02:00" level=debug msg="attach: stderr: end"
Jun 14 15:08:52 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:52.508244927+02:00" level=debug msg="attach done"
Jun 14 15:08:52 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:52.508296968+02:00" level=debug msg="Health check for container 1c8b6cbb74374b3a025f7c34c94ed60eb0efcdd661f22a2da0443d345ceace0d done (exitCode=0)"
Jun 14 15:08:52 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:52.774042585+02:00" level=debug msg="Name To resolve: redis." spanID=da9aed71c31a6205 traceID=a60ed00467061e1c28057296a23a1589
Jun 14 15:08:52 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:52.774163505+02:00" level=debug msg="Name To resolve: redis." spanID=1f270cc0bad7d069 traceID=3d59606698e056b69b36237f4a21660a
Jun 14 15:08:52 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:52.774284786+02:00" level=debug msg="[resolver] lookup for redis.: IP [172.22.1.249]" spanID=1f270cc0bad7d069 traceID=3d59606698e056b69b36237f4a21660a
Jun 14 15:08:52 ub-8gb-fsn-P-Web dockerd[1067]: time="2024-06-14T15:08:52.774304186+02:00" level=debug msg="[resolver] lookup for redis.: IP [fd4d:6169:6c63:6f77::6]" spanID=da9aed71c31a6205 traceID=a60ed00467061e1c28057296a23a1589

Can it be because DNSStubListener is disabled?
The container that the logs is from is my pi-hole container that uses the 53 port.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area/networking/portmapping area/networking kind/bug Bugs are bugs. The cause may or may not be known at triage time so debugging may be needed. status/0-triage version/26.1
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@akerouanton @thaJeztah @Tohjuler