[Triumf-linux-managers] Problems with Centos-7.6 update on some DAQ machines

Thomas Lindner lindner at triumf.ca
Wed Dec 5 15:25:11 PST 2018 

Hi,

The Centos-7.6 update came out yesterday

https://lwn.net/Articles/773680/

On many DAQ machines this update was automatically installed around 5AM on Dec 4.  On most machines the update seemed to work ok, but I have at least two machines where the update seemed to go really wrong.  I'm finding it hard to be very certain about what is wrong, but here's a couple symptoms/clues:

1) The X-window (GNOME) crashed on the machines.  I tried to restart GNOME

systemctl restart gdm.service

but it didn't work.  system messages didn't provide me any clear clue:

Dec  5 11:53:44 daq03 systemd-logind: New session c4 of user gdm.
Dec  5 11:53:44 daq03 gdm: GdmDisplay: display lasted 0.249658 seconds
Dec  5 11:53:44 daq03 systemd-logind: Removed session c4.
< repeated lines>
Dec  5 11:53:44 daq03 gdm: GLib: g_variant_new_string: assertion 'string != NULL' failed
Dec  5 11:53:45 daq03 gdm: Child process -4877 was already dead.
Dec  5 11:53:45 daq03 gdm: Child process 4873 was already dead.
Dec  5 11:53:45 daq03 gdm: Unable to kill session worker process
Dec  5 11:53:45 daq03 gdm: GdmDisplay: display lasted 0.136216 seconds
Dec  5 11:53:45 daq03 gdm: GLib: g_variant_new_string: assertion 'string != NULL' failed
Dec  5 11:53:45 daq03 gdm: GdmLocalDisplayFactory: maximum number of X display failures reached: check X server log for errors


2) The ypbind service seemed to fail after the NetworkManager update:

Dec  4 04:55:29 daq10 yum[27323]: Updated: 1:NetworkManager-1.12.0-8.el7_6.x86_64
Dec  4 04:55:29 daq10 yum[27323]: Updated: 1:NetworkManager-wifi-1.12.0-8.el7_6.x86_64
Dec  4 04:55:29 daq10 dbus[909]: [system] Reloaded configuration
<snip>
Dec  4 04:56:59 daq10 systemd: rpc-statd.service stop-sigterm timed out. Killing.
Dec  4 04:56:59 daq10 systemd: rpc-statd.service: main process exited, code=killed, status=9/KILL
Dec  4 04:56:59 daq10 systemd: Stopped NFS status monitor for NFSv2/3 locking..
Dec  4 04:56:59 daq10 systemd: Unit rpc-statd.service entered failed state.
Dec  4 04:56:59 daq10 systemd: rpc-statd.service failed.
<snip>
Dec  4 04:56:59 daq10 systemd: Failed to start NIS/YP (Network Information Service) Clients to NIS Domain Binder.
Dec  4 04:56:59 daq10 systemd: Unit ypbind.service entered failed state.
Dec  4 04:56:59 daq10 systemd: ypbind.service failed.

Full message at end.

3) firewalld had failed, though it could be restarted

[root at daq10 ~]# systemctl status firewalld
● firewalld.service - firewalld - dynamic firewall daemon
   Loaded: loaded (/usr/lib/systemd/system/firewalld.service; enabled; vendor preset: enabled)
   Active: failed (Result: exit-code) since Tue 2018-12-04 04:58:34 PST; 1 day 5h ago
     Docs: man:firewalld(1)
 Main PID: 995 (code=exited, status=1/FAILURE)

Nov 20 21:55:20 daq10.triumf.ca systemd[1]: Starting firewalld - dynamic firewall daemon...
Nov 20 21:55:20 daq10.triumf.ca systemd[1]: Started firewalld - dynamic firewall daemon.
Dec 04 04:58:34 daq10.triumf.ca systemd[1]: firewalld.service: main process exited, code=exited, status=1/FAILURE
Dec 04 04:58:34 daq10.triumf.ca systemd[1]: Unit firewalld.service entered failed state.
Dec 04 04:58:34 daq10.triumf.ca systemd[1]: firewalld.service failed.


4) There are some error reports similar to this, though it is not clear that the problems are exactly the same.

https://www.centos.org/forums/viewtopic.php?t=69009
https://bugs.centos.org/view.php?id=15526
https://bugzilla.redhat.com/show_bug.cgi?id=1644933



I'm mostly confused about why the update was not a problem for most of our Centos-7.6 machines.  Both the machines affected were desktop machines, though certainly other desktop machines were ok.

Is anyone else having problems with this update?

Cheers,
Thomas



Full error message in log

Dec  4 04:55:29 daq10 yum[27323]: Updated: 1:NetworkManager-1.12.0-8.el7_6.x86_64
Dec  4 04:55:29 daq10 yum[27323]: Updated: 1:NetworkManager-wifi-1.12.0-8.el7_6.x86_64
Dec  4 04:55:29 daq10 dbus[909]: [system] Reloaded configuration
Dec  4 04:55:29 daq10 systemd: Reloading.
Dec  4 04:55:29 daq10 systemd: [/usr/lib/systemd/system/yum-autoupdate.service:11] Unknown lvalue 'ExecStopPre' in section 'Service'
Dec  4 04:55:29 daq10 systemd: Failed to reload: Address already in use
Dec  4 04:55:29 daq10 systemd: Reached target RPC Port Mapper.
Dec  4 04:55:29 daq10 systemd: Stopping NIS/YP (Network Information Service) Clients to NIS Domain Binder...
Dec  4 04:55:29 daq10 systemd: Stopping NFS status monitor for NFSv2/3 locking....
Dec  4 04:55:29 daq10 systemd: Stopped NFS status monitor for NFSv2/3 locking..
Dec  4 04:55:29 daq10 systemd: Starting Preprocess NFS configuration...
Dec  4 04:55:29 daq10 systemd: Started Preprocess NFS configuration.
Dec  4 04:55:29 daq10 systemd: Stopped NIS/YP (Network Information Service) Clients to NIS Domain Binder.
Dec  4 04:55:29 daq10 systemd: Stopping RPC bind service...
Dec  4 04:55:29 daq10 systemd: Stopped RPC bind service.
Dec  4 04:55:29 daq10 systemd: Listening on RPCbind Server Activation Socket.
Dec  4 04:55:29 daq10 systemd: Starting NFS status monitor for NFSv2/3 locking....
Dec  4 04:55:29 daq10 systemd: Starting RPC bind service...
Dec  4 04:55:29 daq10 systemd: Started RPC bind service.
Dec  4 04:55:29 daq10 systemd: Starting NIS/YP (Network Information Service) Clients to NIS Domain Binder...
Dec  4 04:55:29 daq10 systemd: Reloading.
Dec  4 04:55:29 daq10 rpc.statd[9555]: Version 1.3.0 starting
Dec  4 04:55:29 daq10 rpc.statd[9555]: Flags: TI-RPC
Dec  4 04:55:29 daq10 systemd: [/usr/lib/systemd/system/yum-autoupdate.service:11] Unknown lvalue 'ExecStopPre' in section 'Service'
Dec  4 04:55:29 daq10 systemd: Started NFS status monitor for NFSv2/3 locking..
Dec  4 04:55:29 daq10 systemd: Stopping RPC bind service...
Dec  4 04:55:29 daq10 systemd: Stopping NFS status monitor for NFSv2/3 locking....
Dec  4 04:55:29 daq10 systemd: Stopped RPC bind service.
Dec  4 04:55:29 daq10 setsebool: The allow_ypbind policy boolean was changed to 1 by root
Dec  4 04:55:29 daq10 dbus[7600]: avc:  received policyload notice (seqno=3)
Dec  4 04:55:29 daq10 dbus[14521]: avc:  received policyload notice (seqno=3)
Dec  4 04:55:29 daq10 dbus[7767]: avc:  received policyload notice (seqno=3)
Dec  4 04:55:29 daq10 dbus[14740]: avc:  received policyload notice (seqno=3)
Dec  4 04:56:27 daq10 journal: Error releasing name com.redhat.NewPrinterNotification: Timeout was reached
Dec  4 04:56:27 daq10 journal: Ignored exception from dbus method: Gio.IOErrorEnum: Timeout was reached
Dec  4 04:56:27 daq10 journal: Ignored exception from dbus method: Gio.IOErrorEnum: Timeout was reached
Dec  4 04:56:29 daq10 org.a11y.Bus: Reloaded configuration
Dec  4 04:56:29 daq10 org.a11y.Bus: Reloaded configuration
Dec  4 04:56:52 daq10 journal: Error releasing name com.redhat.PrinterDriversInstaller: Timeout was reached
Dec  4 04:56:59 daq10 systemd: rpc-statd.service stop-sigterm timed out. Killing.
Dec  4 04:56:59 daq10 systemd: rpc-statd.service: main process exited, code=killed, status=9/KILL
Dec  4 04:56:59 daq10 systemd: Stopped NFS status monitor for NFSv2/3 locking..
Dec  4 04:56:59 daq10 systemd: Unit rpc-statd.service entered failed state.
Dec  4 04:56:59 daq10 systemd: rpc-statd.service failed.
Dec  4 04:56:59 daq10 systemd: ypbind.service start operation timed out. Terminating.
Dec  4 04:56:59 daq10 systemd: Closed RPCbind Server Activation Socket.
Dec  4 04:56:59 daq10 systemd: Stopping RPCbind Server Activation Socket.
Dec  4 04:56:59 daq10 systemd: Listening on RPCbind Server Activation Socket.
Dec  4 04:56:59 daq10 systemd: Starting RPC bind service...
Dec  4 04:56:59 daq10 systemd: Starting Preprocess NFS configuration...
Dec  4 04:56:59 daq10 systemd: Started RPC bind service.
Dec  4 04:56:59 daq10 systemd: Started Preprocess NFS configuration.
Dec  4 04:56:59 daq10 systemd: Starting NFS status monitor for NFSv2/3 locking....
Dec  4 04:56:59 daq10 systemd: Failed to start NIS/YP (Network Information Service) Clients to NIS Domain Binder.
Dec  4 04:56:59 daq10 systemd: Unit ypbind.service entered failed state.
Dec  4 04:56:59 daq10 systemd: ypbind.service failed.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.triumf.ca/pipermail/triumf-linux-managers/attachments/20181205/699a1ab0/attachment-0001.html>

More information about the Triumf-linux-managers mailing list