On Linux kernel version 7.0.0-42-generic, it appears the network card driver bnxt_en is unstable. About an hour after the weekly reboot today, the network card driver crashes, yielding the machine itself and virtual machines unreachable.

A temporary reload of the affected module caused the same crash within a few minutes.

We rolled back to 7.0.0-38-generic, which seems to be more stable.

Affected virtual machines:

  • zulip1
  • icsd24
  • goldengate
  • jupyter24
  • ldap4
  • geronimo
  • web2

Update 14:45

It appears we’re running into this issue that has been fixed in the patch bnxt_en: fix DMA mapping length for padded small packets.

Unfortunately, this patch has not yet been backported to the Ubuntu 24.04 kernel (it has landed in 26.04). We’re considering upgrading the vmhost09 to Ubuntu 26 in the near future.