故障处理节点硬盘故障

  • 2020年10月2
  • 1回复
  • 1270的浏览量
R
排名
Userlevel 2
徽章 ＋４
  • raaji Nutanix员工
  • Nutanix员工
  • 70回复

当主机(SSD或HDD)上的驱动器出现可恢复错误、警告或完全的硬件故障时，星门服务将把该磁盘标记为坏磁盘。

当硬盘出现故障时，可以观察到以下现象:

  1. 在棱镜中圆盘为红色或纯灰色

  2. Prism中的一个严重错误，说明磁盘坏了。

故障排除步骤

  1. 确定Prism中有问题的磁盘。

    1. 请检查Prism web控制台是否有故障磁盘。在Diagram视图中，您可以看到红色或灰色的缺失磁盘。

    2. 在Prism web控制台中检查磁盘警报，或在集群中的任何工作cvm中使用以下命令检查已生成故障消息的磁盘。

ncli警报ls

  1. 检查磁盘是否被黑色平面识别。在显示磁盘故障的节点的cm上执行以下命令

list_diks

  1. 检查磁盘是否挂载在节点上。

df - h

  1. 使用NCC检查检查是否有离线磁盘disk_online_check．

NCC health_checks hardware_checks disk_checks disk_online_checks

  1. 使用如下命令检查磁盘的健康状态

sudo smartctl -H /dev/sdX(X可以是第3步中该磁盘的字母)

在更换驱动器之前，需要重新启动CVM，以正确显示驱动器失败，或如果它应该回来，可以进一步排除故障，并尝试使其联机

KB文章:

https://portal.nutanix.com/page/documents/kbs/details?targetId=kA0600000008USrCAM

Raaji
When a drive on a host (SSD or HDD) experiencing a recoverable errors, warnings or a complete hardware failure, the stargate service will mark the disk as bad.<\/span><\/p>

\u00a0<\/p>

The following can be observed when a disk fail occurs.<\/span><\/p>

  1. \t

    Disk is shown as a red\u00a0 or a plain grey in prism<\/span><\/p>\t<\/li>\t

  2. \t

    A critical error in Prism stating the disk went bad.<\/span><\/p>\t<\/li><\/ol>

    \u00a0<\/p>

    Troubleshooting steps<\/span><\/p>

    \u00a0<\/p>

    1. \t

      Identify the problematic disk in Prism.<\/span><\/p>\t

      1. \t\t

        Check the Prism web console for the failed disk. In the Diagram view, you can see red or grey for the missing disk.<\/span><\/p>\t\t<\/li>\t\t

      2. \t\t

        Check the alerts in the Prism web console for the disk alerts, or use the following command from any of the working CVMs in the cluster to check for disks that have generated the failure messages.<\/span><\/p>\t\t<\/li>\t<\/ol><\/li><\/ol>

        ncli alert ls<\/span><\/strong><\/p>

        1. \t

          Check to see if the disk is being recognized by the black plane. Execute the following command from the cm of the node that shows disk fail<\/span><\/p>\t<\/li><\/ol>

          list_diks<\/span><\/strong><\/p>

          1. \t

            Check to see if the disk is mounted on the node.<\/span><\/p>\t<\/li><\/ol>

            df -h<\/span><\/strong><\/p>

            1. \t

              Check for offline disks using NCC check <\/span>disk_online_check<\/strong>.<\/span><\/p>\t<\/li><\/ol>

              ncc health_checks hardware_checks disk_checks disk_online_checks<\/span><\/strong><\/p>

              1. \t

                Check the health status of the disk using the following command<\/span><\/p>\t<\/li><\/ol>

                sudo smartctl -H \/dev\/sdX<\/span><\/strong>\u00a0 (X can be an alphabet of this disk from step 3)<\/span><\/p>

                \u00a0<\/p>

                Before replacing the Drive a CVM reboot is needed to properly show the Drive as failed or if it should come back to be able to troubleshoot further and try to bring it online<\/span><\/p>

                \u00a0<\/p>

                KB Article:\u00a0<\/span><\/p>

                https:\/\/portal.nutanix.com\/page\/documents\/kbs\/details?targetId=kA0600000008USrCAM<\/span><\/p>","quoteUsername":"raaji","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote","Share":"Share"}}}">

1回复

DavidN
Userlevel 2
徽章 ＋４

如果磁盘被列为“tombstone”，是否仍然需要CVM重启(或任何这些命令/测试)或磁盘重置?

ncli磁盘ls-tombstone-entries

Is a CVM reboot (or any of these commands\/test) or a disk reseat still needed if the disk is listed as \u201ctombstoned\u201d?<\/p>

ncli disk ls-tombstone-entries<\/p>","quoteUsername":"DavidN","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote","Share":"Share"}}}">

回复


Baidu