解决了

LCM框架卡住了更新

Stevecoops
UserLevel 2
徽章 +7

你好，

我无法在CE集群中访问LCM。它只是说“ LCM框架更新正在进行中。当更新过程完成后，请检查。”已经有几天了。更新基础和NCC的旧方式很好。

我看不到棱镜或使用ECLI任务的任何活动任务。清单

有任何想法吗？

图标

最好的答案Stevecoops2021年3月10日，17:26

I just had a play and I fixed it! It\u2019s now doing a framework update.<\/p>

\u00a0<\/p>

I *think* the command that did it was\u00a0<\/p>

zkcli write \/appliance\/logical\/lcm\/mercury_config\/f58690da-9d18-400c-8a6a-f7d3a4e09b28<\/p>

as that id now shows when I do a list. I did so many different commands I\u2019m not 100% sure it is that one though :)<\/p>

Cheers,<\/p>

Steve<\/p>","className":"post__content__best_answer"}">

查看原件
Hi,<\/p>

I can\u2019t access LCM in my\u00a0CE cluster. It just says \u201cLCM Framework Update is in progress. Please check back when the update process is completed.\u201d It\u2019s been like this for days. Updating Foundation and NCC worked fine the old way.<\/p>

I can\u2019t see any active tasks in Prism or using ecli\u00a0task.list<\/p>

Any ideas?<\/p>","quoteUsername":"SteveCoops","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote","Share":"Share"}}}">

该主题已关闭以供评论

12个答复

Stevecoops
UserLevel 2
徽章 +7

我注意到如果我进行NCC检查，我会得到一项负载：

信息：集群/节点报告目前正在进行维护/升级。在此工作流程中，该健康检查插件将被禁用，以避免结果不准确或警报，但在工作流程完成后将再次运行。有关更多详细信息，请参见KB4999。

但是NCLI主机LS在所有三个节点上显示为维护模式的错误。

我发现了其他一些脚本，但再次说什么都没有发生：

nutanix@ntnx-afcd9aa8-a-cvm：192.168.250.236：/usr/usr/local/nutanix/cluster/bin/lcm $ ./lcm_upgrade_status
正在进行的升级：
没有升级正在进行

完成升级：
最多5个以前完成的升级批次以升级升级的开始时间列出：
nutanix@ntnx-afcd9aa8-a-cvm：192.168.250.236：/usr/usr/local/nutanix/cluster/bin/lcm $ $

nutanix@ntnx-afcd9aa8-a-cvm：192.168.250.236：/usr/usr/local/nutanix/cluster/bin/bin/lcm $ lcm_auto_auto_upgrade_status
没有自动化

I\u2019ve noticed if I do an NCC check then I get a load of :<\/p>

INFO: Cluster\/node reports it is currently undergoing maintenance\/upgrade. This health check plugin is disabled during this workflow to avoid inaccurate results or alerts but will run again when the workflow completes. See KB4999 for more details.<\/p>

But ncli host ls shows false for maintenance mode on all three nodes.<\/p>

I found some other scripts\u00a0but again says nothing is happening:<\/p>

nutanix@NTNX-afcd9aa8-A-CVM:192.168.250.236:\/usr\/local\/nutanix\/cluster\/bin\/lcm$ .\/lcm_upgrade_status
Ongoing upgrades:
No upgrade is in progress<\/p>

Finished upgrades:
Up to 5 previously finished upgrade batches listed in descending order of upgrade start time:
nutanix@NTNX-afcd9aa8-A-CVM:192.168.250.236:\/usr\/local\/nutanix\/cluster\/bin\/lcm$<\/p>

nutanix@NTNX-afcd9aa8-A-CVM:192.168.250.236:\/usr\/local\/nutanix\/cluster\/bin\/lcm$ lcm_auto_upgrade_status
No autoupdate in progress<\/p>","quoteUsername":"SteveCoops","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote","Share":"Share"}}}">

Stevecoops
UserLevel 2
徽章 +7

我只是尝试将LCM_LEADER移至另一个节点（不知道该怎么做，所以我只是重新启动了cvm lcm_leader所在！），现在它挂在“加载...”上时，在prism中登上LCM页面。

I just tried moving the lcm_leader to another node (no idea how to do this so I just rebooted the CVM the lcm_leader was on!) and it now just hangs on \u201cLoading...\u201d when going to the LCM page in Prism.<\/p>","quoteUsername":"SteveCoops","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote","Share":"Share"}}}">
p
UserLevel 6
徽章 +16

看这篇文章：LCM ：（生命周期经理）故障排除指南

Stevecoops
UserLevel 2
徽章 +7

不幸的是，那里没有任何帮助我在该州。这些不存在：

〜/data/logs/lcm_ops.out或
〜/data/logs/lcm_wget.log

ergon.out中没有卡住的任务

Genesis.out没什么有趣的

….LCM/LCM路径不存在，因此没有问题。

我认为我需要清除NCC在某个地方设置的升级状态，以根据其大多数支票进行报告：

ahv_version_check的详细信息：
节点192.168.250.237：
信息：集群/节点报告目前正在进行维护/升级。在此工作流程中，该健康检查插件将被禁用，以避免结果不准确或警报，但在工作流程完成后将再次运行。有关更多详细信息，请参见KB4999。

There\u2019s nothing there that helps me in the state it\u2019s in unfortunately. These don\u2019t exist:\u00a0<\/p>
~\/data\/logs\/lcm_ops.out or <\/pre>
~\/data\/logs\/lcm_wget.log<\/pre>
No stuck tasks in ergon.out<\/p>
Nothing interesting in genesis.out<\/p>
\u2026.lcm\/lcm path doesn\u2019t exist so no issue there.<\/p>
I think I need to clear the upgrade status that\u2019s set somewhere for NCC to report this against most of its checks:<\/p>
Detailed information for ahv_version_check:
Node 192.168.250.237:\u00a0
INFO: Cluster\/node reports it is currently undergoing maintenance\/upgrade. This health check plugin is disabled during this workflow to avoid inaccurate results or alerts but will run again when the workflow completes. See KB4999 for more details.<\/p>","quoteUsername":"SteveCoops","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote","Share":"Share"}}}">
Stevecoops
UserLevel 2
徽章 +7

是的，所以这些都说没有升级正在进行：

nutanix@ntnx-5de7c188-a-cvm：192.168.250.235：〜/cluster/bin/bin/lcm $ ustgrade_status
2021-03-09 14：47：36,142Z信息zookeeper_session.py:176 usgrade_status正在尝试连接到Zookeeper
2021-03-09 14：47：36,149Z信息usprade_status：38目标发行版：EL7.3 Release-CE-2020.09.16-stable-D4FC219B73B4181935A3A3A3A19465EB922313FC735FC735FC735FC735FC735FC735FC735FC735FC735FC735FC735FC735FC735FC735FC735FC735FC735FC735FC735FC735FC735FC735FC735FC735FC735FC735FC735FC735FC735F
2021-03-09 14：47：36,152Z信息UPGRADE_STATUS：103 SVM 192.168.250.235是最新的
2021-03-09 14：47：36,152Z信息UPGRADE_STATUS：103 SVM 192.168.250.236是最新的
2021-03-09 14：47：36,153Z信息UPGRADE_STATUS：103 SVM 192.168.250.237是最新的

nutanix@ntnx-5de7c188-a-cvm：192.168.250.235：〜/cluster/bin/bin/lcm $ host_upgrade_status
2021-03-09 14：47：56,572Z信息zookeeper_session.py:176 host_upgrade_status正在尝试连接到Zookeeper
自动管理程序升级：已启用
目标主机版本：无

但是NCC说：

cluster_active_upgrade_check的详细信息：
节点192.168.250.235：
信息：['nos'，''机身'，'固件']被升级
有关cluster_active_upgrade_check或与：ncc health_checks system_checks cluster_active_upgrade_upgrade_checks，请参阅KB 5277（http://portal.nutanix.com/kb/5277））

Yeah so these both say no upgrade is taking place:<\/p>

nutanix@NTNX-5de7c188-A-CVM:192.168.250.235:~\/cluster\/bin\/lcm$ upgrade_status
2021-03-09 14:47:36,142Z INFO zookeeper_session.py:176 upgrade_status is attempting to connect to Zookeeper
2021-03-09 14:47:36,149Z INFO upgrade_status:38 Target release version: el7.3-release-ce-2020.09.16-stable-d4fc219b73b4181935a3a19465eb922313fc735f
2021-03-09 14:47:36,152Z INFO upgrade_status:103 SVM 192.168.250.235 is up to date
2021-03-09 14:47:36,152Z INFO upgrade_status:103 SVM 192.168.250.236 is up to date
2021-03-09 14:47:36,153Z INFO upgrade_status:103 SVM 192.168.250.237 is up to date<\/p>

nutanix@NTNX-5de7c188-A-CVM:192.168.250.235:~\/cluster\/bin\/lcm$ host_upgrade_status
2021-03-09 14:47:56,572Z INFO zookeeper_session.py:176 host_upgrade_status is attempting to connect to Zookeeper
Automatic Hypervisor upgrade: Enabled
Target host version: None<\/p>

But NCC says:<\/p>

Detailed information for cluster_active_upgrade_check:
Node 192.168.250.235:
INFO: ['NOS', 'Hypervisor', 'Firmware'] being upgraded
Refer to KB 5277 (http:\/\/portal.nutanix.com\/kb\/5277) for details on cluster_active_upgrade_check or Recheck with: ncc health_checks system_checks cluster_active_upgrade_check<\/p>","quoteUsername":"SteveCoops","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote","Share":"Share"}}}">

阿罗纳
秩
UserLevel 6
徽章 +5

在黑暗中拍摄，您可以升级NCC吗？它将有效重新启动该过程。

Shot in the dark, can you upgrade NCC? It will effectively restart the process.<\/p>","quoteUsername":"Alona","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote","Share":"Share"}}}">
Stevecoops
UserLevel 2
徽章 +7

不，我已经在最新:(

今天，我将其放在一夜之间时到达了一个不同的阶段。当我进入LCM页面时，它只是说“等待LCM框架开始……”

编辑OH留下几分钟，回到“正在进行的LCM框架更新，请在更新过程完成后查看。”

我在创世纪中注意到这一点一遍又一遍地重复：

2021-03-10 10：23：17,117Z信息ergon_utils.py:825无LCM操作运行
2021-03-10 10：23：17,118Z信息ergon_utils.py:1595找不到root Task uuid
2021-03-10 10：23：17,121Z信息zeus_utils.py:413 zk node/place/logical/lcm/lcm/mercury_config/f58690da-9d18-400c-8a66a-f7a6a-f7d3a4e09b28
2021-03-10 10：23：17,121Z信息框架。返回自动化

Edit2-我认为我正在做一些事情。“ F58690DA-9D18-400C-8A6A-F7D3A4E09B28”是我的第三个节点的ID，它丢失了：

nutanix@ntnx-5de7c188-a-cvm：192.168.250.235：〜/data/logs $ zkls/appliance/appliance/逻辑/lcm/mercury_config
5D0B2664-9ACE-4DCF-9A0E-35CA8EE0910E
C555B5DD-6841-4EC0-A87D-54F3454C213D
nutanix@ntnx-5de7c188-a-cvm：192.168.250.235：〜/data/logs $

其他两个ID还有其他两个节点。

我如何创建这个“东西”（是一个文件夹？）

干杯，

史蒂夫

No I\u2019m already on the latest :(<\/p>

\u00a0<\/p>

I\u2019ve today got to a different stage by leaving it overnight. When I go to the LCM page it just says \u201cWaiting for LCM Framework to start...\u201d<\/p>

\u00a0<\/p>

edit oh leaving it for a few minutes it\u2019s back to \u201cLCM Framework Update in Progress, please check back when the update process is completed.\u201d<\/p>

\u00a0<\/p>

I notice in genesis log this repeats over and over:<\/p>

\u00a0<\/p>

2021-03-10 10:23:17,117Z INFO ergon_utils.py:825 No LCM operation running
2021-03-10 10:23:17,118Z INFO ergon_utils.py:1595 Cannot find root task uuid
2021-03-10 10:23:17,121Z INFO zeus_utils.py:413 Zk node \/appliance\/logical\/lcm\/mercury_config\/f58690da-9d18-400c-8a6a-f7d3a4e09b28 doesn't exist
2021-03-10 10:23:17,121Z INFO framework.py:2196 Mercury config is in progress. Returning Autoupdate<\/p>

\u00a0<\/p>

Edit2 - I think I\u2019m on to something. \u201cf58690da-9d18-400c-8a6a-f7d3a4e09b28\u201d is the ID of my 3rd node and it\u2019s missing:<\/p>

\u00a0<\/p>

nutanix@NTNX-5de7c188-A-CVM:192.168.250.235:~\/data\/logs$ zkls \/appliance\/logical\/lcm\/mercury_config
5d0b2664-9ace-4dcf-9a0e-35ca8ee0910e
c555b5dd-6841-4ec0-a87d-54f3454c213d
nutanix@NTNX-5de7c188-A-CVM:192.168.250.235:~\/data\/logs$<\/p>

\u00a0<\/p>

The other two IDs there are the other two nodes.<\/p>

\u00a0<\/p>

How do I create this \u201cthing\u201d (is it a folder?)<\/p>

\u00a0<\/p>

Cheers,<\/p>

Steve<\/p>","quoteUsername":"SteveCoops","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote","Share":"Share"}}}">

Stevecoops
UserLevel 2
徽章 +7

我只是玩了一场比赛，我修复了它！现在正在进行框架更新。

我 *认为 *这样做的命令

zkcli Write/athere/逻辑/lcm/mercury_config/f58690da-9d18-400c-8a6a-f7d3a4e09b28

正如该ID现在显示的那样，当我列出列表时。我做了很多不同的命令，我不是100％确定是那个:)

干杯，

史蒂夫

I just had a play and I fixed it! It\u2019s now doing a framework update.<\/p>

\u00a0<\/p>

I *think* the command that did it was\u00a0<\/p>

zkcli write \/appliance\/logical\/lcm\/mercury_config\/f58690da-9d18-400c-8a6a-f7d3a4e09b28<\/p>

as that id now shows when I do a list. I did so many different commands I\u2019m not 100% sure it is that one though :)<\/p>

Cheers,<\/p>

Steve<\/p>","quoteUsername":"SteveCoops","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote","Share":"Share"}}}">

Stevecoops
UserLevel 2
徽章 +7

哦，我必须再做一次，但是在创世纪日志上也有类似的错误，然后添加其他主机，然后我重新启动了创世纪，LCM领导者搬到了另一个主机，现在LCM Prechecks已经完成并且库存正在运行！

Oh I had to do it again but adding the other hosts in as i had a similar error in genesis logs, then I restarted genesis and the lcm leader moved to another host and now the LCM prechecks have completed and inventory is running!<\/p>","quoteUsername":"SteveCoops","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote","Share":"Share"}}}">
Stevecoops
UserLevel 2
徽章 +7

woohoo都完成了，更新执行！

Woohoo all done and updates performed!<\/p>
\"//www.jhbzcj.com/next/how-it-works-22/\"<\/figure>

\u00a0<\/p>","quoteUsername":"SteveCoops","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote","Share":"Share"}}}">

Stevecoops
UserLevel 2
徽章 +7

NCC现在很清楚 - 不再说正在进行升级

Also NCC is clear now - no longer says upgrade in progress<\/p>","quoteUsername":"SteveCoops","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote","Share":"Share"}}}">
阿罗纳
秩
UserLevel 6
徽章 +5

哇！做得好！

Wow! Great work!<\/p>","quoteUsername":"Alona","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote","Share":"Share"}}}">
条款和条件
Learn more about our cookies.<\/a>","cookiepolicy.button":"Accept cookies","cookiepolicy.button.deny":"Deny all","cookiepolicy.link":"Cookie settings","cookiepolicy.modal.title":"Cookie settings","cookiepolicy.modal.content":"We use 3 different kinds of cookies. You can choose which cookies you want to accept. We need basic cookies to make this site work, therefore these are the minimum you can select. Learn more about our cookies.<\/a>","cookiepolicy.modal.level1":"Basic
Functional","cookiepolicy.modal.level2":"Normal
Functional + analytics","cookiepolicy.modal.level3":"Complete
Functional + analytics + social media + embedded videos"}}}">
Baidu