问题

在Nutanix平台上运行ZFS虚拟机

  • 2020年2月21日
  • 3回复
  • 1390的浏览量
Z
  • zain
  • “航行者”号
  • 1回复

我运行了一个6节点的nutanix集群，并计划运行一些容器(LXC)，在VM中使用ZFS池，利用轻松克隆、迁移、快照容器，主要是为了将这些克隆传输到其他系统(DR)。

我了解到，ZFS需要直接处理磁盘硬件，以确定哪些内容实际写入磁盘，哪些内容没有写入磁盘。

ZFS是否适合运行在nutanix平台上，考虑到数据损坏或丢失池的风险，因为它不能直接处理磁盘硬件?

硬件是与nutanix-enterprise捆绑在一起的超微型。

    I run a 6-node nutanix cluster, and planing\u00a0to run some containers (LXC) , inside VM using ZFS pool, to leverage on easy clone, migrate, snapshot the containers mainly to transport those clones to other system (DR)<\/p>

    I read that ZFS need to deal directly with disks hardware to be sure about what is or what is not actually written to disks.\u00a0<\/p>

    Is ZFS suaitable or not, being run on top of nutanix platform, concerning the data corruption risk or losing pool, because it can\u2019t deal directly with disk hardware?<\/p>

    Hardware is supermicro bundled with nutanix-enterprise.<\/p>","quoteUsername":"zain","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote","Share":"Share"}}}">

    3回复

    JeremyJ
    排名
    Userlevel 3
    徽章 ＋４

    你好 @zain

    听起来您似乎已经知道了ZFS在虚拟磁盘中不能正常运行的一些原因。通过查看可用的文档，他们警告不要在另一个文件系统上实现，并警告性能损失和其他潜在问题。

    我要补充的是，当应用于Nutanix分布式文件系统上的VM磁盘时，ZFS中包含的任何磁盘健康监视特性充其量都是无意义的。ZFS的设计似乎是为了充分利用(更便宜的)商品硬件，并包括一些磁盘健康监控和磁盘设备调整。任何ZFS文件系统块可能是一个或多个文件系统块的一部分Nutanix分布式文件系统(DFS),和那些DFS块将驻留在集群中的两个或多个物理磁盘和固态硬盘和硬盘驱动器层之间可能会迁移数据的生命周期。因此，任何试图识别和监控底层物理设备的尝试都不能依赖于它在每一个小时都是相同的设备。

    我建议大家回顾一下码头工人储存注意事项部分的Docker容器在AHV上最佳实践指导，并确定相同的推理和建议是否可以成功应用到您的部署中。虽然Docker和LXC不是完全一样的东西，但它是经过彻底审查的最接近的模拟，您将看到，在形成他们的建议之前，作者在其他可用选项中考虑了ZFS。

    hello @zain<\/user-mention>\u00a0<\/p>

    It sounds like you\u2019re already aware of some reasons why ZFS may not perform as expected in a virtual disk. From reviewing the available documentation they caution against implementing on top of another filesystem with warnings of performance losses and other potential issues.<\/p>

    I\u2019ll add that any disk health monitoring features included in ZFS would be nonsensical\u00a0at best when applied to a VM disk on the Nutanix distributed filesystem. ZFS seems designed to make good use of (cheaper) commodity hardware and included some disk health monitoring and disk-device tweaks to do so. Any filesystem block in ZFS could be part of one or more filesystem blocks in the Nutanix Distributed FileSystem (DFS), and any of those DFS blocks would reside on two or more physical disks in the cluster and would likely migrate between the SSD and HDD tiers during the lifecycle of the data. Because of this any attempt to recognize and monitor the underlying physical device simply couldn\u2019t rely on it being the same device from one hour to the next.<\/p>

    I would recommend reviewing the Docker Storage Considerations<\/a>\u00a0section of the\u00a0Docker Containers on AHV<\/a>\u00a0 best practices guide, and determining whether the same reasoning and recommendations can be successfully applied to your deployment. While Docker won\u2019t be quite the same thing as LXC, it\u2019s the closest analog that\u2019s been thoroughly vetted and you\u2019ll see the authors took the time to consider ZFS among other available options before forming their recommendations.<\/p>

    \u00a0<\/p>","quoteUsername":"JeremyJ","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote","Share":"Share"}}}">

    Z

    亲爱的 @JeremyJ，

    谢谢你的解释。我已经认为这是ZFS在DFS上的情况，我需要确定。

    dear @JeremyJ<\/user-mention>\u00a0,<\/p>

    \u00a0<\/p>

    thank you for your explanation. I already thought that is the case about ZFS on DFS,\u00a0 I need\u00a0to be sure.<\/p>","quoteUsername":"zain","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote","Share":"Share"}}}">

    E

    @JeremyJ我仍然认为应该支持ZFS nutanix,是的,这可能会带来一些性能问题,也失败的目的文件系统的自动愈合功能,对我来说我用FreeBSD的大部分时间和ZFS是如此强大的文件系统,不仅仅是因为它的auto-healing特性。但快照、压缩和加密，文件系统的数据集样式也是我喜欢的。对我来说，ZFS提供的特性远远超过了ZFS对DFS文件系统造成的性能问题。

    @JeremyJ<\/user-mention>\u00a0I still believe that ZFS should be supported in nutanix, yes it may incur some performance issue and also defeat the purpose of the auto healing features of the file system, for me I am using FreeBSD most of the time and ZFS is such powerful file system, not just because its auto-healing features.. but snapshot, compression and now with encryption, the dataset style of the file system also one thing I like. For me, the features that ZFS offer far outweigh the performance issue imposed by ZFS on DFS file system.<\/p>","quoteUsername":"Eman Zane","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote","Share":"Share"}}}">

    回复


    Baidu