问题

NVME SSD + SSD节点性能和I / O路径

  • 2021年10月13日
  • 0答复
  • 129次观点
C
徽章 +6

我有5个配备2 * 3.2TB NVME SSD和6 * 1.92TB SATA SSD的节点。每个人。所有节点都与25GB网络连接。AOS 5.15到5.20的所有节点Upgarde

从Nutanix圣经中，在与NVME SSD + Stata SSD的场景中，Oplog只会驻留在NVME SSD中，而不是SATA SSD。

所以这意味着所有随机写作都将首先用NVME SSD写入，然后排水到所有NVME SSD + SATA SSD？

所有顺序写入都将通过oplog，只能在所有NVME SSD + SATA SSD中分存普通存储次数

读取I / O路径怎么样？

在某些测试中，我发现当我在VM中执行一些I / O操作时，所有设备（NVME和SATA）都有I / O计数器，并且IOPS在Prism-Hardware - 磁盘页面中大致相同。似乎无法使用NVME SSD的快速速度。

您是否有任何建议可以通过在节点中使用NVME来证明快速性能改善。

我还检查了磁盘状态，如folloing：它是使用spdk。

================== 172.88.61.131 =================.
插槽磁盘模型串行大小
0 ----------- ------------- ----------------------
1 / DEV / SDA SSDSC2KG019T8L PHYG0506026Z1P9DGN 1.9 TB
2 / DEV / SDB SSDSC2KG019T8L PHYG050602HB1P9DGN 1.9 TB
3 / DEV / SDC SSDSC2KG019T8L PHYG0506024J1P9DGN 1.9 TB
4 / DEV / SDD SSDSC2KG019T8L PHYG050602FT1P9DGN 1.9 TB
5 / DEV / SDE SSDSC2KG019T8L PHYG050602781P9DGN 1.9 TB
6 / DEV / SDF SSDSC2KG019T8L PHYG050605TU1P9DGN 1.9 TB
7 ----------- ------------- ----------------------
8 ----------- ------------- ----------------------
9 ----------- ------------- ---------------------
10 ----------- ------------- ----------------------
11 / dev / nvme1n1 ssdpe2ke032t8l ​​phln0201024t3p2bgn 3.2 tb
12 / dev / nvme0n1 ssdpe2ke032t8l ​​phln020102p3p2bgn 3.2 tb

I have 5 nodes equipped with 2*3.2TB NVMe\u00a0SSD and 6* 1.92TB SATA SSD. of every one. all nodes are connected with 25Gb network. all nodes upgarde from AOS 5.15 to 5.20<\/p>

From the nutanix bible, in the scenarion with NVMe SSD + STATA SSD, the oplog will only reside in the NVMe\u00a0SSD, and not in SATA SSD.<\/p>

So that is mean all the random write will first write in NVMe\u00a0SSD and then drain to all the NVMe SSD+ SATA SSD?<\/p>

all the sequential write will pass OPlog and only writhe to extent store parally in all NVMe\u00a0SSD + SATA SSD?\u00a0<\/p>

How about the read I\/O path?\u00a0<\/p>

In some test, I found that when I do some I\/O operation in VM, All the device (NVMe and SATA) have I\/O counters and the IOPS are\u00a0roughly the same in the prism-hardware--disk page. Seems the fast speed of NVMe SSD cannot be utilized.<\/p>

Does you have any suggestions to prove the fast performance improve by\u00a0used NVMe in the nodes.<\/p>

I also checked that the disk status, as the folloing: It is used SPDK.<\/p>

================== 172.88.61.131 =================
Slot \u00a0Disk \u00a0 \u00a0 \u00a0 \u00a0 \u00a0Model \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 Serial \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0Size
0 \u00a0 \u00a0 ------------ \u00a0-------------- \u00a0------------------ \u00a0------
1 \u00a0 \u00a0 \/dev\/sda \u00a0 \u00a0 \u00a0SSDSC2KG019T8L \u00a0PHYG0506026Z1P9DGN \u00a01.9 TB
2 \u00a0 \u00a0 \/dev\/sdb \u00a0 \u00a0 \u00a0SSDSC2KG019T8L \u00a0PHYG050602HB1P9DGN \u00a01.9 TB
3 \u00a0 \u00a0 \/dev\/sdc \u00a0 \u00a0 \u00a0SSDSC2KG019T8L \u00a0PHYG0506024J1P9DGN \u00a01.9 TB
4 \u00a0 \u00a0 \/dev\/sdd \u00a0 \u00a0 \u00a0SSDSC2KG019T8L \u00a0PHYG050602FT1P9DGN \u00a01.9 TB
5 \u00a0 \u00a0 \/dev\/sde \u00a0 \u00a0 \u00a0SSDSC2KG019T8L \u00a0PHYG050602781P9DGN \u00a01.9 TB
6 \u00a0 \u00a0 \/dev\/sdf \u00a0 \u00a0 \u00a0SSDSC2KG019T8L \u00a0PHYG050605TU1P9DGN \u00a01.9 TB
7 \u00a0 \u00a0 ------------ \u00a0-------------- \u00a0------------------ \u00a0------
8 \u00a0 \u00a0 ------------ \u00a0-------------- \u00a0------------------ \u00a0------
9 \u00a0 \u00a0 ------------ \u00a0-------------- \u00a0------------------ \u00a0------
10 \u00a0 \u00a0------------ \u00a0-------------- \u00a0------------------ \u00a0------
11 \u00a0 \u00a0\/dev\/nvme1n1 \u00a0SSDPE2KE032T8L \u00a0PHLN0201024T3P2BGN \u00a03.2 TB
12 \u00a0 \u00a0\/dev\/nvme0n1 \u00a0SSDPE2KE032T8L \u00a0PHLN020102EP3P2BGN \u00a03.2 TB<\/p>","quoteUsername":"chenzh4","translations":{"Common":{"like":"Like","unlike":"Unlike"},"Forum":{"Quote":"Quote","Share":"Share"}}}">

0答复

做第一个回复的人！

回复


条款和条件
Learn more about our cookies.<\/a>","cookiepolicy.button":"Accept cookies","cookiepolicy.button.deny":"Deny all","cookiepolicy.link":"Cookie settings","cookiepolicy.modal.title":"Cookie settings","cookiepolicy.modal.content":"We use 3 different kinds of cookies. You can choose which cookies you want to accept. We need basic cookies to make this site work, therefore these are the minimum you can select. Learn more about our cookies.<\/a>","cookiepolicy.modal.level1":"Basic
Functional","cookiepolicy.modal.level2":"Normal
Functional + analytics","cookiepolicy.modal.level3":"Complete
Functional + analytics + social media + embedded videos"}}}">
Baidu