HPE Storage Users Group

A Storage Administrator Community




Post new topic Reply to topic  [ 8 posts ] 
Author Message
 Post subject: Can't add CPG or change set size
PostPosted: Tue Oct 23, 2018 4:28 am 

Joined: Tue Oct 23, 2018 4:09 am
Posts: 4
Hello 3parug!

Today I met interesting issue. When I tried to create new CPG it gave me only r1 option. Other RAIDs free space are being calculated as zero.

It shows like this

std1 cli% showspace -p -devtype FC -ha mag -t r5
--Estimated(MB)---
RawFree UsableFree
0 0
std1 cli% showspace -p -devtype FC -ha mag -t r6
--Estimated(MB)---
RawFree UsableFree
0 0
std1 cli% showspace -p -devtype FC -ha mag -t r1
---Estimated(MB)---
RawFree UsableFree
13637632 6818816
std1 cli%

Does anybody know what is the matter? The goal is to create new r5 CGP with 5+1 set size , or at least change already created one.

_________________
*****************************************
Sorry for possible mistakes, English is not my mothertongue.


Top
 Profile  
Reply with quote  
 Post subject: Re: Can't add CPG or change set size
PostPosted: Tue Oct 23, 2018 7:09 am 

Joined: Wed Nov 09, 2011 12:01 pm
Posts: 392
What's the physical config, model, trays, disks and are any of the disks currently full?


Top
 Profile  
Reply with quote  
 Post subject: Re: Can't add CPG or change set size
PostPosted: Tue Oct 23, 2018 7:39 am 

Joined: Tue Oct 23, 2018 4:09 am
Posts: 4
ailean wrote:
What's the physical config, model, trays, disks and are any of the disks currently full?

Hi ailean!

it's 8440, 2 cages with six FC 1800GB and ten SSD 1920GB drives on each.
typical FC drive is like this:

Code:
std1 cli% showpd -c
                             --------- Normal Chunklets --------- ---- Spare Chunklets ----
                             -- Used -- -------- Unused --------- - Used - ---- Unused ----
Id CagePos Type State  Total    OK Fail  Free Uninit Unavail Fail OK  Fail Free Uninit Fail
 0 0:0:0   FC   normal  1675   428    0  1107      0       0    0  0     0  140      0    0


UPD: I forgot to note, all CPGs I mentioned are FC-only

_________________
*****************************************
Sorry for possible mistakes, English is not my mothertongue.


Top
 Profile  
Reply with quote  
 Post subject: Re: Can't add CPG or change set size
PostPosted: Tue Oct 23, 2018 8:39 am 

Joined: Wed Nov 09, 2011 12:01 pm
Posts: 392
There is a slight limit I think on small amounts of disks.

Each node is master of half the disks in a tray and by default the layout of raid sets is at a node level.

So at the moment each Node sees 3 x FC disks and 5 x SSD disks. So CPG set sizes have to fit into 3 or 5.

There was an update in one of the 3.2.2 releases which added some more flexibility, allowing the set sizes to be across Node Pairs I think but I've only seen that on our SSD based 8xxx boxes so don't know if it applies to FC as well. After we had that update I was able to move our volumes from R1 to R5 (we only had 6 SSDs per tray), before the update I couldn't create a R5 CPG either.

Just had a look at the release notes (3.2.2MU2), I think the feature was "Express layout (for SSD only)" and as I suspected it does state SSD only. :(

Couldn't see any enhancements to that feature up to MU6 at least so I think you may be limited to R1 on FC unless you add more disks.

EDIT: On better news just checked the release notes for 3.3.1 and it states Express Layout enhanced to support all drives, not just SSD. ;)


Top
 Profile  
Reply with quote  
 Post subject: Re: Can't add CPG or change set size
PostPosted: Tue Oct 23, 2018 9:48 am 

Joined: Tue Oct 23, 2018 4:09 am
Posts: 4
ailean wrote:
There is a slight limit I think on small amounts of disks.

Each node is master of half the disks in a tray and by default the layout of raid sets is at a node level.

So at the moment each Node sees 3 x FC disks and 5 x SSD disks. So CPG set sizes have to fit into 3 or 5.

So r1 is available just because there are only two chunks per set. Thanks, you helped a lot.

I am afraid there will be no approve for 3PAR OS Upgrade, then additional disks is only solution.

Thanks again, Ailean! :)

_________________
*****************************************
Sorry for possible mistakes, English is not my mothertongue.


Top
 Profile  
Reply with quote  
 Post subject: Re: Can't add CPG or change set size
PostPosted: Wed Oct 24, 2018 10:01 am 

Joined: Mon Sep 21, 2015 2:11 pm
Posts: 1571
Location: Europe
Minimum supported config is 6x SSDs, 12x FC or 12x NL per node pair. If your 8440 has 4 nodes, you require a minimum of 24x FC drives for a supported configuration with any FC drive.

_________________
The views and opinions expressed are my own and do not necessarily reflect those of my current or previous employers.


Top
 Profile  
Reply with quote  
 Post subject: Re: Can't add CPG or change set size
PostPosted: Thu Oct 25, 2018 2:41 am 
User avatar

Joined: Tue Oct 07, 2014 8:34 am
Posts: 214
Location: Germany
MammaGutt wrote:
Minimum supported config is 6x SSDs, 12x FC or 12x NL per node pair. If your 8440 has 4 nodes, you require a minimum of 24x FC drives for a supported configuration with any FC drive.

The Updated Rule is:
All node pairs must have minimum of either 6 Fast Class, 6 SSD, or 12 NL drives
https://hpe.kx.com.tw/file/repository/a ... yi1ipz.pdf
Table 3
6x FC with R1 or R5 (2+1) should work anytime, for R5 (5+1) with 6 Disk you need the Express Layout Feature.
This came with 3.2.2 EMU2 for SSD and 3.3.1 for all Drives.
(The CPG have to be created with the new IOS)
So it depends, if you have 2 or 4 Node 8440 and on your Firmware.
Both we did not know. :roll:
And also respect this:
https://support.hpe.com/hpsc/doc/public ... cale=en_US


Top
 Profile  
Reply with quote  
 Post subject: Re: Can't add CPG or change set size
PostPosted: Thu Oct 25, 2018 4:55 am 

Joined: Tue Oct 23, 2018 4:09 am
Posts: 4
cali wrote:
MammaGutt wrote:
Minimum supported config is 6x SSDs, 12x FC or 12x NL per node pair. If your 8440 has 4 nodes, you require a minimum of 24x FC drives for a supported configuration with any FC drive.

The Updated Rule is:
All node pairs must have minimum of either 6 Fast Class, 6 SSD, or 12 NL drives
https://hpe.kx.com.tw/file/repository/a ... yi1ipz.pdf
Table 3
6x FC with R1 or R5 (2+1) should work anytime, for R5 (5+1) with 6 Disk you need the Express Layout Feature.
This came with 3.2.2 EMU2 for SSD and 3.3.1 for all Drives.
(The CPG have to be created with the new IOS)
So it depends, if you have 2 or 4 Node 8440 and on your Firmware.
Both we did not know. :roll:
And also respect this:
https://support.hpe.com/hpsc/doc/public ... cale=en_US


Hi Cali

it's 4x-node with 3.2.2.612 (MU4)+P51,P56,P59,P74,P84,P92,P95

and it behaves exactly as you say - R1 or R5 (2+1) are only available.

_________________
*****************************************
Sorry for possible mistakes, English is not my mothertongue.


Top
 Profile  
Reply with quote  
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 8 posts ] 


Who is online

Users browsing this forum: Majestic-12 [Bot] and 23 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group | DVGFX2 by: Matt