3PAR Users Group

A Storage Administrator Community




Post new topic Reply to topic  [ 20 posts ]  Go to page 1, 2  Next
Author Message
 Post subject: Adaptive Optimization
PostPosted: Wed Jan 23, 2019 5:55 am 

Joined: Thu Mar 01, 2018 3:04 am
Posts: 15
Hi,

We have 7200c with 40 SAS15K 600GB + 8 SSD 400GB,that is present to a VMware Cluster.
we have 13 vv on CPG_FC_RAID6_8D2P + 2 vvol on CPG_SSD_RAID5_7D1P.
FalshCash is enable for a total of 256GB

We have some performance problem (latency, application are slowly or crash)

We have open a case on HPE says us that we have more IOPS like FC can support: they tell us:
· From the above charts, it is noticed that IOPS (I/Os per second) for FC disks goes beyond the limit at time period when performance issue is noticed. The  safe IOPS for FC 10K RPM is 150 @ 8K and anything beyond this values could adversely impact the service time of the I/O to the volumes.
· AO is not configured
To decrease the load on the FC disks, we would suggest either to move some VVs to the SSD CPGs, to review the AO configuration or to add more drives

we want to set AO.
I have create a configuration just for analyse.
can you help me to understand correctly the report from HPE SSMC ?
can you think we have suffisant SSD Space for AO ? (we plan to move VM to another datastore to free up SSD space and dedicated SSD to AO)


Attachments:
ao_charts.pdf [2.36 MiB]
Downloaded 41 times


Last edited by abelliot on Mon Jan 28, 2019 4:53 am, edited 1 time in total.
Top
 Profile  
Reply with quote  
 Post subject: Re: Adaptive Optimization
PostPosted: Wed Jan 23, 2019 10:46 am 

Joined: Mon Sep 21, 2015 2:11 pm
Posts: 764
Location: Europe
Sorry to say, but that report is useless.

It does not show current IOps per FC drives.
It does not show anything about SSDs.

If you could provide output from
srrgiodensity -btsecs -1d -cpg * -withvv -pct
And
srrgiodensity -btsecs -1d -cpg * -withvv
(it can take a minute or two to generate the data)
It will give some general perspective. I don't remember the srstatpd command to show average IOps per disk but not the most important one.

Edit: did you ever check the value of FlashCache? My experience is that it provides little to no value in 95+% of cases, while it provides a lot of value in the remaining few. My guess is that it will be better spent putting it into AO.


Top
 Profile  
Reply with quote  
 Post subject: Re: Adaptive Optimization
PostPosted: Thu Jan 24, 2019 4:37 am 

Joined: Thu Mar 01, 2018 3:04 am
Posts: 15
Hi,

Thanks for your response. I am beginning with AO (and 3Par too...). I thinked the report that provide SSMC was suffisant, but I see that CLI is very better !

in attachment the exports of the two commands.

Thanks for your help,


Attachments:
srrgiodensity.pdf [1.15 MiB]
Downloaded 46 times
Top
 Profile  
Reply with quote  
 Post subject: Re: Adaptive Optimization
PostPosted: Thu Jan 24, 2019 5:46 am 

Joined: Mon Sep 21, 2015 2:11 pm
Posts: 764
Location: Europe
Yeah...

Well, assuming that most active data is the same over multiple days you should be able to get a rather decent improvement.

~40% of SSD cacpity in AS49_SSD_DATASTORE is completely dead, ~15% in SSD_TEMP_DATASTORE

Funny stuff is that the most active areas of the volumes on almost every FC volume (except H2M, ARCANE, OPTILOGISTIC and AS49) is more active than the most active areas of the SSD volumes :)

Really horrible calculations show that about 40%-ish of the total IO is produced from only 520GB of capacity (everything including and above the 512 column)

If you do it without the "-withvv" you get some nice percentages for entire CPGs, but yeah. I would really take a stab on AO if you have that license.

Use FC CPG for user CPG (if you have DO licence you can just tune, if not you need to create new volumes and use storage vmotion) and create a AO config with FC CPG as tier 1 and SSD as tier 0. Schedule a task to run AO daily and you should see improvement the first day. When all volumes are using FC CPG as user CPG you can allow AO to fill SSD CPG to 100% as there will not be any growth there not done by AO.

Edit: noticed now and can't avoid giving it a comment.
On OPTILOGISTIC_DATASTORE. 0.1% (128MB) of the capacity is responsible for 93.7% of the IO on that volume. As long as it is the same 128MB MB every day, you will seriously never find a better candicate for AO than that volume :) (even though the numbers and volume is low)


Top
 Profile  
Reply with quote  
 Post subject: Re: Adaptive Optimization
PostPosted: Thu Jan 24, 2019 6:08 am 

Joined: Thu Mar 01, 2018 3:04 am
Posts: 15
Thanks, very good analyze !

So if i understand,
i need only about 500GB for hot block to move to SSD
Vvol on SSD are sleeping
you advise me to turn on AO on all VV

I'll planning to:
phase one:
try to activate AO with a limit of 500GB on view what happened

phase two:
move the 2 only VM on SSD datastore to FC datastore
remove this 2 vv
active AO on all volumes and dedicated SSD space to AO

if AO is used, what about flash cache ?

what do you think about it ?

note: 3par_as49_datastore and 3par_optilogistic_datastore is not used. I 'll plan to delete it.


Last edited by abelliot on Mon Jan 28, 2019 4:54 am, edited 1 time in total.

Top
 Profile  
Reply with quote  
 Post subject: Re: Adaptive Optimization
PostPosted: Thu Jan 24, 2019 6:54 am 

Joined: Thu Mar 01, 2018 3:04 am
Posts: 15
Do you think I can already apply the AO for all VV ?
is there a risk to apply AO ?

Do you think it's better to test before on a new CPG ?


Last edited by abelliot on Mon Jan 28, 2019 4:57 am, edited 1 time in total.

Top
 Profile  
Reply with quote  
 Post subject: Re: Adaptive Optimization
PostPosted: Thu Jan 24, 2019 7:22 am 

Joined: Mon Sep 21, 2015 2:11 pm
Posts: 764
Location: Europe
Depending on what licenses you have, I would:

1. Disable FlashCache (you could check FMP column in srstatcmp to see if it actually does anything)
2. Delete all volumes you are planning on deleting
3. Create AO config with existing CPGs (since you've deleted FlashCache you should have some free space) and create schedule to run once per day. (NB Requires AO license)
4. Tune User CPG for SSD volumes back to FC CPG (which is now in AO) (NB requires DO license)
5. Sit back and wait a couple of days and run new reports to see if there is any improvement.


Top
 Profile  
Reply with quote  
 Post subject: Re: Adaptive Optimization
PostPosted: Thu Jan 24, 2019 2:54 pm 

Joined: Thu Mar 01, 2018 3:04 am
Posts: 15
Very Very Thanks MammaGutt.

I have all the license (AO,DO).
I'll apply all of these this next week.


Top
 Profile  
Reply with quote  
 Post subject: Re: Adaptive Optimization
PostPosted: Mon Jan 28, 2019 2:35 am 

Joined: Fri Jun 27, 2014 2:01 am
Posts: 386
You can also tune your FC CPG to raid 5 7+1 rather than raid 6 8+2 : lower latences and more capacity.

One very cool parameter in AO, on latest Inform OS releases ( >= 3.2.2 MU3 i think), is "t0min" which forces the allocation of data on SSD tier.

Another good thing would be to stop talking of VVOL (VMware Virtual Volume) instead of VV (3PAR Virtual Volume) ;)
Correct me if i'm wrong.


Top
 Profile  
Reply with quote  
 Post subject: Re: Adaptive Optimization
PostPosted: Mon Jan 28, 2019 5:05 am 

Joined: Thu Mar 01, 2018 3:04 am
Posts: 15
Sorry for the confusion between VV and VVol, i'had correct this.

For R6, a HPE engineer tell us it was better for security raison but in fact we have loss performance :?

I am waiting HPE to install this patch (HPE 3PAR OS 3.2.2 MU6 Patch 138) before launch the action plan.


Top
 Profile  
Reply with quote  
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 20 posts ]  Go to page 1, 2  Next


Who is online

Users browsing this forum: Google [Bot] and 9 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group | DVGFX2 by: Matt