HPE Storage Users Group

A Storage Administrator Community




Post new topic Reply to topic  [ 6 posts ] 
Author Message
 Post subject: 3par 7200 3.2.1 MU3 OS upgrade problem
PostPosted: Wed Sep 06, 2017 2:22 am 

Joined: Mon Dec 12, 2016 9:30 am
Posts: 9
Hello community

I have problems trying to upgrade 3par 7200 OS 3.2.1 MU3 to 3.2.2 MU4 through SPOOC

The upgrade started normally and it looks like node0 upgraded, but after that the upgrade failed

(Rebooting node 0.

Error The cache server is waiting for the system manager to finish reporting the system configuration and status. Please try again later.
The upgrade has failed. Please view the messages above and contact HP Customer Support (Error Code 1))


Than I tried servicemag status command, and the output was :

{System manager is still initializing - try this command later.
Use 'showsysmgr' to see the current system state.} 0 0 0
cli% showsysmgr
Cannot reach TOC quorum. Use 'setsysmgr' to set system manager startup state.

Reason for being unable to automatically start:
TOC information preserved in powerfail save on node 0 but missing nodes from mask 0x03. Run "setsysmgr tocgen" to start despite this.

Than I ran setsysmgr tocgen and the system was started up but shownode command only shows node0.

This is upgrade status output:

upgradesys -status

Node 0: 3.2.1.MU3 (old)
Node 1: Unknown (rebooting)
Next node to be rebooted is node 0
3PAR cli

We tried to reseat node1 and halt whole 3par controller enclosure waiting for batteries to discharge, and after that the problem was still there

The storage system does not have production data on itself

Any iea wht could be wrong?

Thanks


Top
 Profile  
Reply with quote  
 Post subject: Re: 3par 7200 3.2.1 MU3 OS upgrade problem
PostPosted: Wed Sep 06, 2017 7:37 am 

Joined: Wed Sep 06, 2017 7:31 am
Posts: 5
Hello,
I would recommend to connect with serial line to the node.
In the past I had an upgrade where the internal Card with boot image was dead....
Mathias


Top
 Profile  
Reply with quote  
 Post subject: Re: 3par 7200 3.2.1 MU3 OS upgrade problem
PostPosted: Thu Sep 07, 2017 8:59 am 

Joined: Mon Dec 12, 2016 9:30 am
Posts: 9
Thank you Mathias for your answer, I have connected with serial cable tothe problematic node, and the checkhealth output is:

1. Out Of The Box Procedure
2. Re-enter network configuration
3. Update the CBIOS
4. Enable or disable CLI error injections
5. Perform a Node-to-Node rescue
6. Set up the system to wipe and rerun ootb
7. Cancel a wipe
8. Perform a deinstallation
9. Update the system for recently added hardware (admithw)
10. Check system health (checkhealth)
11. Exit
> 10
Could not open connection to CLI server process tpdtcl, it has not yet
started or has failed


Top
 Profile  
Reply with quote  
 Post subject: Re: 3par 7200 3.2.1 MU3 OS upgrade problem
PostPosted: Wed Sep 13, 2017 6:11 am 

Joined: Wed Sep 06, 2017 7:31 am
Posts: 5
Hello Miho,

Hmmm....
For me it sounds like calling HP...
If it is not a productive 3par and has no support I can imagine that node-to-node rescue can be an option. May be...
Last post here: http://3parug.com/viewtopic.php?f=18&t=1554 sounds also interesting. Maybe a clean boot disk is the way....
But my preference is calling HP....
Good luck

Mathias


Top
 Profile  
Reply with quote  
 Post subject: Re: 3par 7200 3.2.1 MU3 OS upgrade problem
PostPosted: Mon Sep 18, 2017 10:13 am 

Joined: Mon Apr 28, 2014 4:51 pm
Posts: 38
Location: Rockford, MI
I highly recommend that you call support, with that being said I have run into this issue twice, once on a 7200 and the other time on a 7400 and I had to perform a node rescue. If you choose to proceed with this on your own here are the procedures I followed:

• Connect to good node in NP Node via the serial cable
• Verify active network is on the good node in the NP (shownet) 
• If other node is the active then issue the setnet changenode <#>  
• Verify Node that you want to rescue has a network cable plugged into mgmt port
• Shutdown Node that needs rescued (shutdownnode halt #) 
• Verify Node is down with blue led 
• Start Node Rescue (startnoderescue -node #) 
• Move serial cable over to Node and watch rescue operation
• Once complete and at login prompt, move cable back over to master Node
• Verify rescued Node is in cluster (shownode) 
• Verify there are no space issue (checkhealth -svc -detail file) 

Please note that on the 7000 series arrays the node rescue is performed across the network interface.

_________________
Adam Berus - I.S. Tech Lead - Wolverine Worldwide Inc.
x1-7200, x2-7400, x1-7450, x1-8400, x2-8440
3PAR Technologies: AFC, AO, FilePersona, RemoteCopy (RCIP)


Top
 Profile  
Reply with quote  
 Post subject: Re: 3par 7200 3.2.1 MU3 OS upgrade problem
PostPosted: Tue Oct 03, 2017 7:52 am 

Joined: Mon Dec 12, 2016 9:30 am
Posts: 9
Thank you all for your advices and contribution,
We solved the problem by replacing problematic node,
Although we still do not know what is the problem with old one (LEDs and logs look OK, but it just does not work-it can not join cluster, and we tried a lot of things)
I suppose the problem is with node ssd, I will try to replace it with new one and see what happens
when I put the node in the storage and try to copy the OS from the good one

Thanks


Top
 Profile  
Reply with quote  
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 6 posts ] 


Who is online

Users browsing this forum: Google [Bot] and 47 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group | DVGFX2 by: Matt