3PAR Users Group

A Storage Administrator Community




Post new topic Reply to topic  [ 5 posts ] 
Author Message
 Post subject: Upgrade hangs at rebooting node0 from 3.2.1MU4 to 3.3.1MU2
PostPosted: Tue Feb 05, 2019 7:31 am 

Joined: Tue Jul 08, 2014 2:56 pm
Posts: 38
Hello,
when trying to ugprade from 3.2.1MU4 to 3.3.1MU2, the update hangs after trying to reboot node 0. But the node never got booted:

Quote:
2019-02-05 10:05:48 CET Substituting package for staged
2019-02-05 10:05:48 CET Beginning upgrade of system software.
2019-02-05 10:05:48 CET
2019-02-05 10:05:48 CET Extracting...
2019-02-05 10:06:01 CET ..|
2019-02-05 10:06:01 CE
2019-02-05 10:06:01 CET Applying new package...
2019-02-05 10:06:02 CET Calculating checksums...
2019-02-05 10:06:11 CET Performing pre-update checks...
2019-02-05 10:06:18 CET Distributing package to all nodes...
2019-02-05 10:06:26 CET ..tar: tpdpackage: time stamp 2019-02-05 10:06:02 is 41.051967933 s in the future
2019-02-05 10:06:27 CERunning preupdate scripts...
2019-02-05 10:06:28 CET Installing base filesystem
2019-02-05 10:06:42 CET Installing to partition: 3
2019-02-05 10:06:46 CET Installing software...
2019-02-05 10:07:53 CET IDE disk of node 0 updated successfully.
2019-02-05 10:07:53 CET IDE disk of node 1 updated successfully.
2019-02-05 10:07:53 CET Update complete.
2019-02-05 10:07:53 CET
2019-02-05 10:07:53 CET Update successful.
2019-02-05 10:07:54 CET Checking if the system is healthy enough to proceed...
2019-02-05 10:07:55 CET
2019-02-05 10:07:55 CET
2019-02-05 10:07:55 CET The current system configuration is valid for proceeding with an online upgrade.
2019-02-05 10:07:56 CET
2019-02-05 10:07:56 CET
2019-02-05 10:07:56 CET Rebooting node 0.


Any ideas? I already opened a case and keep this thread updated.

Cheers,
Thomas


Top
 Profile  
Reply with quote  
 Post subject: Re: Upgrade hangs at rebooting node0 from 3.2.1MU4 to 3.3.1M
PostPosted: Tue Feb 05, 2019 7:58 am 

Joined: Mon Sep 21, 2015 2:11 pm
Posts: 931
Location: Europe
I'm guessing one of four.

1. Node0 rebooted, management interface failed over to node1 which for some reason is connected to the wrong VLAN or something resulting in the SP no longer being able to connect to the 3PAR.
2. Node0 rebooted, failed and is down.
3. Node0 rebooted but for some reason is unable to rejoin the cluster. Using the update tool is checking and fixing some of these issues so if the update tool was used this is unlikely.
4. System crashed during upgrade and 3PAR is down.

_________________
The views and opinions expressed are my own and do not necessarily reflect those of my current or previous employers.


Top
 Profile  
Reply with quote  
 Post subject: Re: Upgrade hangs at rebooting node0 from 3.2.1MU4 to 3.3.1M
PostPosted: Tue Feb 05, 2019 8:29 am 

Joined: Tue Jul 08, 2014 2:56 pm
Posts: 38
Hello,
node0 has not rebooted. Since we're still logged in via SSH. However most commands hang. But
I can issue a upgradedsys -getlog which shows the above. showalert and showtask. No tasks are
active. In the alerts it says that an upgrade is in progress.

Cheers,
Thomas


Top
 Profile  
Reply with quote  
 Post subject: Re: Upgrade hangs at rebooting node0 from 3.2.1MU4 to 3.3.1M
PostPosted: Tue Feb 05, 2019 8:37 am 

Joined: Mon Sep 21, 2015 2:11 pm
Posts: 931
Location: Europe
I'm guessing as commands hang you can't do "shownode" ... What about "statport -host" traffic on everything?

If node0 hasn't rebooted then I'm guessing you're not in the worst shape. Probably some management service hanging (sysmgr?) so support could probably cancel the upgrade and restart the service and get back to square one.

_________________
The views and opinions expressed are my own and do not necessarily reflect those of my current or previous employers.


Top
 Profile  
Reply with quote  
 Post subject: Re: Upgrade hangs at rebooting node0 from 3.2.1MU4 to 3.3.1M
PostPosted: Tue Feb 05, 2019 11:09 am 

Joined: Tue Jul 08, 2014 2:56 pm
Posts: 38
Hello,
with the help of a forum member I resetted node 0 using a console cable. Afterwards I could do a upgradesys -abort and started from square one. But now I go a different path:

Quote:
[x] SP 4.4 MU6
[x] 3.2.2 MU6
[x] SP 4.5 MU4
[ ] 3PAR_SW_Upgrade_Tool_U018_QR482-11389.iso
[ ] 3.3.1 MU2
[ ] SP 5.0.4
[ ] P30
[ ] P32
[ ] P34
[ ] P37
[ ] P38
[ ] P39
[ ] P40
[ ] P41
[ ] P42
[ ] P45
[ ] P48


Still waiting for HPE support to call me back.

Cheers,
Thomas


Top
 Profile  
Reply with quote  
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 5 posts ] 


Who is online

Users browsing this forum: Google [Bot] and 34 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group | DVGFX2 by: Matt