Cisco Cytalyst 3850 „{/tmp/packages.conf} does not exist“ boot loop

Heute ein Software Upgrade eines Cisco Catalyst 3850 Stack gemacht. Im Stack enthalten:

  • Switch 1) WS-C3850-12XS
  • Switch 2) WS-C3850-12XS
  • Switch 3) WS-C3850-24T.  

Die Switch kamen Werkseitig geliefert mit 16.2.2, diese IOS wird bei Cisco als defered gelisted und sollte nicht mehr verwendet werden:

Kurzerhand auf cisco.com geschaut, welches die empfohlene Release für den WS-C3850-24T ist, diese wird mit 3.6.6E(MD) gelistet.

SPOILER ALERT: Das Problem an der Sache ist, dass die IOSXE 3.6.6E(MD) nicht von den   WS-C3850-12XS unterstützt wird, man muss mindestens auf die 3.7.5E(ED) gehen. 

 

Nach dem Upgrade des Stacks mittels des Befehls:

Switch#request platform software package clean switch all file flash:

befanden sich die WS-C3850-12XS in einem Bootloop:

Booting...
Interface GE 0 link down***ERROR: PHY link is down
Getting rest of image
Reading full image into memory...Check base package header ...: done = 16384
Getting rest of image
Reading full image into memory....done
Reading full base package into memory...: done = 83293932
Bundle Image
--------------------------------------
Kernel Address : 0x5342e34c
Kernel Size : 0x41852f/4293935
Initramfs Address : 0x5384687c
Initramfs Size : 0xe7766d/15169133
Compression Format: .mzip
Bootable image at @ ram:0x5342e34c
Bootable image segment 0 address range [0x81100000, 0x82140000] is in range [0x80180000, 0x90000000].
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@boot_system: 377
Loading Linux kernel with entry point 0x8166a600 ...
Bootloader: Done loading app on core_mask: 0x3f
### Launching Linux Kernel (flags = 0x5)
 
%IOSXEBOOT-4-ABORT: (rp/0): Package provisioning file {/tmp/packages.conf} does not exist.
%IOSXEBOOT-4-ABORT: (rp/0): Package provisioning file {/tmp/packages.conf} does not exist.
 
Booting...
Interface GE 0 link down***ERROR: PHY link is down
Getting rest of image
Reading full image into memory...Check base package header ...: done = 16384
Getting rest of image
Reading full image into memory....done

usw....

 

Um den Bootloop zu unterbrechen und in den Rommon zu gelangen, muss den Mode Button beim Start relativ lange drücken:

Booting...
Interface GE 0 link down***ERROR: PHY link is down
The system has been interrupted prior to initializing some
filesystems and loading the operating system software.
Console will be reset to 9600 baud rate, need to change terminal setting first.
The following commands will initialize the remaining filesystems, 
and finish loading the operating system software:
flash_init
 boot

switch: ? 
 ? -- Present list of available commands
 arp -- Show arp table or arp-resolve an address
 boot -- Load and boot an executable image
 cat -- Concatenate (type) file(s)
 copy -- Copy a file
 delete -- Delete file(s)
 dir -- List files in directories
emergency-install -- Initiate Disaster Recovery
 flash_init -- Initialize filesystem(s)
 format -- Format a filesystem
 fsck -- Check filesystem consistency
 help -- Present list of available commands
 mgmt_init -- initialize management port
 mkdir -- Create dir(s)
 more -- Concatenate (display) file(s)
 ping -- Send ICMP ECHO_REQUEST packets to a network host
 readrtc -- Read RTC
 rename -- Rename a file
 reset -- Reset the system
 rmdir -- Delete empty dir(s)
 set -- Set or display environment variables
 set_bs -- Set attributes on a boot sector filesystem
 set_param -- Set system parameters in flash
 type -- Concatenate (type) file(s)
 unset -- Unset one or more environment variables
 version -- Display boot loader version
 writertc -- Write RTC

Um die Software wiederherzustellen, kann man nun ein „emergency_install“ durchführen. Dazu das IOSXE Bin file auf einen FAT32 USB Stick kopieren und am Front USB Port des 3850 stecken. Danach flash mounten und das emergency_install ab USB durchführen.

switch: flash_init
Initializing Flash...
flashfs[7]: 0 files, 1 directories
flashfs[7]: 0 orphaned files, 0 orphaned directories
flashfs[7]: Total bytes: 6784000
flashfs[7]: Bytes used: 1024
flashfs[7]: Bytes available: 6782976
flashfs[7]: flashfs fsck took 1 seconds....done Initializing Flash.
 
switch: dir usbflash0:
Directory of usbflash0:/
1 -rw- 328618032 cat3k_caa-universalk9.SPA.03.07.05.E.152-3.E5.bin
1674125312 bytes available (328663040 bytes used)
 
switch: emergency-install usbflash0:/cat3k_caa-universalk9.SPA.03.07.05.E.152-3.E5.bin
The bootflash will be erased during install operation, continue (y/n)?y
Starting emergency recovery (usbflash0:/cat3k_caa-universalk9.SPA.03.07.05.E.152-3.E5.bin)...
Reading full image into memory........................done
Bundle Image
--------------------------------------
Kernel Address : 0x5344d5d4
Kernel Size : 0x3faba9/4172713
Initramfs Address : 0x53848180
Initramfs Size : 0xdf2d3b/14626107
Compression Format: .mzip
Bootable image at @ ram:0x5344d5d4
Bootable image segment 0 address range [0x81100000, 0x820a0000] is in range [0x80180000, 0x90000000].
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
File "sda9:cat3k_caa-recovery.bin" uncompressed and installed, entry point: 0x816733a0
Loading Linux kernel with entry point 0x816733a0 ...
Bootloader: Done loading app on core_mask: 0x3f
### Launching Linux Kernel (flags = 0x5)
 
Initiating Emergency Installation of bundle usbflash0:/cat3k_caa-universalk9.SPA.03.07.05.E.152-3.E5.bin
 
Reading bundle usbflash0:/cat3k_caa-universalk9.SPA.03.07.05.E.152-3.E5.bin...
Validating bundle usbflash0:/cat3k_caa-universalk9.SPA.03.07.05.E.152-3.E5.bin...
Installing bundle usbflash0:/cat3k_caa-universalk9.SPA.03.07.05.E.152-3.E5.bin... 
Verifying bundle usbflash0:/cat3k_caa-universalk9.SPA.03.07.05.E.152-3.E5.bin...
Package cat3k_caa-base.SPA.03.07.05E.pkg is Digitally Signed
Package cat3k_caa-drivers.SPA.03.07.05E.pkg is Digitally Signed
Package cat3k_caa-infra.SPA.03.07.05E.pkg is Digitally Signed
Package cat3k_caa-iosd-universalk9.SPA.152-3.E5.pkg is Digitally Signed
Package cat3k_caa-platform.SPA.03.07.05E.pkg is Digitally Signed
Package cat3k_caa-wcm.SPA.10.3.150.0.pkg is Digitally Signed
Preparing flash... 
Syncing device... 
Emergency Install successful... Rebooting
Restarting system.
 
Booting...
Interface GE 0 link down***ERROR: PHY link is down
Getting rest of image
Reading full image into memory...Check base package header ...: done = 16384
Getting rest of image
Reading full image into memory....done
Reading full base package into memory...: done = 82000420
Bundle Image
--------------------------------------
Kernel Address : 0x5342f34c
Kernel Size : 0x3fb255/4174421
Initramfs Address : 0x5382a5a4
Initramfs Size : 0xd47c7e/13925502
Compression Format: .mzip
Bootable image at @ ram:0x5342f34c
Bootable image segment 0 address range [0x81100000, 0x820b0000] is in range [0x80180000, 0x90000000].
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@boot_system: 377
Loading Linux kernel with entry point 0x816734a0 ...
Bootloader: Done loading app on core_mask: 0x3f
### Launching Linux Kernel (flags = 0x5)
All packages are Digitally Signed
Starting System Services
devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=4,mode=600,ptmxmode=000 0 0
 
FIPS(NGWC): Flash Key Check : Begin
FIPS(NGWC): Flash Key Check : End, Not Found, FIPS Mode Not Enabled
Feb 1 11:09:46 %SMN_HBL_LICENSE-3-FILE_READ_ERR: Bad file descriptor: License file read failed.
Feb 1 11:10:28 %STACKMGR-1-STACK_LINK_CHANGE: Stack port 2 on switch 2 is up
Feb 1 11:11:07 %STACKMGR-1-STACK_LINK_CHANGE: Stack port 2 on switch 2 is down
Feb 1 11:11:07 %STACKMGR-1-RELOAD: Reloading due to reason active removed before switch became ready
Feb 1 11:11:07 %IOSXE-3-PLATFORM: process sysmgr: Reset/Reload requested by [stack-manager].
<Thu Feb 1 11:11:07 2018> Message from sysmgr: Reason Code:[4] Reset Reason:Reset/Reload requested by [stack-manager]. [active removed before switch became ready]
get_local: failed: No such file or directory
Unmounting ng3k filesystems...
Warning! - some ng3k filesystems may not have unmounted cleanly...
Please stand by while rebooting the system...
Restarting system.

 

E voila

Samuel Heinrich
Senior Network Engineer at Alpiq Intec (Basel, Switzerland)
Arbeitet in Raum Basel (Switzerland) als Senior Network Engineer mit über 10 Jahren Erfahrung im Bereich Netzwerk und Telekommunikation.

One thought on “Cisco Cytalyst 3850 „{/tmp/packages.conf} does not exist“ boot loop

Schreibe einen Kommentar

Deine E-Mail-Adresse wird nicht veröffentlicht. Erforderliche Felder sind mit * markiert.