Jump to content
XPEnology Community

No Synology Login Screen and Lost access to two Healthy Volume Groups after failed install of Container Manager


Rhubarb

Recommended Posts

System is Supermicro M'brd X11SSL-CF including 8xSAS (Storage Pool 1, volume 1); Kaby Lake Xeon E3-1245v6; second 8 port SAS controller in PCIe slot (Storage Pool 2, volume 2); two GbE ports.  Both Storage Pools are completely populated with 16TB HDDs (14 x Exos 16; 2x IronWolf).  All files/folders are BTRFS. DSM 7.2-64570 Update 1.

Trying to Install Container Manager yesterday caused the install to 'hang' - nothing happened for several hours and unable to cancel/end the install, I tried to force shutdown/restart the system with damaging consequences. Now no applications are working; the system is not showing up in Synology Assistant and it was not possible to get a login until we ran the command "syno-ready" via a "Putty" session to the system.


We've managed to reboot the system; and using "PUTTY", we've managed to mount the disks: Storage Pools/volumes (appear intact and can be read).

Some screen captures are available of what's been achieved, so far.

root@dumbo:/dev/mapper# lvdisplay
  --- Logical volume ---
  LV Path                /dev/vg2/syno_vg_reserved_area
  LV Name                syno_vg_reserved_area
  VG Name                vg2
  LV UUID                7In8lA-Tkar-3pbr-4Hl7-aVVH-G3lY-GV905o
  LV Write Access        read/write
  LV Creation host, time ,
  LV Status              available
  # open                 0
  LV Size                12.00 MiB
  Current LE             3
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     1536
  Block device           249:0

  --- Logical volume ---
  LV Path                /dev/vg2/volume_2
  LV Name                volume_2
  VG Name                vg2
  LV UUID                TuHfCo-Ui9K-VlYg-TzLg-AIQL-eYTu-V5fOVu
  LV Write Access        read/write
  LV Creation host, time ,
  LV Status              available
  # open                 1
  LV Size                87.26 TiB
  Current LE             22873600
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     1536
  Block device           249:1

  --- Logical volume ---
  LV Path                /dev/vg1/syno_vg_reserved_area
  LV Name                syno_vg_reserved_area
  VG Name                vg1
  LV UUID                ywtTe5-Nxt7-L3Q3-o9mZ-KGrt-hnfe-3zpE5r
  LV Write Access        read/write
  LV Creation host, time ,
  LV Status              available
  # open                 0
  LV Size                12.00 MiB
  Current LE             3
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     1536
  Block device           249:2

  --- Logical volume ---
  LV Path                /dev/vg1/volume_1
  LV Name                volume_1
  VG Name                vg1
  LV UUID                2SBxA1-6Nd6-Z9B2-M0lx-PL8x-NFjv-KkxqT3
  LV Write Access        read/write
  LV Creation host, time ,
  LV Status              available
  # open                 1
  LV Size                87.29 TiB
  Current LE             22882304
  Segments               2
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     1536
  Block device           249:3


root@dumbo:/dev/mapper# lvm vgscan
  Reading all physical volumes.  This may take a while...
  Found volume group "vg2" using metadata type lvm2
  Found volume group "vg1" using metadata type lvm2


root@dumbo:/dev/mapper# lvm lvscan
  ACTIVE            '/dev/vg2/syno_vg_reserved_area' [12.00 MiB] inherit
  ACTIVE            '/dev/vg2/volume_2' [87.26 TiB] inherit
  ACTIVE            '/dev/vg1/syno_vg_reserved_area' [12.00 MiB] inherit
  ACTIVE            '/dev/vg1/volume_1' [87.29 TiB] inherit

root@dumbo:/# cat /proc/mdstat
Personalities : [raid1] [raid6] [raid5] [raid4] [raidF1]
md3 : active raid6 sdi6[0] sdl6[7] sdj6[6] sdn6[5] sdm6[4] sdp6[3] sdk6[2] sdo6[1]
      46871028864 blocks super 1.2 level 6, 64k chunk, algorithm 2 [8/8] [UUUUUUUU]

md2 : active raid6 sdi5[0] sdk5[6] sdp5[7] sdm5[8] sdn5[9] sdo5[3] sdl5[11] sdj5[10]
      46855172736 blocks super 1.2 level 6, 64k chunk, algorithm 2 [8/8] [UUUUUUUU]

md4 : active raid6 sda5[0] sdh5[7] sdg5[6] sdf5[5] sde5[4] sdd5[3] sdc5[2] sdb5[1]
      93690928896 blocks super 1.2 level 6, 64k chunk, algorithm 2 [8/8] [UUUUUUUU]

md1 : active raid1 sdi2[0] sdh2[12](S) sdc2[13](S) sdb2[14](S) sda2[15](S) sdf2[11] sdd2[10] sde2[9] sdg2[8] sdo2[7] sdm2[6] sdn2[5] sdp2[4] sdk2[3] sdl2[2] sdj2[1]
      2097088 blocks [12/12] [UUUUUUUUUUUU]

md0 : active raid1 sdi1[0] sda1[12](S) sdb1[13](S) sdc1[14](S) sdh1[15](S) sdf1[11] sdd1[10] sde1[9] sdg1[8] sdo1[7] sdl1[6] sdm1[5] sdn1[4] sdp1[3] sdj1[2] sdk1[1]
      2490176 blocks [12/12] [UUUUUUUUUUUU]


root@dumbo:/dev/mapper# vgchange -ay
  2 logical volume(s) in volume group "vg2" now active
  2 logical volume(s) in volume group "vg1" now active


root@dumbo:/dev/mapper# mount /dev/vg1/volume_1 /volume1
mount: /volume1: /dev/vg1/volume_1 already mounted or mount point busy.


Main Question Now is:  How to repair the system such that:
a:  It appears to Synology Assistant as a functioning DS3622XS+ with correct IP, Status, MAC address, Version, Model and Serial no.
b:  It functions again correctly; presenting Login prompt and applications work correctly and accessing relevant data in Storage Pools/Volumes/Folders and files.

In the absence of responses of workable solutions, we're considering actually "blowing away" backed up data (Storage Pool 2/Volume 2), Creating a new system on that volume group, then copying back the data stored in the original Storage Pool 1/Volume 1 to the new installation.


 

Edited by Rhubarb
added DSM version
Link to comment
Share on other sites

As you will see, our problem is that DSM 7.2-64570 Update 1, is not loading these storage pools/volumes automatically on bootup. Even when loaded and accessible by the System, these volumes/data are not being managed by DSM.

In fact,

 when you boot up, initially Storage manager shows the volumes as crashed until you mount them with the commands:

 mount -v /dev/mapper/cachedev_1 /volume1
mount -v /dev/mapper/cachedev_0 /volume2

 

Here you can see that many packages are not running:

InstalledPackages-manynotrunning.thumb.jpg.7df994d4a9c79f9bfd9342982df1c675.jpg

Additional info:

Creating a new share causes this problem:

CreatinganewSharecausesthiserror.thumb.jpg.02e9617e0991a60a2d4fd04d0a9017bd.jpg

 

Shares are not visible in File Station:

 

SharesarenotvisibleinFileStation.thumb.jpg.2e506a6d4b60cfc4e36c2e94b0f00c3e.jpg

 

Apps Fail to Start:

AllAppsFailtostart.thumb.jpg.a418166454a1b44a76cbb2bc8724c74d.jpg

Shares are not visible in File Station.jpg

Edited by Rhubarb
additional data re Package Centre packages not running
Link to comment
Share on other sites

Problem solved:

Updated /etc/fstab with the following details:
/dev/mapper/cachedev_0 /volume2 btrfs auto_reclaim_space,ssd,synoacl,relatime,nodev 0 0
/dev/mapper/cachedev_1 /volume1 btrfs auto_reclaim_space,ssd,synoacl,relatime,nodev 0 0

Then we ran the Synology DSM re-install Script: https://github.com/007revad/Synology_DSM_reinstall

After that we manually installed the 7.2 Update 1 pat file, from within the DSM console

After reboot disks were retained and mounted correctly; DSM was fully functional again.

All Shares and applications were ok.

Container manager was still freezing on install, until container manager was on volume2. Not sure whats happening but seemed to be similar to these guys here on reddit: https://www.reddit.com/r/synology/comments/13s4bat/latest_container_manager_update_from_today_52523/

I'm very happy its back!

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...