SirIanthe3rd

No, unfortunately I gave up and got to a point where I got the RAID healthy enough and migrated to OMV. It imports right into OMV since it's just Linux software RAID. Haven't had a problem since. It was definitely some critical bug in Synology or Xpenology, not sure. I wouldn't trust it with my data again.

I'm rebuilding the array now. Hopefully will be done by tomorrow night.

Nothing wrote to the array, but I think the OS probably marked it degraded because two drives were no longer present. We can continue, but at this point I'll have to go through another 36 hour resync unless you know of a way to workaround that.

So I removed the disk and controller and put the grub settings back to default: set sata_args='sata_uid=1 sata_pcislot=5 synoboot_satadom=1 DiskIdxMap=0C SataPortMap=1 SasIdxMap=0' and the two drives are showing back up, but they've fallen out of the array. I really don't care about the numbers or order at this point. Can we get the drives back in the array without doing a full resync?

synoinfo.conf So I just a lspci -nn -q and it shows the first two sata controllers as lower numbers, but the lsi controller shows up as a sas controller. Would that make a difference in the grub config? 0000:02:01.0 SATA controller [0106]: VMware SATA AHCI controller [15ad:07e0] 0000:02:02.0 SATA controller [0106]: VMware SATA AHCI controller [15ad:07e0] 0000:03:00.0 Ethernet controller [0200]: Intel Corporation 82574L Gigabit Network Connection [8086:10d3] 0000:0b:00.0 Serial Attached SCSI controller [0107]: Broadcom / LSI SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] [1000:0072] (rev 03)

I also vaguely remember editing the synoinfo.conf files for esataportcfg when I was first setting this up. Could that be related? To answer your other questions, yes I've built this VM to whatever the guide was at the time. The only difference is that I've added more RAM and procs because I was running surveillance station and resilio sync on it.

Yes it's vCenter 7. If I login to the host directly, I do not see those devices. However, I think the IDE controllers might be related to the floppy and CD drives.

New GRUB setting did not affect the disks. VMware ESXi, 6.7.0, 13981272

Under other devices there are a couple of IDE controllers. I don't have the ability to remove them however.

Seems like the position of the disks is wrong so it's masking the other ones attached.

It's unchanged.

I'm not sure what you mean by modify. The only thing I can do with it is remove it and re-add. I have to shut off the VM to do it though.

same problem: Looks like the positions of the drives have changed. root@ismhomenas:/mnt/synoboot1/grub# cat grub.cfg | grep sata set sata_args='sata_uid=1 sata_pcislot=5 synoboot_satadom=1 DiskIdxMap=0C00 SataPortMap=1 SasIdxMap=0'

Same problem: root@ismhomenas:/mnt/synoboot1/grub# cat grub.cfg | grep sata set sata_args='sata_uid=1 sata_pcislot=5 synoboot_satadom=1 DiskIdxMap=000C08 SataPortMap=811 SasIdxMap=0'

No I do not.

if serial --port=0x3F8 --speed=115200;then set has_serial=true terminal_input --append serial terminal_output --append serial else clear fi terminal_input --append console terminal_output --append console if [ x"${grub_platform}" = xefi ]; then insmod efi_gop insmod efi_uga else insmod vbe fi set extra_initrd="extra.lzma" set info="info.txt" set vid=0x058f set pid=0x6387 set sn=C7LWN09761 set mac1=0011322CA785 set rootdev=/dev/md0 set netif_num=1 set extra_args_3615='' set common_args_3615='syno_hdd_powerup_seq=0 HddHotplug=0 syno_hw_version=DS3615xs vender_format_version=2 console=ttyS0,115200n8 withefi elevator=elevator quiet syno_port_thaw=1' set sata_args='sata_uid=1 sata_pcislot=5 synoboot_satadom=1 DiskIdxMap=0C0001 SataPortMap=118 SasIdxMap=0' set default='0' set timeout='1' set fallback='1' if [ -s $prefix/grubenv ]; then load_env if [ -n "$saved_entry" ]; then set default="${saved_entry}" fi fi VERSION="with Jun's Mod v1.02b" search --file -s /zImage function savedefault { if [ -s $prefix/grubenv ]; then saved_entry="${chosen}" save_env saved_entry fi } function do_option { if [ $# -lt 2 ]; then eval "set value=\"\$$1\"" echo "current $1: $value"; return; fi set key=$1 shift set $key="$*" if [ -s $prefix/grubenv ]; then save_env $key fi } function vid { do_option vid $@; } function pid { do_option pid $@; } function sn { do_option sn $@; } function mac1 { do_option mac1 $@; } function mac2 { do_option mac2 $@; } function mac3 { do_option mac3 $@; } function mac4 { do_option mac4 $@; } function rootdev { do_option rootdev $@; } function append { do_option extra_args_3615 $@; } function vidpid { if [ $# -lt 2 ]; then echo "usage: vidpid 0xVVVV 0xPPPP"; return; fi set usb_args="vid=$1 pid=$2" if [ -s $prefix/grubenv ]; then save_env usb_args fi } function showtips { if [ -n "$has_serial" ]; then terminal_output --remove serial fi echo "Screen will stop updating shortly, please open http://find.synology.com to continue." echo echo if [ -n "$has_serial" ]; then terminal_output --append serial fi } function loadinitrd { if [ -s $img/$info ]; then if [ -n "$has_serial" ]; then terminal_output --remove serial fi cat $img/$info if [ -n "$has_serial" ]; then terminal_output --append serial fi fi if [ -s $img/$extra_initrd ]; then initrd $img/rd.gz $img/$extra_initrd else initrd $img/rd.gz fi } function common_add_option { eval "set value=\"\$$1\"" if [ -z $value ]; then return 1; fi set common_args="$common_args $1=$value" } function common_add_option_ex { eval "set value=\"\$$1\"" if [ -z $value ]; then return 1; fi set common_args="$common_args $2=$value" } function loadlinux { set model=$1 set bootdev=$2 shift 2 if [ -n $vid -a -n $pid ]; then set usb_args="vid=$vid pid=$pid" fi eval "set common_args=\"\$common_args_$model\"" eval "set extra_args=\"\$extra_args_$model\"" eval "set bootdev_args=\"\$${bootdev}_args\"" common_add_option_ex rootdev root common_add_option sn if common_add_option mac1; then set netif_num=1; fi if common_add_option mac2; then set netif_num=2; fi if common_add_option mac3; then set netif_num=3; fi if common_add_option mac4; then set netif_num=4; fi common_add_option netif_num if [ -z $zImage ]; then set zImage=zImage fi linux $img/$zImage $common_args $bootdev_args $extra_args $@ } menuentry "DS3615xs 6.1 Baremetal $VERSION" --class os { set img= savedefault loadlinux 3615 usb loadinitrd showtips } menuentry "DS3615xs 6.1 Baremetal $VERSION Reinstall" --class os { set img= loadlinux 3615 usb mfg loadinitrd showtips } #menuentry "DS3615xs 6.1 Baremetal AMD $VERSION" --class os { # set img= # set zImage=bzImage # savedefault # loadlinux 3615 usb # loadinitrd # showtips #} menuentry "DS3615xs 6.1 VMWare/ESXI $VERSION" --class os { set img= savedefault loadlinux 3615 sata loadinitrd showtips }

This is what I had the 20GB disk for before. It's removed now. I went ahead and added a new one. I had the VMware settings using a SCSI controller before, so I changed it to SATA and moved the disks to the new controllers. I booted the VM successfully to make sure it didn't affect anything. I made the changes as you suggested, but it did not like them.

@flyrideSorry forgot to answer your question, yes the drive was removed as well as the volume.

admin@ismhomenas:/$ cat /proc/mdstat Personalities : [linear] [raid0] [raid1] [raid10] [raid6] [raid5] [raid4] [raidF1] md4 : active raid6 sde3[4] sdh3[7] sdd3[6] sdf3[8] sdg3[5] 23427613632 blocks super 1.2 level 6, 64k chunk, algorithm 2 [5/5] [UUUUU] md1 : active raid1 sdh2[4] sdg2[3] sdf2[2] sde2[1] sdd2[0] 2097088 blocks [12/5] [UUUUU_______] md0 : active raid1 sdd1[2] sde1[3] sdf1[4] sdg1[5] sdh1[6] 2490176 blocks [12/5] [__UUUUU_____] unused devices: <none> This is complete: admin@ismhomenas:/etc$ ls -l /usr/local/etc/rc.d/ total 4 -rwxr-xr-x 1 admin users 2161 Jun 4 11:43 FixSynoboot.sh if serial --port=0x3F8 --speed=115200;then set has_serial=true terminal_input --append serial terminal_output --append serial else clear fi terminal_input --append console terminal_output --append console if [ x"${grub_platform}" = xefi ]; then insmod efi_gop insmod efi_uga else insmod vbe fi set extra_initrd="extra.lzma" set info="info.txt" set vid=0x058f set pid=0x6387 set sn=C7LWN09761 set mac1=0011322CA785 set rootdev=/dev/md0 set netif_num=1 set extra_args_3615='' set common_args_3615='syno_hdd_powerup_seq=0 HddHotplug=0 syno_hw_version=DS3615xs vender_format_version=2 console=ttyS0,115200n8 withefi elevator=elevator quiet syno_port_thaw=1' set sata_args='sata_uid=1 sata_pcislot=5 synoboot_satadom=1 DiskIdxMap=0C SataPortMap=1 SasIdxMap=0' set default='0' set timeout='1' set fallback='1' if [ -s $prefix/grubenv ]; then load_env if [ -n "$saved_entry" ]; then set default="${saved_entry}" fi fi VERSION="with Jun's Mod v1.02b" search --file -s /zImage function savedefault { if [ -s $prefix/grubenv ]; then saved_entry="${chosen}" save_env saved_entry fi } function do_option { if [ $# -lt 2 ]; then eval "set value=\"\$$1\"" echo "current $1: $value"; return; fi set key=$1 shift set $key="$*" if [ -s $prefix/grubenv ]; then save_env $key fi } function vid { do_option vid $@; } function pid { do_option pid $@; } function sn { do_option sn $@; } function mac1 { do_option mac1 $@; } function mac2 { do_option mac2 $@; } function mac3 { do_option mac3 $@; } function mac4 { do_option mac4 $@; } function rootdev { do_option rootdev $@; } function append { do_option extra_args_3615 $@; } function vidpid { if [ $# -lt 2 ]; then echo "usage: vidpid 0xVVVV 0xPPPP"; return; fi set usb_args="vid=$1 pid=$2" if [ -s $prefix/grubenv ]; then save_env usb_args fi } function showtips { if [ -n "$has_serial" ]; then terminal_output --remove serial fi echo "Screen will stop updating shortly, please open http://find.synology.com to continue." echo echo if [ -n "$has_serial" ]; then terminal_output --append serial fi } function loadinitrd { if [ -s $img/$info ]; then if [ -n "$has_serial" ]; then terminal_output --remove serial fi cat $img/$info if [ -n "$has_serial" ]; then terminal_output --append serial fi fi if [ -s $img/$extra_initrd ]; then initrd $img/rd.gz $img/$extra_initrd else initrd $img/rd.gz fi } function common_add_option { eval "set value=\"\$$1\"" if [ -z $value ]; then return 1; fi set common_args="$common_args $1=$value" } function common_add_option_ex { eval "set value=\"\$$1\"" if [ -z $value ]; then return 1; fi set common_args="$common_args $2=$value" } function loadlinux { set model=$1 set bootdev=$2 shift 2 if [ -n $vid -a -n $pid ]; then set usb_args="vid=$vid pid=$pid" fi eval "set common_args=\"\$common_args_$model\"" eval "set extra_args=\"\$extra_args_$model\"" eval "set bootdev_args=\"\$${bootdev}_args\"" common_add_option_ex rootdev root common_add_option sn if common_add_option mac1; then set netif_num=1; fi if common_add_option mac2; then set netif_num=2; fi if common_add_option mac3; then set netif_num=3; fi if common_add_option mac4; then set netif_num=4; fi common_add_option netif_num if [ -z $zImage ]; then set zImage=zImage fi linux $img/$zImage $common_args $bootdev_args $extra_args $@ } menuentry "DS3615xs 6.1 Baremetal $VERSION" --class os { set img= savedefault loadlinux 3615 usb loadinitrd showtips } menuentry "DS3615xs 6.1 Baremetal $VERSION Reinstall" --class os { set img= loadlinux 3615 usb mfg loadinitrd showtips } #menuentry "DS3615xs 6.1 Baremetal AMD $VERSION" --class os { # set img= # set zImage=bzImage # savedefault # loadlinux 3615 usb # loadinitrd # showtips #} menuentry "DS3615xs 6.1 VMWare/ESXI $VERSION" --class os { set img= savedefault loadlinux 3615 sata loadinitrd showtips }

@flyride So what is next? I ran memtest for 6 passes and it came out 0 errors. Array has been stable for ~24 hours.

The array is finished rebuilding now and the bad drive was removed. Only RAID Group 3 is there now. Array shows normal.

Ok, this array will take a couple of days to rebuild so I will report back.

Apologies, DSM 6.1.7 Loader 1.02b Yes, always had the 50Mb disk show up. However, now that you mention it, I remember that I had to disconnect the 20GB disk to get the old VM to boot. I would imagine it had something to do with you're referring to about it choosing the wrong boot order. I would imagine that it's booting from the system partition on the degraded array now. I'm upgrading because I thought there might be a bug that is causing my disks to drop out. I've replaced the controller and the cables. It was fine for almost a month, but now it's happening again. I did have to do the pin modification for the HGST drives, but this was happening before then. Once the array finishes rebuilding I'm going to shut it down and test the memory next. This thing was stable for 2+ years and all of the sudden this started about 2 months ago.

I have that 1TB that is going bad, so I was trying to remove it. Guess it's waiting on the other operation

No I did not. Simply there to allow DSM to install. I'm not sure what this is. I have it back up and running with the old DSM for now. Although the array didn't import perfectly and two of the drives in the RAID6 dropped out, so I'm currently rebuilding it. Is this what you're looking for?