• Content Count

  • Joined

  • Last visited

  • Days Won


Rhubarb last won the day on December 1 2018

Rhubarb had the most liked content!

Community Reputation

3 Neutral

About Rhubarb

  • Rank
    Junior Member

Recent Profile Visitors

The recent visitors block is disabled and is not being shown to other users.

  1. - Outcome of the update: SUCCESSFUL - DSM version prior update: DSM 6.2.2-24922-2 - Loader version and model: JUN'S LOADER v1.03b - DS3615xs - Using custom extra.lzma: NO - Installation type: BAREMETAL - Supermicro X10SL7-F; Xeon E3-1241 v3 CPU; 16 GB ECC (2 x 8 GB DDR3); 2xGBE +1IPMI_LAN port; 6 SATA (2xSATA3 (6GB/s) & 4xSATA2 (3GB/s); 8 SAS (L-SAS 0-7 supported by LSI2308 SAS controller) connected to a total of 10x8TB WD SATA HDDs (8xWD-80EFZX; 2xWD80-EFAX) via standard SATA cables. - Additional Comment: Reboot required
  2. Synology's Drive, Moments, Photo Station and Deduplication? Background: Originally built and operating flawlessly for over 2 years since April, 2016, my Xpenology DS3615xs compatible (Supermicro X10SL7-F-0; Intel Xeon E3-1241-V3 (3.5 GHz 4 core/8 thread Haswell); 16 GB ECC RAM; began exhibitting regular hard disk disconnections/RAID 6 failures between July 2018 and late February, 2019. It was only after I replaced the Corsair VS450 450W power supply with a brand new 650W Coolermaster Gold 80+ unit on 1 March, 2019, that all of the disk error problems disappeared. The unit has now been operating flawlessly again since then, with performance far superior to consumer grade Synology products. I am a long time user of Photo Station and I like it very much. During this time I have been concerned about disk wastage due to data duplication caused by Photo Station in particular, as it places photo files in the volume's photo folder in those cases where original photo files reside in my "/home" directory on the NAS. When these photos are uploaded from other storage areas on the NAS, such as in homes/user directories (as a result of PC backups to the NAS) the /photo storage folder is holding duplicate copies of those files. I have for some time been running Synology's Drive and Moments applications on my DS3615xs based platform which is running DSM 6.2.2-24922. The system is also running btrfs (for it's Copy on Write features; bitrot protection, etc) which I have found to be very reliable. Other applications installed include Active Backup for Business and Synology's Hyper Backup suite (both applications not currently being used). Drive is enabled (with Intelliversion=32) against my /home (My Drive) folder, and; the /photo, /music folders on the volume. Observations: When I copied approx. 1 TB (actually 971.95 GB in 29320 files/70 folders) of RAW image files from my /homes folder to a /homes/Drive sub-folder (virtually duplicating the files in the homes directory), the homes folder storage increased from 9.71 TB to 10.66 TB; this was accompanied by a rise in CPU resources dedicated to the Drive service (initially in order of 30+%, then reducing to 8-20%, and finally when CPU resources allocated to “Drive” were 0 (when checked in the morning after rising), total storage of the /homes folder was then shown as 10.66 TB (443,891 files, 44885 folders), but total storage on the volume remained at 27% (15.31 TB of 55.86 TB). (Note: this system also functions as a Plex server on my home network. Plex continued to serve my Samsung smart TV Plex client and a remote Plex client, without playback issues during the copy process). Finally, when I deleted all of the 971.95 GB of files copied (duplicated) to the “Drives” sub-folder (next morning), volume usage still remained at 27% and storage in the /homes folder again reduced back to 9.71 TB (414571 files, 44814 folders). I am wondering if anyone else has observed similar circumstances. Is this some indication of deduplication of redundant data files by the Synology Drive app? System data: 10 x 8 TB WD-Red hard disks in RAID 6 configuration (not SHR2). Storage Manager: Volume1 (Normal) 27% Storage Pool 1; 15.3 TB/55.9 TB Volume 1 - Normal: RAID 6 (with 2 disk data redundancy); Total capacity: 55.86 TB; Used Capacity: 15.32 TB Shared Folder storage: Shared folder1: 292.5 GB (314,067,717,955 Bytes), 87013 file(s), 838 folder(s) homes folder: 9.71 TB (10,676,301,073,915 Bytes), 414571 file(s), 44814 folder(s) music folder: 7.67 GB (8,234,597,498 Bytes) 2416 file(s), 52 folder(s) photo folder: 476.23 GB (511,352,024,764 Bytes), 72262 file(s), 698 folder(s) Rod 220.73 GB (37502 files, 459 folders) Rail 6.43 GB (402 files, 3 folders) Moments 1014.7 KB (1 file, 2 folders) Holidays 249.07 GB (34,357 files, 230 folders) video folder: 4.54 TB (4,996,187,380,629 Bytes), 2964 file(s), 479 folder(s) web folder: 452.6 KB (463,478 Bytes), 62 file(s), 7 folder(s) Rhubarb
  3. - Outcome of the update: SUCCESSFUL - DSM version prior update: DSM 6.2.1-23824 update 6 - Loader version and model: JUN'S LOADER v1.03b - DS3615xs - Using custom extra.lzma: NO - Installation type: BAREMETAL - Supermicro X10SL7-F-0 with both SATA (6 ports) and SAS (8 ports - LSI2308) and dual onboard Intel (i210AT) NICs. - Additional comments: fastest System update ever; seems to be operating normally; also updated several of the apps that were showing as outdated.
  4. Seemed to be the only way bearcat - but not good to have to disable the whole 6 port SATA controller (2x6Gbps & 4x3Gbps) to disable only 2 ports. I have now arranged purchase of a new LSI2308 8 port SAS PCI-E and a SFF-8087 SAS to 4 port SATA cable to make up for the lost ports. System is now running with 8 disks (RAID 6) until I get/add the new hardware.
  5. Thanks again for your advice, flyride. However, no luck yet with DiskIdxMap=080A00 and SataPortMap=228. Also tried 208. Neither removes the 4 vacant slots for SATA2 (positions 3 to 6 of the Storage Manager drive listing). Have just noticed, however, that the 6 drive RAID 6 group has now entered degraded mode 5/6. One of the drives that was previously not visible is now included in the array, replacing one of the other disks. Will allow the RAID to recover before further changes. Will probably take at least 24hrs to get the RAID normalised.
  6. Had no success mapping out SATA2 controller in two attempts. 1st attempt was to set "set sata_args='sata_uid=1 sata_pcislot=5 synoboot_satadom=1 DiskIdxMap=0C SataPortMap=208 SasIdxMap=0'" 2nd attempt was to set "set sata_args='sata_uid=1 sata_pcislot=5 synoboot_satadom=1 DiskIdxMap=0C SataPortMap=20 SasIdxMap=8'" On both occasions, the blank SATA2(x4) still show as vacant slots in (3 to 6) in the Storage Manager Overview and DSM is unable to access the 7th & 8th disk on the LSI2308 (SAS) ports. I do want to retain max disks set to 12 as suggested by haydibe: "The "12 drives" limit is the default-configuration. If you change it, be prepared that updates sometimes reset your settings to the default value." I'm still struggling with how to go about offsetting the location of the 8xSAS ports to mask over the empty SATA2 ports.
  7. Thanks to you to too haydibe. Much appreciated! Desirably, my SAS controller should be switched to become the first device, then SATA1(x2), and finally SATA2(x4), without increasing/changing the MAXDRIVES limit of 12. Will post again to confirm when I've got system configured correctly as I want.
  8. Thanks for your advice flyride. I have seen some material on this topic on the net and have previously (some months ago) read the tutorial when I was not aware of the need to map out a device (SATA2x4), because my system appeared to be functioning flawlessly with all drives connected across the available controllers (incl. SATA2). Will investigate further today. Thanks again for your advice and pointing me in the right direction.
  9. My Supermicro m'brd system (X10SL7F as DS3615xs) has lately had occasional disk issues which Supermicro has advised me could be due to RAIDing 6Gb/s (SATA1x2), 3Gb/s (SATA2x4), and 6Gb/s SAS(4of8) as a 10 Disk RAID 6 array. I was generally advised that RAID groups should be confined to each controller. My m'brd has 2xSATA3 RAID0,1 ports; 4xSATA2 RAID0,1,5,10 ports; and 8xSAS2 (LSI2308) ports. To resolve my problems, I placed 4 of my HDDs on the slower SATA2 ports as RAID5, and 6 drives on 6 of the 8 available SAS2 ports. Because of the 12 disk limit for DS3615 I can't use more than 6 of the 8xSAS2 ports. I guess my options are to: a: Change the MaxDrives limit to 14 and place two of my HDDs on to the 2xSATA1 ports and the balance on the 8 SAS ports; (this gives problem that the 4 vacant SATA2 ports show as "blanks" in the Storage Manager, Overview page); or, b: modify my systems config to remove all the SATA2 ports from being visible to the DS3615xs so that the 4 vacant ports don't show as "blanks" in the Storage Manager Overview and I can see all 8 SAS ports as available for usage. Any ideas how I can achieve either of a/b above? Suggestions welcome.
  10. - Outcome of the installation/update: SUCCESSFUL - DSM version prior update: DSM 6.1-7-15284 - Loader version and model: JUN'S LOADER v1.03b - DS3615xs - Using custom extra.lzma: NO - Installation type: BAREMETAL - Supermicro X10SL7-F with Xeon E3-1241 V3 cpu and 16 GB (2 x 8 GB) ECC / NIC: Onboard Dual Gigabit Ethernet LAN ports via Intel® i210AT - Additional comments: Rebuilt RAID as part of the upgrade from: 10 x 8 TB WD Reds Volume 1 (RAID 6) (btrfs) to: 6(attached to SATA controller) x 8 TB WD Reds in Volume 1 (RAID 6) and 4(attached to 4 of 8 x SAS2 (6Gbps) via Broadcom 2308) x 8 TB WD Reds in RAID 5 (Volume 2). Retained btrfs for both RAID volumes. Primary purpose was to create smaller arrays to minimise stress from rechecking/rebuilding after about 3 or 4 intermittent disk disconnections over the past 6~8 months. Cause of this was never identified. All SATA cables were connected and no entries in logs indicating cause of these disconnections. It should also be noted that it was intended to do the upgrade using Jun's 1.03b and the 6.2.23739.pat. The system refused the use of 6.2.23739 and demanded 6.2.23824.
  11. Hi, Out of curiosity, what do you have you system configured as: DS918+, 916,3615xs, 3617xs? I'm very happy with my Supermicro X10SL7-F mbrd with E3-1241v3: it's rock solid (configured as a DS3615xs) with 9x8TB (WD80EFZX)in RAID 6 config; 6 of the drives are connected on the SATA ports and remainder on 3 of the 8 LSI2308 SAS ports. I did recently experience connection errors with one of the drives which has now been RMA'd back to WD, Vietnam, for replacement under warranty. Am using the box mainly media storage (photo collections; Plex server for my smart tv; and media downloads via Sonar, SABnzbd, etc). Using my old DS1513+ (5x4TB WD40EFRX) to back up important data via Hyperbackup. Have additional off-site backup of important data via a 4 mile wi-fi connection across the valley to my son's house. Use that same connection to access his video library and for his family to access mine. While I have both the X10SL7-F LAN ports bonded, I'm getting transfer rates of averaging 90 MB/s to my desktop PC whilst simultaneously transferring at about 30 MB/s to a notebook PC (also via a hardwired ethernet connection). This is with multiple (15~20 Mb) photo jpgs and the occasional video files ranging in size from 70 Mb to upwards of 500 Mb). I am getting read/write speeds on the Xpenology box maxing out my PCs single ethernet connection at 107~114 MB/s (mainly about 110~112 MB/s). No problems running Photostation for displaying photo library; but original media is stored separately on the disks. No problems running the DSM 6.1.7-15284-1 using Jun's 1.02b, I'm not game to try moving to DSM 6.2 with Jun's 1.03a, just yet.
  12. Downloaded this update about 10 mins ago and installed on my xP3615xs baremetal. No dramas, install went to plan and system was back up and functioning normally within 6 minutes of the restart commencing.
  13. My Xpenology box is running a single volume (/volume 1) using the BTRFS system which, I understand, supports COW (copy-on-write), such that hyper backup can store multiple versions of files without duplication. Also, I have verified, via PUTTY, that the 'cp --reflink' command is available on my system (DSM 6.1.3-15152-update 5), an essential element for the COW facility utilised by Hyper Backup (which I am also using). Elsewhere, I have seen multiple users complain about file duplication created by Photo Station as it copies files to the '/photo' folder from other location on the system that those photos are already stored. I know that Synology has provided, through Storage Analyzer, a very poor (IMO) facility to identify duplicate files via MD5 checking. But this facility only identifies 200 instances of duplicates on each run, and it requires that duplicates be deleted by the operator (no batch deletion facility). Not only this, but it is reasonable that both the original files on the Synology/xpenology boxes and the copies uploaded to the /Photo folders are required in their respective locations. So a better option is required to deal with this issue: either hard linking of the duplicate files, or 'reflink'ing the copied data to minimize redundancy and maximize disk storage efficiency. My question is: has anyone managed to implement either file deduplication or reflinking of data on Synology's BTRFS in this way? If so, what have you achieved? Any advice please on how to proceed. Is anyone working on this issue? Apologies if this is expressed inadequately/too simply. Supermicro M'brd X10SL7-F-0 Xeon E3-1241-V3, 2 x 8 Gb DDR3 DIMMs giving 16Gb ECC DDR3 RAM. 9 x 8TB WD-Red HDDs in RAID 6 of 50.91 TB and 48.87 TB of BTRFS Volume DSM 6.1.3-15152 Update 5
  14. Well I applied with my DS1513+ S/N to my xpenology DS3615xs emulation box. Now no problem with uploaded videos. Problem, solved. All you need is a genuine Synology S/N. Unfortunately, I'm still running my xpenology box as a DS3615xs and not a DS3617xs (preferred configuration), because there is no available Sonarr packages for the DS3617xs (xeon processor) yet.
  15. It does seem that the problem is caused by serial number or other check implemented by Synology, either in DSM or in Photo Station. My xPenology DS3615xs tells me 'Cannot display or playback this format, or the file is currently being converted.' However, I have mounted my 'Photo' folder on my authentic DS1513+ Synology box, as a CIFS shared folder on my DS3615xs. Now, when I copy the relevant file from the Photo folder on my DS1513+ (Synology box) to the relevant Photo folder on my xPenology DS3615xs, and then run Photo Station on the xDS3615xs, the video will now play correctly. In my case I have my DS1513+ on ports http/https (5002/5003) and my xDS3615xs on ports http/https (5000/5001) and can access both via the Net. Of course, Quick Connect can only be set up on the authentic DS1513+. It's about time Synology started allowing people to buy a Synology license to run on 3rd party boxes. Then they (Synology) wouldn't have to waste resources finding new ways to cripple their software when we try and adapt it to home built (non-Synology) platforms. If Synology were to devote that energy to improving their platforms instead, DSM would improve faster and Synology would get revenue from the myriad xPenology users who would be happy to pay for a license for their 3rd party boxes, until such time as they decided to purchase a real Synology device because of the increasing capabilities and capacity of the newer Synology systems.