Skalyx
-
Posts
19 -
Joined
-
Last visited
Posts posted by Skalyx
-
-
UP!
I have found this error in my log and it is a recurrent error, since I restored my DS916+'s data with HyperBackup. There was an error restoring Moments and I finally gave up and installed Moments from scratch. However and fortunately, all my data was still there as all the "homes" directories and files were restored from HyperBackup. Please check the following error from my log:
Warning
System
25/08/2020 04:41:44
SYSTEM
Checksum mismatch on file [/volume1/@database/pgsql/base/29914/11776.1].
Please help me.
Thanks! -
Hello,
I am having an issue with my Xpenology where I cannot backup it completely with Hyper Backup. Indeed, I am having a: "Failed to backup application Moments. System error".
I just do not know what to do in order to fix it. No one has the same problem on the Internet.
Here are some information:
SHR Volume with SSD Read-only Cache. The backup location is an external Seagate Barracuda HDD 6TBs. I have run some SMART tests and other health tests on the external drive and no problem was found.
More information:
DS3617xs
Intel Xeon E5-2630L V3 (8 cores, 16 threats)
32 GBs DDR4 RAM ECC 2133Mhz
DSM 6.2.3-25426 Update 2
June Loader 1.03
Total capacity 19TBs (SHR with 4HDDs)
1TB SSD cache with 2 Samsung SSDs (Raid 0, Read-only cache)
Please find attached the journal/logs of Hyper Backup and please help me.
Thank you,
-
6 hours ago, jensmander said:
No, I meant the internal cache of your SSDs, not the cache you created within DSM. Every HDD/SSD has an internal cache. If this cache is full the performance or speed will drop.
Oh yes, it makes sense. Thank you!
-
9 hours ago, jensmander said:
Afaik this happens when the SSD‘s internal cache is full. The value of 270MB/s is typical for this.
Well my cache is only at 34%, so it is not full. I would expect at least 450MB/s. Do you think the 34% is impacting my SSDs perf that much?
6 hours ago, flyride said:I'm afraid you are missing the point. Please go back and read the article I linked about SMR behavior and all will make sense. I gave you the specs so that you could help match drive replacements, not to say that there was something wrong with the WD80EFZX. It's correct that the WD80EFZX is slower than the WD Red Pro drive, but the two SMR drives have a much bigger impact on the overall performance regardless of their burst stats.
Use a cache or don't. Personally, I don't as it involves risk of data corruption that I don't choose to have.
The statement about SHR being faster than RAID5 is completely false. At best, SHR *IS* RAID5. Depending on the choices you make with drives, it becomes a conjoined series of RAID5 and RAID1 arrays using subpartitions on larger drives. Those larger drives tend to see more IOPS than the smaller ones, which reduces throughput on the smaller ones. It's always going to be equal or slower, but you may not notice the difference.
Yes, I understand. Thank you for explaining me that. I have read the link and understand the problem much better.
Yes, the cache is risky. That is why I only chose to have SSD read-only cache as I am afraid of data corruption.
-
6 hours ago, flyride said:
Use them for another purpose? If you want to maximize the performance of your array they will have to be replaced, preferably with drives that are closely performance matched. You might have other issues that inhibit your system performance, but half a RAID array with SMR drives will be very noticeable on writes. Reads should be okay though.
These are the relevant specs for the drives you have:
WD6002FFWX - CMR, 7200 rpm, 128MB cache, 227MBps max rate, 6 heads, 6 tebibytes
WD80EFZX - CMR, 5400 rpm, 128MB cache, 178MBps max rate, 7 heads, 8 tebibytes
ST8000DM004 - SMR, 5400 rpm, 256MB cache, 190MBps max rate, 8 heads, 8 tebibytes
The Seagate drives have a larger cache to mask the SMR write performance.
FMI: https://blocksandfiles.com/2020/04/15/seagate-2-4-and-8tb-barracuda-and-desktop-hdd-smr/
So my "WD80EFZX" is the slowest... I see. Will a read/write SSD cache help?
2 hours ago, jensmander said:As always: SHR + SMR = 💩💩💩
😉
Beside SMR I always prefer normal RAID modes like 1, 1+0, 5, 6, etc. with equal disks over SHR. Usually most of the strange „my volume crashed!“ have a SHR background. On normal mdam RAIDs you‘ll always have the possibility to mount the file system on another Linux system.
Oh yes, that is a very interesting advantage. However, I was looking for flexibility and speed. Based on my research a few years back, I think SHR is faster than RAID 5. I will look further into that.
Nevertheless, I have run single disk benchmarks and it looks like my drives have good speed according to their theoretical ones. However, my SSDs do not at all! Please refer to the attached screenshots. Is it normal? What should I do? I am using them for SSD cache read only and I ensured nothing was using my disks during the benchmarks.
I verified if the SATA ports on my motherboard is SATA 3 and not. It 100% is.
Furthermore, my benchmarks speed went back to normal after a shut down and reboot. Only the SSDs are slow.
Thanks!
-
12 minutes ago, flyride said:
ST8000DM004 drives are SMR drives. They are not going to perform well in a RAID array under stress.
Thanks for the answer.
What should I do? 😕
-
Hello,
I am noticing that my SHR volume with 6 drives (2 SSDs, and 4 HDDs) and with a 1TB SSD read-only cache is very slow, especially when running a virtual machine. Please find attached a screenshot and details of my drives and some benchmarks, which show some very disappointing results.
I just do not know how to make it fast. I should get at least normal HDDs speed. SHR seems to be a Synology version of RAID 5, which is fast compared to a single HDD. However, it is very slow.
More information:
-
DS3617xs
-
Intel Xeon E5-2630L V3 (8 cores, 16 threats)
-
32 GBs DDR4 RAM ECC 2133Mhz
-
DSM 6.2.3-25426 Update 2
-
June Loader 1.03
-
Total capacity 19TBs (SHR with 4HDDs)
-
1TB SSD cache with 2 Samsung SSDs (Raid 0, Read-only cache)
Is it normal ? Can you please let me know what I should do to get "normal" speed?
PS: I ran SMART Quick Test and no drives have problems. There are also no bad sectors.
-
-
Dear Users,
I have just migrated from a DS 916+ to XPenology for my needs. Everything went succesfully but... I lost all my data (i. e., configuration, users, applications, etc.). My hard drives (SHR volume) are fine!
Fortunately, I have a backup I ran daily with an external HDD and HyperBackup. It saved all my configuration settings and also my application, such as Synology Drive and Moments. However, my external HDD is in exFAT so it is not usable with xpenology. I tried "https://github.com/luckylz2git/exfat-synology", but it did not work. Maybe it even made my system faulty with some issues as I tried uninstalling it.
So, I am trying to copy all the data to a second HDD with NTFS. The problem is I have more than 8TBs of backup and a very very slow HDD as a backup (used for archive). I get 10Mb/s even with write cache on Windows 10 and Terracopy. It will take DAYYYYYSSS. Thus, I tried to avoid this process and share the USB Drive with Windows 10 and mount it using CIFS in Synology. It works great, but Hyper Backup does not detect it (maybe because of the exfat Github thing I tried). It is saying no directories available under "Relink an existing task" in Hyper Backup. Please refer to the attached screenshots.
I just do not know how to get my data (configs and applications) back... My DS 916+ is untouched except for the HDDs that are used in the new Xpenology. Is there any way to do it faster and get my users, configuration, applications (Moments' data and configs) back?
Please let me know!
Thank you so very much
-
I just succeeded by testing the third extra.lzma (extra3617_v0.11.2_test.zip) and waiting 2 hours. Thank you!
-
38 minutes ago, jensmander said:
Try to put the extra.lzma on the second partition of your stick (replace the existing one). If the NICs don’t indicate anything it looks like a driver problem.
It does not work. I replaced it with two different extra.lzma (extra3617_v4.8.zip and extra3617_v0.5_test.zip). Unfortunately, it does not work. I cannot detect it in any way. However, I can detect it with the original exra.lzma when I create a new USB.
Do you have any idea?
Btw, is it bad to force the reboot with all the drives connected? There are a lot of data there in SHR from my old Synology and I hope nothing will happen. Please help me. Thanks,
-
6 hours ago, jensmander said:
Did you try the 1.03b for the 3617?
Thank you for your help.
I have used the XPEnology Tool to download the 1.03b and have made the USB again. I then had access to the webpage and could again click on "recovery", but it seems like the problem is still occurring after it restarted for recovery. I cannot ping the machine and cannot find anything on Synology Assistant. It has been already 20 minutes now.
Do you have any idea?
Thank you!
-
PS: It is a baremetal installation with the latest DSM version (DSM_DS3617xs_25426.pat). I have been letting the "restoring process" for hours now and no news. Nmap does not show any host now. The two LAN port (RTL8125 and Intel XXXX) do not work. I mean they do not allow me to get any web page to do anything. The DHCP server does not show any new lease. Should I force the reboot and risk damaging my disks again?
Please help me
-
Dear Members,
I had DS916+ with 4 disks in SHR (30TBs) and have been trying to migrate to a customized server with a Huanzhi X99 D8 and E5 2630lV3 with 32GBs of DDR4 RAM.
Therefore, I followed the step for "DS3617xs 6.1 Jun's Mod V1.02b.img" and prepared a USB 2.0 flash drive.
I inserted it to the workstation and the first boot was fine. I could ping the New DS and find it on Synology Assistant after 60 seconds. I went to 192.168.1.2 (I binded the IP and MAC Address with the DHCP server) and could see the web page which indicated me to migrate, which I did. Then, I manually installed the .pat file for DS3617xs which made it reboot through the web page.
When it rebooted, nothing happened for at least 10 minutes. I tried ping -t and checking synology assitant. Nothing...
Thus, I tried to force the reboot many times and waited for 10 minutes every time before pinging. Nothing worked.
Hence, I recreated the USB drive with the img and redid the steps. This time, the web page indicated me "Try to recover" or something like this, which I did. It then rebooted the machine and it has been an hour since then and nothing has happened yet. I cannot ping, see anything in Synology Assistant, and access any web page. It is stuck on "Intro: This mod is brought to you by Jun... Happy hacking... Screen will stop updating shortly, please open http://find.synology.com/ to continue."I just do not know what to do next. May you please help me?
It is very important for me not to lose any data despite having a cold backup.Thank you!
-
2 hours ago, IG-88 said:
thats a problem as 16 cores (8 real, 8 HT) can only be used with 3617, th other two are limited to 8 cores (kernel compile defaults from synology)
to use nvme you need 918+ (you cpu is haswell so it should work) but you would need to disable HT or you loose performance when HT is used instead of real cores (i dont know how the kernel chooses but it its 4cores/4ht it would be significant)
i'd suggest going with two normal sata ssd's and use write caching (only with two drives allowed)
Thank you so much for your advice. I will follow it and go with the 3617 to have 16 threats. Then, I will use SATA SSD. Only one will be used for read-only caching. As a heavy Moments user, I believe it will help. My DS916+ is too slow!
I am a little bit worried for the reliability of my hardware, especially as I will replace a DS916+.
Thanks for the ESXI suggestion, but I do not think NVMe will change a lot as a home user. So, I will use SATA SSD. It should already be great!
-
26 minutes ago, IG-88 said:
the link ended in a "not found" so i cant say anything about if its supported by the additional driver package
if its 2.5GBit only it might imply a realtek 8125, witch is supported
the micro atx board i found with this chipset would be
HUNNANZHI X99-8M ~130$
Asrock FATAL1TY X99 M Killer ~400$
not sure why you go with that outdated hardware/cpu
maybe a 8 core ryzen might be a better choice (as 8 core intel wil cost double) ?
you did not say much about your base for choice so its hard to suggest anything else
Thanks for your messages. You are fully right! It is indeed a Realtek 8125.
I actually went for a 35 USD used Xeon. 8cores 16threats which is pretty good for this price with a really good TDP of 55 watts. My budget is pretty low but I wanted something reliable with strong performance.
Actually my question was: Should I go with the DS3617xs hardware version loader according to my hardware or another one? My aim is to get NVMe caching on read-only.
Thank you
-
1 minute ago, IG-88 said:
i'm not so sure this does look ok together
beeing cheep on such a important part?
if its important then maybe a known server board brand like supermicro would fit the description?
???
the board seems to have just a 1Gbit nic,
if it would be real the it would be a NBASE-T nic and the description did say 1GBit or is it any additiona nic you are planning?
I can go up to 110USD including shipping to Switzerland. Sadly, I could not find a Micro ATX X99 Motherboard.
This is the NIC I bought: https://www.aliexpress.com/item/4000148568525.html?spm=a2g0s.9042311.0.0.30e44c4dTsPKtb
-
Hello,
I am looking to build a Xpenology with the adviced DS3617xs image. I would like to use at all time as a NAS as a massively used file server where Moments will be running and casually use VMs (Win10, WinServer & Ubuntu). My specs:
Intel Xeon E5-2630LV3 (8cores 16threads)
Fujitsu 32GB DDR4 ECC 2400mhz
Kllisre X99 LGA2011-3 motherboard from Aliexpress
2x WD Red 8TBs (Dedicated for the storage)
2x WD Red 6TBs (Dedicated for the storage)
1x Samsung NVME 256GB SSD PM981 (for the cache)
1x 2.5 GBE Network interface
1x 1GBE Network interface
1x APC Back up UPS
My aim is to have the less problem as possible while the best stability, security, and performance as possible.
I am currently looking for the best hardware version loader for my hardware specs and needs while having NVMe cache support. Is it possible?
Please advice me!
-
Hello,
I am looking to build a Xpenology but am hesitating on installing on bare metal or VMware ESXI 6.7 to replace my DS916+. I would like to use at all time as a NAS as a massively used file server where Moments will be running and casually use VMs (Win10, WinServer & Ubuntu). I know we can use VMs on Synology. That is why I am hesitating. My specs:
- Intel Xeon E5-2630LV3 (8cores 16threads)
- Fujitsu 32GB DDR4 ECC 2400mhz
- Kllisre X99 LGA2011-3 motherboard from Aliexpress
- 2x WD Red 8TBs (Dedicated for the storage)
- 2x WD Red 6TBs (Dedicated for the storage)
- 2x Samsung NVME 256GB SSD PM981 (for the cache)
- 1x Toshiba Sata 256gb SSD (for the VMware ESXI installation)
- 1x 2.5 GBE Network interface
- 1x 1GBE Network interface
- 1x APC Back up UPS
My aim is to have the less problem as possible while the best stability, security, and performance as possible.
Requirements:
- Have at least 18TB with, for example, SHR
- Have redundancy
- SSD Cache (NVME maybe?)
PS: All my data will be backed up to my GSuite account with HyperBackup.
Many thanks for your precious advice!
Synology Moments Database Corruption
in General Post-Installation Questions/Discussions (non-hardware specific)
Posted · Edited by Skalyx
Hello,
I am having an issue with my Synology where I cannot backup it completely with Hyper Backup. Indeed, I am having a: "Failed to backup application Moments. System error" and “Checksum Mismatch”.
I just do not know what to do in order to fix it. No one has the same problem on the Internet.
Here are some information:
SHR Volume with SSD read and write Cache. The backup location is an external Seagate Barracuda HDD 6TBs. I have run some SMART tests and other health tests on the external drive and no problem was found.
I noticed this backup problem has been occurring since the last time I had to reinstall synology with the synology assistant as two of my drives died.
I used my external Hyper Backup backup and restored all the applications, settings, and data. The data was successfully restored and the "homes" directories were also successfully restored. However, there was an error when I restored the applications. It was not working. Thus, I let it go.
When I reinstalled Synology Drive and Moments, I noticed all my data was still there and working fine. Probably because I restored my homes directories. Indeed, all my albums, and people matches were there for all my users.
So, I did not really care. However, I have been having Hyper backup issues as described above and noticed some errors in my logs. It is always the same:
Warning System 25/08/2020 04:41:44 SYSTEM Checksum mismatch on file [/volume1/@database/pgsql/base/29914/11776.1].
What should I do? I have already reindexed all except for the current groupings in People and subject albums as I would like not to have my server restart all the processes. (I have millions of photos and I have sorted them all out; days/weeks of work)
Please help me ☹
Thank you,