RedPill - the new loader for 6.2.4 - Discussion

[T-REX-XP]

@ThorGroup, is it possible to map internal ssd as hdd, that is available for installer? There are a lot of single board pc with embedded ssd. It will be a good chance use them as energy efficiency solutions or portable nas. I have one os them, so I can provide any logs, etc...

Thanks. 

[psychoboi32]

1 minute ago, T-REX-XP said:

@ThorGroup, is it possible to map internal ssd as hdd, that is available for installer? There are a lot of single board pc with embedded ssd. It will be a good chance use them as energy efficiency solutions or portable nas. I have one os them, so I can provide any logs, etc...

Thanks. 

With proxmox you can do that install in it and give require space as SATA0 drive

[T-REX-XP]

Just now, psychoboi32 said:

With proxmox you can do that install in it and give require space as SATA0 drive

Is a pretty limited by resources hw. With intel atom and 2gigs of ram. So I'm not sure that the proxmox or esxi will be best approach for it.

[T-REX-XP]

Just now, T-REX-XP said:

Is a pretty limited by resources hw. With intel atom and 2gigs of ram. So I'm not sure that the proxmox or esxi will be best approach for it.

For example, atomic pi, latte panda, chuwi larchbox, etc... no name intel based pc from aliexpress.

[psychoboi32]

5 minutes ago, T-REX-XP said:

Is a pretty limited by resources hw. With intel atom and 2gigs of ram. So I'm not sure that the proxmox or esxi will be best approach for it.

can you not increase ram of it? if not my idea use linux and make that drive as ISCSI so I can connect that storage local that I will do
a persistence USB bootable disk with linux and make that whole storage as Iscsi.
use persistence USB install cockpit on it and see magic

Edited August 19, 2021 by psychoboi32

[T-REX-XP]

3 minutes ago, psychoboi32 said:

can you not increase ram of it? if not my idea use linux and make that drive as ISCSI so I can connect that storage local that I will do

No, I can't do it. is not standalone mb. All components embedded to motherboard via soldering. Its compact and low energy consuming solution, such as raspberry pi.

Edited August 19, 2021 by T-REX-XP

[psychoboi32]

5 minutes ago, T-REX-XP said:

No, I can't do it. is not standalone mb. All components embedded to motherboard via soldering. Its compact and low energy consuming solution, such as raspberry pi.

Understood it is x86-64 board just like Pi, see above mention use base linux with cockpit and share that volume as iscsi but yes your data in raid 0. if may I suggest you lets open another thread where we can discuss or send me PM right away hope I can help

Edited August 19, 2021 by psychoboi32

[loomes]

1 hour ago, ilovepancakes said:

OK cool. Did that log you posted above showing the face detection plugin failing come from /var/log/messages or another log?

This is the synofoto.log in /var/logs

[ilovepancakes]

1 minute ago, loomes said:

This is the synofoto.log in /var/logs

 

Does /var/log/messages show anything related to face detection or Photos?

[Orphée]

5 hours ago, ThorGroup said:

It looks like your image or storage is damaged somehow. If you look into the log there are ext driver errors saying it cannot save blocks to disk. We would look into ESXi logs. If there isn't anything interesting there try to transfer the image again.

We saw this before on Proxmox when the image was replaced when machine was still running, but this is quite unusual and we don't think you did that here

 

 

I'm using the following VMDK file (the one from Jun's loader) to load synoboot.img :

 

# Disk DescriptorFile
version=1
CID=9fb45bdb
parentCID=ffffffff
createType="vmfs"

# Extent description
RW 102400 VMFS "synoboot.img"

# The Disk Data Base 
#DDB

ddb.adapterType = "lsilogic"
ddb.deletable = "true"
ddb.encoding = "UTF-8"
ddb.longContentID = "cd061c7d6828764fa3d6bf989fb45bdb"
ddb.thinProvisioned = "1"
ddb.toolsInstallType = "0"
ddb.toolsVersion = "2147483647"
ddb.uuid = "60 00 C2 9a ee da ca 33-df 5e 04 3f 80 55 f9 62"
ddb.virtualHWVersion = "10"

 

@scoobdriver was right, I just needed to add following args (extracted from jun's loader grub.cfg file) :

sata_uid=1 sata_pcislot=5 DiskIdxMap=0C SataPortMap=1 SasIdxMap=0
to make SATA1 available in VMWare configuration, it should make LSI passtrough work (just a guess, did not try yet on my production env) @psychoboi32 (try at your own risk)

 

My current VM settings are :

 

 

@ThorGroup I'm using same SSD as pool storage for data disk.

I created a 40GB virtual disk exactly the same way as I did for Jun's loader, or that I usually do for other VM likes Ubuntu currently used to build loader with docker.

 

I build the loader from a Ubuntu's VM running on the same SSD where my Xpenology PROD (jun's) is running.

 

 

So I really don't think it can be a failure from SSD pool storage...

 

I also tried to create a 50GB virtual disk on my real NAS pool storage, same result.

 

21.log 23.log

[psychoboi32]

I just notice I can only boot redpill if I use legacy bios but for apollolake xpenlogy it was recommended to use UEFI, hmm can we resolve some errors by that idk but we can try.

 

[psychoboi32]

5 hours ago, Orphée said:

sata_uid=1 sata_pcislot=5 DiskIdxMap=0C SataPortMap=1 SasIdxMap=0

where should I add this? means in grub.cfg or .vmx can you help me with that got my answer

it should be added in grub.cfg

thanks I want to DSM7 ui on xpenology and data already backup (hyperbackup) don't worry

Edited August 20, 2021 by psychoboi32

[Balrog]

I am currently not able to build the Apollolake 7.0 image for #41890:

 

...
 > [stage-1 3/9] RUN git clone https://github.com/RedPill-TTG/redpill-lkm.git  -b master  /opt/redpill-lkm &&     git clone https://github.com/jumkey/redpill-load.git -b 7.0-41890 /opt/redpill-load:
#6 0.438 Cloning into '/opt/redpill-lkm'...
#6 1.081 Cloning into '/opt/redpill-load'...
#6 1.426 fatal: Remote branch 7.0-41890 not found in upstream origin
------
executor failed running [/bin/sh -c git clone ${REDPILL_LKM_REPO}  -b ${REDPILL_LKM_BRANCH}  ${REDPILL_LKM_SRC} &&     git clone ${REDPILL_LOAD_REPO} -b ${REDPILL_LOAD_BRANCH} ${REDPILL_LOAD_SRC}]: exit code: 128

 

Is the remote branch for 7.0-41890 deactivated and I have missed this?

[jumkey]

6 minutes ago, Balrog said:

I am currently not able to build the Apollolake 7.0 image for #41890:

 

...
 > [stage-1 3/9] RUN git clone https://github.com/RedPill-TTG/redpill-lkm.git  -b master  /opt/redpill-lkm &&     git clone https://github.com/jumkey/redpill-load.git -b 7.0-41890 /opt/redpill-load:
#6 0.438 Cloning into '/opt/redpill-lkm'...
#6 1.081 Cloning into '/opt/redpill-load'...
#6 1.426 fatal: Remote branch 7.0-41890 not found in upstream origin
------
executor failed running [/bin/sh -c git clone ${REDPILL_LKM_REPO}  -b ${REDPILL_LKM_BRANCH}  ${REDPILL_LKM_SRC} &&     git clone ${REDPILL_LOAD_REPO} -b ${REDPILL_LOAD_BRANCH} ${REDPILL_LOAD_SRC}]: exit code: 128

 

Is the remote branch for 7.0-41890 deactivated and I have missed this?

sorry this branch has merged into master and deleted😅

Edited August 20, 2021 by jumkey

[plegs]

 

7 minutes ago, Balrog said:

Is the remote branch for 7.0-41890 deactivated and I have missed this?

can't confirm. working fine for me. just run ist again. 

[haydibe]

17 minutes ago, Balrog said:

am currently not able to build the Apollolake 7.0 image for #41890:

 

...
 > [stage-1 3/9] RUN git clone https://github.com/RedPill-TTG/redpill-lkm.git  -b master  /opt/redpill-lkm &&     git clone https://github.com/jumkey/redpill-load.git -b 7.0-41890 /opt/redpill-load:
#6 0.438 Cloning into '/opt/redpill-lkm'...
#6 1.081 Cloning into '/opt/redpill-load'...
#6 1.426 fatal: Remote branch 7.0-41890 not found in upstream origin
------
executor failed running [/bin/sh -c git clone ${REDPILL_LKM_REPO}  -b ${REDPILL_LKM_BRANCH}  ${REDPILL_LKM_SRC} &&     git clone ${REDPILL_LOAD_REPO} -b ${REDPILL_LOAD_BRANCH} ${REDPILL_LOAD_SRC}]: exit code: 128

 

Is the remote branch for 7.0-41890 deactivated and I have missed this?

You need to use v0.5.4 of the script OR just change the url and branch in the global_settings.json. Just copy the values for load repo from one of the other profiles. 

[haydibe]

13 hours ago, psychoboi32 said:

it is easy if you need my config i can share with you

boot: order=usb0
cores: 4
cpu: SandyBridge
hostpci0: 0000:01:00
hostpci1: 0000:08:00
memory: 8192
name: XPenology-TMP-ds918
net1: e1000=8A:C1:48:E3:A6:4D,bridge=vmbr0
numa: 0
ostype: l26
sata0: local-lvm:vm-102-disk-2,size=32G
scsihw: virtio-scsi-pci
serial0: socket
smbios1: uuid=04F674CF-F8B7-4268-998C-629149B97412
sockets: 1
tablet: 0
usb0: host=090c:1000,usb3=1
vga: serial0

just make vm and put this config change pcie card according that if you need any help how to passthrough i have written guide i can share with you

there was backup of proxmox available on this forum just use that and remove jun loader files and put redpill there as you can see my vm name it is used from that 😛

You are right, wasn't that hard after all. 

 

I have noticed the backup, but honestly don't like the idea of restoring someone elses backup.

 

At the end it was as easy as adding a virtio network card, the usb controller and serial0 port, and manualy edit the vm's conf to add:

args: -device 'qemu-xhci,addr=0x18' -drive 'id=synoboot,file=/var/lib/vz/images/XXX/redpill-DS918+_7.0-41890.img,if=none,format=raw' -device 'usb-storage,id=synoboot,drive=synoboot,bootindex=5'

at the top of the vm config file: /etc/pve/nodes/zzz/qemu-server/xxx.conf

 

Then used this user_config.json:

{
    "extra_cmdline": {
      "pid": "0x0001",
      "vid": "0x46f4",
      "sn": "xxxxxxxx",
      "mac1": "xxxxxxxxxxx"
    },
    "synoinfo": {},
    "ramdisk_copy": {}
  }
}

Of course with a generated sn and mac1.

 

What should I say: Successfully migrated one of my old XPE vm's from ESXi to Proxmox.

 

I do favor the usb bootdrive approach over the sata_dom boot approach. For me that's the way to go, unless ThorGroup argues in one of their fabulous explainations why it's better to use sata_dom instead

 

Edited August 20, 2021 by haydibe

[psychoboi32]

15 minutes ago, haydibe said:

You are right, wasn't that hard after all. 

 

I have noticed the backup, but honestly don't like the idea of restoring someone elses backup.

 

At the end it was as easy as adding a virtio network card, the usb controller and serial0 port, and manualy edit the vm's conf to add:

args: -device 'qemu-xhci,addr=0x18' -drive 'id=synoboot,file=/var/lib/vz/images/XXX/redpill-DS918+_7.0-41890.img,if=none,format=raw' -device 'usb-storage,id=synoboot,drive=synoboot,bootindex=5'

at the top of the vm config file: /etc/pve/nodes/zzz/qemu-server/xxx.conf

 

Then used this user_config.json:

{
    "extra_cmdline": {
      "pid": "0x0001",
      "vid": "0x46f4",
      "sn": "xxxxxxxx",
      "mac1": "xxxxxxxxxxx"
    },
    "synoinfo": {},
    "ramdisk_copy": {}
  }
}

Of course with a generated sn and mac1.

 

What should I say: Successfully migrated one of my old XPE vm's from ESXi to Proxmox.

 

I do favor the usb bootdrive approach over the sata_dom boot approach. For me that's the way to go, unless ThorGroup argues in one of their fabulous explainations why it's better to use sata_dom instead

 

thank you for clearing my doubt but i am stuck with mpt3sas driver do you have any idea how to resolve. if docker run there are some virtio driver i saw can i add mpt3sas there thank you so much for args for pcie passthrough if you need help i have some guides or scripts or command whatever you call english not my forte
for current here is sneak peak

do you hate proxmox message when you login , you can't get apt update  here is a solution

 

# Disable Commercial Repo
sed -i "s/^deb/\#deb/" /etc/apt/sources.list.d/pve-enterprise.list
apt-get update

# Add PVE Community Repo
echo "deb http://download.proxmox.com/debian/pve $(grep "VERSION=" /etc/os-release | sed -n 's/.*(\(.*\)).*/\1/p') pve-no-subscription" > /etc/apt/sources.list.d/pve-no-enterprise.list
apt-get update

# Remove nag
echo "DPkg::Post-Invoke { \"dpkg -V proxmox-widget-toolkit | grep -q '/proxmoxlib\.js$'; if [ \$? -eq 1 ]; then { echo 'Removing subscription nag from UI...'; sed -i '/data.status/{s/\!//;s/Active/NoMoreNagging/}' /usr/share/javascript/proxmox-widget-toolkit/proxmoxlib.js; }; fi\"; };" > /etc/apt/apt.conf.d/no-nag-script
apt --reinstall install proxmox-widget-toolkit

 

Edited August 20, 2021 by psychoboi32

[Orphée]

3 hours ago, psychoboi32 said:

where should I add this? means in grub.cfg or .vmx can you help me with that got my answer

it should be added in grub.cfg

thanks I want to DSM7 ui on xpenology and data already backup (hyperbackup) don't worry

 

Inside the user_config.json

 

{
  "extra_cmdline": {
    "vid": "0x058f",
    "pid": "0x6387",
    "sn": "1XXXXXXXXX9",
    "mac1": "001132XXXXXX",
    "sata_uid": "1",
    "sata_pcislot": "5",
    "DiskIdxMap": "0C",
    "SataPortMap": "1",
    "SasIdxMap": "0"
  },
  "synoinfo": {},
  "ramdisk_copy": {}
}

 

[T-REX-XP]

13 hours ago, T-REX-XP said:

@ThorGroup, is it possible to map internal ssd as hdd, that is available for installer? There are a lot of single board pc with embedded ssd. It will be a good chance use them as energy efficiency solutions or portable nas. I have one os them, so I can provide any logs, etc...

Thanks. 

@ThorGroup,From the device perspective it look like this:  MMC/SD card mmcblk0 device. Thanks in advance.

[scoobdriver]

@haydibe Thanks for your work . Could you advise how I "Clean up" the docker tool . 

 

I'm running this on a small VM , it works great first time , but if I try to generate a new image , I'm out of disk space (seems to grow every time I generate and image for the same Architecture) . 

without removing everything and starting again , are there any locations I can remove files ? 

 

 

[mcdull]

18 minutes ago, scoobdriver said:

@haydibe Thanks for your work . Could you advise how I "Clean up" the docker tool . 

 

I'm running this on a small VM , it works great first time , but if I try to generate a new image , I'm out of disk space (seems to grow every time I generate and image for the same Architecture) . 

without removing everything and starting again , are there any locations I can remove files ? 

 

In general it should clear up by itself under /opt

And ./images that it will store the final img file.  

You may refer to these locations.  (I uses dockerce only)

 

to me I would rather make a snapshot and revert it when necessary.

Edited August 20, 2021 by mcdull

[gadreel]

15 minutes ago, scoobdriver said:

@haydibe Thanks for your work . Could you advise how I "Clean up" the docker tool . 

 

I'm running this on a small VM , it works great first time , but if I try to generate a new image , I'm out of disk space (seems to grow every time I generate and image for the same Architecture) . 

without removing everything and starting again , are there any locations I can remove files ? 

 

 

I want to know about this too. 30GB pop os gone in a few days...

[Orphée]

# docker system prune -a 
WARNING! This will remove: 
  - all stopped containers
  - all networks not used by at least one container
  - all images without at least one container associated to them
  - all build cache

Are you sure you want to continue? [y/N] y 
Deleted Containers: 
bee0d8988fb7b942a53d2317808b96cec9e9e17496f869f2ea9021f01d0567f6

Deleted Images: 
untagged: redpill-tool-chain:bromolow
deleted: sha256:5d92e907c8a059bc035a5d8753cb8e0673d51975914cab6deac1f120d0084c79
deleted: sha256:93f68868a99acf5fcede3c392412fa989d0c47cb5fe4899a05487bbf8b6e0e47
untagged: hello-world:latest
untagged: hello-world@sha256:df5f5184104426b65967e016ff2ac0bfcd44ad7899ca3bbcf8e44e4461491a9e
deleted: sha256:d1165f2212346b2bab48cb01c1e39ee8ad1be46b87873d9ca7a4e434980a7726
deleted: sha256:f22b99068db93900abe17f7f5e09ec775c2826ecfe9db961fea68293744144bd
deleted: sha256:e1540cbeb3186a2f7eb8b7ded1384ba44255513b2755788e6da07518c3b34f70
untagged: redpill-tool-chain:bromolow-6.2.4-25556
deleted: sha256:59b6a6144bf160bc0012882ada0b574df2833a86834d7223a59d38b4be530861
deleted: sha256:3c8dd3d9c68a2cece7f7561d8300ab81e761f9c8d6b98444391507abf8afbd30


Deleted build cache objects: 
uumdb3voglmmz4yhlsb11e85y
kl4c4j9qyu389a82b76y54m3e
lwy4ik8szojsd0wngqd4wge66
6yzpusf4c8aasj0dcp2s0t9go
qrbzqwxdkzyr7l6mvbao14ips
oomjhhzk50mgiovrmshm47b9k
ih9zgrnxd0qoosnegoh0w1krs
vy8thfkw6aw3wql77hx9kcbnl
nkk8mt9k3e4gs9a2eegdl3hii
58jrha6epn6p43y7d6mke3zns
amalxlohyde2slhy6un7i6g5s
zi672ioptqy9uri82a9vrj4hm
3s1k430445qlffpdcc7efby1o
yticmw3v7mtbxddq4ujoaazxk
j3snfib3r72ut53em2ezrbtop
p2abem0ow082vw8kx4jrmxqi8
vmnaixl06w5h42s7z9cbtutug
vvigozr3wgpmpcfcvlvgw4zcu
6c6e1s694qjsfwny33x5sjt3x
qwr82bhsc92ngu1i1bwjtbygj
mnflafwcrievgegdp1unuxpga
38bn8zirvuw933unt71drc5fb
van3nd9uvdc3j928pukn78jg7
wqsk1yii7billcp6fkzii9b2v
jfyf8l67t929fyxw2qlgrvqh9
dosulellulc65777kbs6ie9lc
99prlk0m201ij3q3oa1sch5ip
xw2a0yg917b8l2lgdrk4671ic
xg7mp0uwytup59o657pqzr0e8
wabqmd9l4xnnqpnryxgw7mng1
l0fi8x2ldu0v63ajnwgy2epcz
cer3qvy3gn4vwsw7z16xr06ee
v0o5w4hu1uuw9la1enabzl8rd
nlhmju9fk92ursmjn5vv3zel7
p460jyfctzyoxj4tp5d0n2on0
t6axr2h56dgo4engjlqu52qfp
kvqvfqgziogwg9mtkvajv0e1w
r0h1wlhz73obe6uot3gxqfuzq
1am0833fne0vwn63a6n1h2b9u
idi1mdsg5qe8fkaiwczjjoh4g
qeav24lqyyrt0o19mizikuavl
j7e2o0gxb7sq1m75grulqh8xc
sne2h33ykcw3bcenggwyffhe4
6maze4683rv30dptq7kdbvums
hce36etohn2ta7tk50pu0nlg8
j140fnypn3ddv6gb45pdd60ev
s1ho43cfumltpt3tsy7kforhm
wnwcs4cagynoqfrurkezw5poj

Total reclaimed space: 6.054GB
root@ubuntu:/home/orphee/Downloads/redpill/images#

 

BE CAREFULL WITH THIS COMMAND, IT WILL DELETE EVERYTHING CONSIDERED AS NOT USED.

 

If you are unsure, avoid it. If you use docker only for redpill, you can do it safely. But next time you run it, it will have to redownload everything needed.

[psychoboi32]

./caches have .pat files
./images have all images you built
if you remove other things than it will not work after that

 

Edited August 20, 2021 by psychoboi32