Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OS5 packages #57

Open
stefaang opened this issue Aug 23, 2020 · 85 comments
Open

OS5 packages #57

stefaang opened this issue Aug 23, 2020 · 85 comments

Comments

@stefaang
Copy link
Member

stefaang commented Aug 23, 2020

I've got the new toolchain for OS5. Only minor changes for 3rd party packages.
I'll probably do an overhaul over the project soon.

Stay tuned.

@stefaang
Copy link
Member Author

stefaang commented Aug 31, 2020

Docker 19.03.8 for OS5
docker-19.03.8-OS5.zip

Works on PR4100. Looking for confirmation on other platforms.
Based on OS5 branch: https://github.com/WDCommunity/wdpksrc/tree/OS5

@cmd430
Copy link

cmd430 commented Oct 1, 2020

clarification on what FW is OS5?

@Vendo232
Copy link

Vendo232 commented Oct 6, 2020

Docker 19.03.8 for OS5
docker-19.03.8-OS5.zip

Works on PR4100. Looking for confirmation on other platforms.
Based on OS5 branch: https://github.com/WDCommunity/wdpksrc/tree/OS5

Any chance adding WDMyCloudMirrorGen2_docker_19.03.8.bin for OS5?

@Vendo232
Copy link

Vendo232 commented Oct 6, 2020

clarification on what FW is OS5?

5.02.134

@stefaang
Copy link
Member Author

stefaang commented Oct 7, 2020

root@4762f36cacea:/wdpksrc# ./mksapkg-OS5
ERROR: model_name not specify

Usage: mksapkg-OS5 -E -s -m [model_name]


Supported model_name:
		WDMyCloud
		WDMyCloudEX4100
		WDMyCloudDL4100
		WDMyCloudEX2100
		WDMyCloudDL2100
		WDMyCloudMirror
		MyCloudEX2Ultra
		MyCloudPR4100
		MyCloudPR2100
		WDCloud

root@4762f36cacea:/wdpksrc# ./mksapkg-OS3
ERROR: model_name not specify

Usage: mksapkg -E -s -m [model_name]


Supported model_name:
		WDMyCloudEX4
		WDMyCloudEX2
		WDMyCloudMirror
		WDMyCloud
		WDMyCloudEX4100
		WDMyCloudDL4100
		WDMyCloudEX2100
		WDMyCloudDL2100
		WDMyCloudMirrorGen2
		MyCloudEX2Ultra
		MyCloudPR4100
		MyCloudPR2100

Seems like it is no longer supported. Which is odd as you are on OS5.
I'll ask for clarification.

@stefaang
Copy link
Member Author

stefaang commented Oct 7, 2020

You may try the other packages, I'm fairly sure one of the other packages should work fine.

@Vendo232
Copy link

Vendo232 commented Oct 7, 2020

I have tried all from your zip file and all failed

https://community.wd.com/t/my-cloud-os-5-firmware-for-my-cloud-mirror/256504

The OS is still Indexing , not sure if this might influence the installation.

@Vendo232
Copy link

Vendo232 commented Oct 8, 2020

hello Stefaan , do you see any major roadblocks on your end to extend the DOCKER packages to WD My Cloud Gen 2?

@D-stefaang
Copy link

docker_19.03.8_OS5.zip

@Vendo232 try the Mirror package in this new zip. I think they just renamed the MirrorV2 to simply Mirror.
The old V1 did not support Docker so it was not part of the build script.

@ricardoespinobon
Copy link

Docker 19.03.8 for OS5
docker-19.03.8-OS5.zip

Works on PR4100. Looking for confirmation on other platforms.
Based on OS5 branch: https://github.com/WDCommunity/wdpksrc/tree/OS5

Works on PR2100 OS5

@irctrakz
Copy link
Contributor

So are these OS5 packages still valid for the PR4100/PR2100 NAS units? Seeing seriously mixed messages between here and the WD forum?

@ricardoespinobon
Copy link

So are these OS5 packages still valid for the PR4100/PR2100 NAS units? Seeing seriously mixed messages between here and the WD forum?

The zip on this thread works just fine for me in PR2100.

image

image

@irctrakz
Copy link
Contributor

@ricardoespinobon thanks! I just updated to OS5 and installed the Docker app without issue! (PR4100)

@mrmatt
Copy link

mrmatt commented Oct 28, 2020

Verified docker for PR2100 OS5 -- Happy to test entware for OS5... though i was able to get Transmission & Flexget configured in a container (wiserain/docker-transmission) so that not be necessary

@Avian-Flew
Copy link

Entware failing on upload into OS5.

@Perlets9
Copy link

Not works on EX2Ultra, it fails on docker run with this error:

docker: Error response from daemon: OCI runtime create failed: container_linux.go:349: starting container process caused "process_linux.go:449: container init caused \"rootfs_linux.go:58: mounting \\\"mqueue\\\" to rootfs \\\"/mnt/HD/HD_a2/Nas_Prog/_docker/vfs/dir/c13d78eea5a514e034fcaa369fdd8fb2d9d0e2c647437e1e5ce100dd186e5780\\\" at \\\"/dev/mqueue\\\" caused \\\"no such device\\\"\"": unknown.

@JediNite
Copy link
Collaborator

@Perlets9 yeah this is the same error as what I was getting on the EX4100. The kernel WD have supplied does not have mqueue support compiled in.

JediNite

@koehn
Copy link

koehn commented Oct 30, 2020

Under OS5, I am suddenly unable to connect from one Docker container to another. That is, if I run

docker run --name $NAME -p 9001:9000 --restart=always -d -v /mnt/HD/HD_a2/minio:/data -e "MINIO_ACCESS_KEY=$ACCESS_KEY" -e "MINIO_SECRET_KEY=$SECRET_KEY" minio/minio server /data

and try to access that container from an nginx container (or whatever), and run:

curl -v 10.0.1.232:9001
* Expire in 0 ms for 6 (transfer 0x5588b8cfff50)
*   Trying 10.0.1.232...
* TCP_NODELAY set
* Expire in 200 ms for 4 (transfer 0x5588b8cfff50)
* Connected to 10.0.1.232 (10.0.1.232) port 9001 (#0)
> GET / HTTP/1.1
> Host: 10.0.1.232:9001
> User-Agent: curl/7.64.0
> Accept: */*
> 
* Empty reply from server
* Connection #0 to host 10.0.1.232 left intact
curl: (52) Empty reply from server

Curiously, I can still access minio remotely (the same curl command from MyCloud outside of Docker or from another machine works fine). It's only from one container to another that's broken.

This worked prior to upgrading to OS 5. Now I need to figure out an alternative somehow.

Update: I switched nginx to host networking, and am able to connect to the other container. Something isn't working with bridge networking in OS5.

@brentgl
Copy link

brentgl commented Oct 31, 2020

Not works on EX2Ultra, it fails on docker run with this error:

docker: Error response from daemon: OCI runtime create failed: container_linux.go:349: starting container process caused "process_linux.go:449: container init caused \"rootfs_linux.go:58: mounting \\\"mqueue\\\" to rootfs \\\"/mnt/HD/HD_a2/Nas_Prog/_docker/vfs/dir/c13d78eea5a514e034fcaa369fdd8fb2d9d0e2c647437e1e5ce100dd186e5780\\\" at \\\"/dev/mqueue\\\" caused \\\"no such device\\\"\"": unknown.

Exactly the same here.

Are we SOL then without mqueue support in kernel?
Thanks
Brent

@JediNite
Copy link
Collaborator

JediNite commented Nov 2, 2020

@koehn.

Update: I switched nginx to host networking, and am able to connect to the other container. Something isn't working with bridge networking in OS5.

Did you try creating a custom bridge network or are you using the default bridge network that is installed with docker ?

https://docs.docker.com/network/bridge/ may help ?

Cheers,

JediNite

@Vendo232
Copy link

Vendo232 commented Nov 2, 2020

docker_19.03.8_OS5.zip

@Vendo232 try the Mirror package in this new zip. I think they just renamed the MirrorV2 to simply Mirror.
The old V1 did not support Docker so it was not part of the build script.

Stefan I was able to install Docker on Mirror V2 but the :9000 Portainer is not opening, any idea what could be wrong?

image
image

@koehn
Copy link

koehn commented Nov 2, 2020

Did you try creating a custom bridge network or are you using the default bridge network that is installed with docker ?

I was just using the default bridge network, trying to communicate between two containers launched thusly:

Minio:

docker run --name $NAME -p 9111:9000 --restart=always -d -v /mnt/HD/HD_a2/minio:/data -e "MINIO_ACCESS_KEY=$ACCESS_KEY" -e "MINIO_SECRET_KEY=$SECRET_KEY" minio/minio server /data

Nginx:

docker run --restart=always --name=$NAME -d -p 9443:443 -p 9080:80 -v $PWD/nginx.conf:/etc/nginx/nginx.conf -v $PWD/conf.d:/etc/nginx/conf.d nginx

Nothing fancy, and those same scripts worked prior to the OS 5 upgrade. Now the nginx container cannot communicate with the port that the minio container is exposing (10.0.1.123:9111, where the WD's IP is 10.0.1.123) unless nginx is run on the "host" network. It's not a show-stopper for me, and you should be able to reproduce it with those scripts (or a variation), but I thought you'd want to know.

Thanks for all your hard work on this project! Much appreciated!

@JediNite
Copy link
Collaborator

JediNite commented Nov 2, 2020

@koehn,

Double check within the "daemon.sh" script that it has this line :
${DOCKERD} --ip-masq=true >> /var/lib/docker/docker.log 2>&1 &

If this is missing, it may also be the cause. For some reason I found on the EX4100 (prior to OS5), that IP masquerading was not being enabled by default unless the daemon was started explicitly with the option. I know @stefaang has added this into the branch code though, so you should have it there if using the latest. If you really do want to try and use bridge networking, would recommend creating a custom bridge network and see if it makes a difference.

Cheers,

JediNite

@koehn
Copy link

koehn commented Nov 2, 2020

I'm sorry; where do I find daemon.sh? I've looked in a bunch of locations but it hasn't turned up.

@JediNite
Copy link
Collaborator

JediNite commented Nov 2, 2020

I'm sorry; where do I find daemon.sh? I've looked in a bunch of locations but it hasn't turned up.

@koehn ,

Try looking in "/mnt/HD/HD_a2/Nas_Prog/docker"

Cheers,

JediNite

@koehn
Copy link

koehn commented Nov 2, 2020

Thanks! I found the file, and it has the line you indicated, exactly as you mentioned it above. A quick ps shows that it is running with --ip-masq=true.

@maxnl
Copy link

maxnl commented Nov 3, 2020

I had the same issue trying to get two containers to communicate with each other using the default bridge network. I ended up creating a new bridge network and assigned the containers to that, and the issue appeared to be resolved. I'm on a PR4100

@akanoodles
Copy link

I had the same issue trying to get two containers to communicate with each other using the default bridge network. I ended up creating a new bridge network and assigned the containers to that, and the issue appeared to be resolved. I'm on a PR4100

@maxnl Can you detail how to do that in portainer? or did you have to sshd into it?

@vacovnik
Copy link

@JediNite, are there any workarounds for the issue @Perlets9 and @brentgl encountered since I have the same problem with mqueues.
I would really appreciate a working docker since Transmission app is missing and the sql database is limited to localhost access on My Cloud OS 5.

Best regards,
Marko

@JediNite
Copy link
Collaborator

JediNite commented Nov 11, 2020

@JediNite, are there any workarounds for the issue @Perlets9 and @brentgl encountered since I have the same problem with mqueues.

I would really appreciate a working docker since Transmission app is missing and the sql database is limited to localhost access on My Cloud OS 5.

Best regards,

Marko

@vacovnik,

There is nothing that can be done as a workaround as the kernel needs to be rebuilt with mqueue support. I saw recently on the WD forums that a large number of people have raised concerns about docker being removed from the OS5 release so at least it is on their radar to fix. The post appeared to indicate WD are looking to fix in a future release.

Cheers

JediNite

@akanoodles
Copy link

@D-stefaang how do you run the 'portainer-ce' image instead of the 'portainer' image?

@caglaraydin
Copy link

Will there be any apps for My Cloud Gen2?

@Myron-S
Copy link
Contributor

Myron-S commented Apr 5, 2021

Docker 19.03.8 for OS5
docker-19.03.8-OS5.zip

Works on PR4100. Looking for confirmation on other platforms.
Based on OS5 branch: https://github.com/WDCommunity/wdpksrc/tree/OS5

Works on a DL4100. :-)

@kueblert
Copy link

kueblert commented May 5, 2021

Hey there,
bintray seems to shut down and does not allow downloads without a paid account anymore.
I found the build artifacts for Docker. Are there also suck for syncthing or any cloud software (nextcloud,...)?

@Myron-S
Copy link
Contributor

Myron-S commented May 5, 2021

He's already on it. See the announcement.

@sheel
Copy link

sheel commented Aug 10, 2021

Hello, I was able to download the .zip above and install on my PR4100, firmware 5.15.106.

However, when I go to configure, it's an empty page (:9000).

I ssh'd into the PR4100, and there is nothing listening on :9000 and no docker processes running.

netstat

root@illmatic docker # netstat -tulpn | grep 9000
root@illmatic docker #

docker ps

root@illmatic docker # docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
root@illmatic docker #

docker is running

root@illmatic docker # ls -l /var/run/docker.sock
srw-rw---- 1 root root 0 Aug 9 23:49 /var/run/docker.sock

I tried running the portainer command, and get a cgroup mount error

root@illmatic docker # docker run -d -p 9000:9000 --restart always -v /var/run/docker.sock:/var/run/docker.sock -v $(pwd)/portainer:/data portainer/portainer
73b72f8dfd01384bde20af579e86d904367bb807ccee69ff777768f333eec0f3
docker: Error response from daemon: cgroups: cannot find cgroup mount destination: unknown.

docker info

root@illmatic docker # docker info
Client:
Debug Mode: false

Server:
Containers: 4
Running: 0
Paused: 0
Stopped: 4
Images: 1
Server Version: 19.03.8
Storage Driver: vfs
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
Volume: local
Network: bridge host ipvlan macvlan null overlay
Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
Swarm: inactive
Runtimes: runc
Default Runtime: runc
Init Binary: docker-init
containerd version: 7ad184331fa3e55e52b890ea95e65ba581ae3429
runc version: dc9208a3303feef5b3839f4323d9beb36df0a9dd
init version: fec3683
Security Options:
seccomp
Profile: default
Kernel Version: 4.14.22
OSType: linux
Architecture: x86_64
CPUs: 4
Total Memory: 3.708GiB
Name: illmatic
ID: ZXDP:4LW5:ROQL:V4ZT:LZIJ:SYRC:JAVL:DBXP:SN4Q:QMS3:67GS:PUZS
Docker Root Dir: /mnt/HD/HD_a2/Nas_Prog/_docker
Debug Mode: false
Registry: https://index.docker.io/v1/
Labels:
Experimental: false
Insecure Registries:
127.0.0.0/8
Live Restore Enabled: false
Product License: Community Engine

WARNING: No memory limit support
WARNING: No swap limit support
WARNING: No kernel memory limit support
WARNING: No kernel memory TCP limit support
WARNING: No oom kill disable support
WARNING: No cpu cfs quota support
WARNING: No cpu cfs period support
WARNING: No cpu shares support

docker version

root@illmatic cgroup # docker version
Client: Docker Engine - Community
Version: 19.03.8
API version: 1.40
Go version: go1.12.17
Git commit: afacb8b7f0
Built: Wed Mar 11 01:22:56 2020
OS/Arch: linux/amd64
Experimental: false

Server: Docker Engine - Community
Engine:
Version: 19.03.8
API version: 1.40 (minimum version 1.12)
Go version: go1.12.17
Git commit: afacb8b7f0
Built: Wed Mar 11 01:30:32 2020
OS/Arch: linux/amd64
Experimental: false
containerd:
Version: v1.2.13
GitCommit: 7ad184331fa3e55e52b890ea95e65ba581ae3429
runc:
Version: 1.0.0-rc10
GitCommit: dc9208a3303feef5b3839f4323d9beb36df0a9dd
docker-init:
Version: 0.18.0
GitCommit: fec3683

@s0th1s
Copy link

s0th1s commented Sep 3, 2021

Stefaan, I found your Cloudsmith bin files for OS5 Docker and Entware installers, do you have an updated location to get your Tautulli installer for OS5, specifically for the PR4100? Tautulli is the only bin installer I do not have. I found and installed it previously from the bintray link, but it appears bintray is no longer around and your posted links no longer work. Any help is appreciated.

First tests with the new kernel look promising, but it's not flawless yet. Kudos to @JediNite for testing it. I see a fair chance they'll take it along in one of the upcoming updates.

Tautulli installer for OS5: https://bintray.com/beta/#/tfl/wdpksrc/Tautulli?tab=overview

Syncthing installer for OS5: https://bintray.com/beta/#/tfl/wdpksrc/Syncthing?tab=overview

NZBGet installer for OS5: https://bintray.com/beta/#/tfl/wdpksrc/NZBGet?tab=overview

@PaoloP74
Copy link

PaoloP74 commented Sep 14, 2021

Hi all,
where can I find the latest OS5 Docker package for the EX2 Ultra?

@h3pdesign
Copy link

Hi these binary Links- Do not work. Please post some working links here. The provided links are a dead end stating that "Bintray has been deprecated
The JFrog Platform offers many solutions to distribute your software internally or externally."

@h3pdesign
Copy link

Me too Hi all,
where can I find the latest OS5 Docker package for the EX2 Ultra?

@PaoloP74
Copy link

I found this repo: https://cloudsmith.io/~wd-community/repos/#

@ufcpride
Copy link

HI, is there an updated Tautulli installer for OS5 for WDPR4100 at all please? I've installed Entware and Docker, but need the bin for Tautulli. The old respisitories seem to have gone. The links just keep taking me back to this page. TIA

@Kale-Tech
Copy link

Kale-Tech commented Oct 22, 2021

I managed to download all of the OS 5 packages before the site went down.

I uploaded them to google drive for anyone who needs it:

https://drive.google.com/drive/folders/1ba3DmqBlLu8pG2WUYzgDZoVf5ot_pNv0?usp=sharing

@Kale-Tech
Copy link

Me too Hi all, where can I find the latest OS5 Docker package for the EX2 Ultra?

HI, is there an updated Tautulli installer for OS5 for WDPR4100 at all please? I've installed Entware and Docker, but need the bin for Tautulli. The old respisitories seem to have gone. The links just keep taking me back to this page. TIA

https://drive.google.com/drive/folders/1ba3DmqBlLu8pG2WUYzgDZoVf5ot_pNv0?usp=sharing

@ufcpride
Copy link

@Kale-Tech Thank you so much, that's excellent. I've managed to install it with no issues.

Thanks again,

@Myron-S
Copy link
Contributor

Myron-S commented Oct 22, 2021

Thank-you Kale-Tech. 👍🏻

@Kale-Tech
Copy link

@ufcpride @Myron-S No problem. Glad to help!

@ArthurSav
Copy link

I found this repo: https://cloudsmith.io/~wd-community/repos/#

I was beginning to lose hope. Installed the image for EX2 Ultra and it works!

@stephanmax
Copy link

COPS packages for OS5: https://bintray.com/beta/#/tfl/wdpksrc/COPS?tab=overview

@stefaang, sorry to bother you on this, but could you re-share the link to the OS5 package of COPS? The link above seems to go somewhere else now. Thanks in advance!

@Kale-Tech
Copy link

COPS packages for OS5: https://bintray.com/beta/#/tfl/wdpksrc/COPS?tab=overview

@stefaang, sorry to bother you on this, but could you re-share the link to the OS5 package of COPS? The link above seems to go somewhere else now. Thanks in advance!

Hey, I managed to download those packages before the link stopped working. I uploaded them for anyone who needs it:

https://drive.google.com/drive/folders/1ba3DmqBlLu8pG2WUYzgDZoVf5ot_pNv0?usp=sharing

@qiancasper
Copy link

sorry to bother you on this, but could you re-share the link to the OS5 package of COPS? The link above seems to go somewhere else now. Thanks in advance!

happy new year first, im running with os 5.18.117 with my dl2100 unable to finish the installation of WDMyCloudDL2100_docker_19.03.8 is there any alternatives to get docker install on my os5.18.117 device. cheers

@rongchun
Copy link

rongchun commented Mar 3, 2022

Hasn't the docker OS5 been updated? Cannot be used in firmware 5.20.113.

@JediNite
Copy link
Collaborator

Docker packages are now updated at https://github.com/WDCommunity/wdpksrc/releases/tag/docker-v20.10.14.

@Jazjo
Copy link

Jazjo commented Sep 20, 2022

Hello, on MyCloudEX2Ultra with FW 5.23.114 getting message - unable to finish the installation of MyCloudEX2Ultra_docker_20.10.14. Would it be please possible to update package for this FW? Many thanks in advance.

@LeHGlobeTrotter
Copy link

@Kale-Tech @JediNite You both are awesome! I installed using the 19.03.8 bin file shared by @Kale-Tech then realized that @JediNite provided a newer version an upgraded after. Everything went smooth as silk.

@technotiger
Copy link

technotiger commented May 5, 2023

Why no packages for single bay WdMyCloud? Can we get entware atleast? Where is mksapkg-OS5?

Edit: Answering my own question. mksapkg-OS5 is missing in master but it is available in other branches. I was able to build and install entware for single bay WdMyCloud. It would be nice if these packages (for single bay WdMyCloud) can also be made available on Cloudsmith. I am not sure why they have been omitted.

@rcknr
Copy link

rcknr commented Jan 22, 2024

@technotiger Can you please share Entware package you've built?

Okay, it turns out building these is quite easy.
@stefaang @WD-stefaang But still how about making a release of Entware for OS5?

@technotiger
Copy link

@technotiger Can you please share Entware package you've built?

Okay, it turns out building these is quite easy. @stefaang @WD-stefaang But still how about making a release of Entware for OS5?

Glad you figured it out. It's been long since my post. I see that built packages for the single bay WdMyCloud have not yet been published. Well, building the packages yourself is better anyway (security wise).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests