Github GitHub - giongto35/cloud-morph: Decentralize, Self-host Cloud Gaming/Appl...

Decentralized, Self-hosted Cloud Gaming service on WebBrowser.
Video Demo: https://youtu.be/eFR7fLy9z6E
Technical Document: https://github.com/giongto35/cloud-morph/wiki
CloudRetro: https://github.com/giongto35/cloud-game: Sister project, Cloud Gaming Service For Retro Games

Introduction

CloudMorph is a decentralized, self-hosted cloud gaming/cloud application platform. Users can quickly spawn up a cloud gaming service with minimal configuration. By leveraging the ease of deployment, CloudMorph goal is to build a decentralized cloud application network with app providers and consumers.
CloudMorph copes with different technical challenges from OS to Cloud, such as Low-Latency Streaming, Video/Audio encoding pipeline and optimization, Windows application Virtualization in headless server, OS event simulation, NAT traversal, P2P network structurization, etc.
Unlike CloudRetro, a completed Cloud Gaming solution for Retro Game run on its dedicated cloud infrastructure, CloudMorph decentralized hosting works to users with any Windows Games/Applications by a generic and modularized solution.

Discord: Join Us

Video Demo: https://www.youtube.com/watch?v=fkOpOQ-HwFY

Screenshot Screenshot Diablo II-US Starcraft RoadRash Browse and Switch games

CloudMorph Demo

• Cloud Diablo SG (Demo of Collaborative play Diablo running on Singapore server using CloudMorph).
• Cloud Diablo US (Demo of Collaborative play Diablo running in US server). Switch applications using the sidebar on the left.

Usecases

For Consumers.

• Play any provided application directly from Browser without Installation.
• i.e, clouddiablo.com is for playing Diablo on Browser collaboratively. When we have less time to finish a game, let's do it together?

For Providers

• Playable Ads: Instead of Video Teaser, Game/Application providers can let users interact with the application.
• Discoverable: Any application that joined the network will be surfaced to users over CloudMorph channel.

For Developers

• Experience playing/hosting Cloud Gaming on their own.
• Plugable Cloud gaming module: The cloud gaming core is packaged and virtualized to be extendable to different tech stacks. E.g Python, Java ...

Getting Started

• Run setup_remote.sh 111.111.111.111 inside ./script, 111.111.111.111 is the address of your host. What you will get is a Notepad hosted on your remote machine. More details are in Deployment section below.

Design

Goal:

1. Cloud gaming Philosophy: The application run in the remote cloud instance. Video/Audio is streamed to users in the most optimal way. User interaction needs to have the lowest latency.
2. Cross-platform compatibility: The service is accessible in web-browser, the universal built-in that can fit multiple platforms like Desktop/Mobile. No console, plugin, external app, or devices are needed.
3. Deployment Simplicity: There is no API/ interface integration required to set up the integration. One line command to finish the deployment.
4. Mesh network: Providers-Consumers over Peer To Peer communication. After joining the network, Provider's Application is discoverable and immediately launched with one selection.
5. Modularizable: A concise technical stack to develop/deploy for cloud gaming/ cloud application service.
6. Scalable: Able to scale on headless machines cluster horizontally.

CloudApp Core

1. When a Web Service starts, Application Container, named "CloudApp Core", is spawned. Inside the Container there are Application + Virtual Display/Audio + Windows Event Simulation Utility. Multiple Containers can be spawned on demand.

2. Web Service is in charge of Webapp interface, P2P communication. When a user/client connects the service, the service will initialize a WebRTC connection between the client and service. This project uses WebRTC Pion, which is a fantastic library for WebRTC in Golang.

3. Input captured from Client is sent to Web Service using WebRTC Data Channel (UDP).

4. Web Service sends received input events to Virtual Machine over a socket.

5. The utility (syncinput.exe) listens to the input events and simulates equivalent Windows OS events to Wine Application through WinAPI.

6. Application screen/ Audio is captured in a Virtual Display Frame Buffer (XVFB)/ Virtual Audio (PulseAudio), which is later piped to FFMPEG.

7. FFMPEG encodes the Video Stream to VPX RTP stream and Audio Stream to Opus stream.

8. Overall, "CloudApp Core" module receives Input as WebSocket event and Output as RTP stream. It is packaged in Container with the interface declared at core/go/cloudapp.

Decentralize

• Discovery service is a centralized service, backed by etcd. In this flow, Client periodically query this service to get list of joinable host and show them in sidebar.
• For Provider, if the configuration in config.yaml includes discoveryHost attribute, application will be discoverable to user.

Detailed Technology

wiki

Development

The service is built using Golang, C++, and Linux X11 utility tools (Xvfb, ffmpeg). You can set up all dependencies with setup.sh. After that, you can run the go server with

• go run server.go

Access to your local at

• localhost:8080

Note: the wine application runs inside Docker. You can run it without docker by changing run-wine.sh to run-wine-nodocker.sh in server.go for easier debugging.

Deployment

First, we need an Ubuntu instance with a public network firewall (No firewall rule for P2P communication NAT traversal). There is script/create_do.sh to create a digital ocean instance. We prepare below in the same directory

1. config.yaml: app config, the app configuration.
2. wine: whole wine folder from .wine. If there is no wine folder, the deployment uses the default .wine from installation.
3. apps: the folder contains the app we will deploy. It is later mapped to winvn/apps in the remote instances. For example, DiabloII. If your application is already inside the synced wine environment at 2, ex "Program Files", we can skip it. We need to configure config.yaml, apppath to point to the correct app path.
4. setup_remote.sh: a copy of the script in winvm/script to deploy your application to server.

After that, we run setup_remote from inside the folder:

• setup_remote.sh $ip. Ex: ./setup_remote.sh 159.89.146.77
• Tutorial Video: https://www.youtube.com/watch?v=w8uCkfZdHVc

Deployment Example

• script/example contains example applications configuration. Note: /apps is left empty due to copyright.

Deployment with Lutris

• Lutris eases the installation of a game on Linux. The recommended flow is to install game with Lutris and copy produced wine environment to Cloud Morph.

Road Map - Request for Help

• UI improvement
• Full Dockerization. Only core is packaged, server is not run in Container.
• Port C++ Window API to Rust.
• GPU acceleration. - Integrate with FFMPEG job.
• Multiplex application sessions. Currently, only collaborative mode is supported, which serves all application sessions from the same single instance.
• Performance optimization.
• Web Mobile controller support. Mouse click is already simulated.
• Packaging frontend as a plugin that can be imported into any Webpage.