Conversation

Orion 🏴‍☠️🐾⎇

If you hear someone at work say words such as "vGPU" or even worse, "MxGPU" then RUN
RUN FOR YOUR LIFE

2
0
0

@awooo what do those two mean?

ive mostly seen vCPU in the context of VMs, mostly as a way to delegate GPU power to multiple VMs, without needing to bind it to one

(i'm still trying to figure out how to do that with some nvidia or AMD cards im having, so i can properly seperate my media encoding VMs, instead of putting it all into one)

3
0
0

@Mae @awooo how long until that starts trickling down to Debian and the likes, or which distro would first see this kinda stuff?

1
0
0
@ShadowJonathan @awooo virtio-gpu is also basically the only vaguely safe (within bounds) way to share GPUs.

Well, without buying a very expensive GPU that has built-in GPU virtualization (this tends to be leaky anyway, GPUs are a shitshow).
1
0
0

@lispi314 @awooo would virtio-gpu support encoding/decoding pipeline support, or is it primarily focused at drivers?

1
0
0

@ShadowJonathan @lispi314 @awooo would be surprised if it did, i couldn’t find a vaapi driver for virtio-gpu

1
0
1
@ShadowJonathan @awooo
ok so what you need:
- linux-next kernel on host
- qemu with non upstream patches
- mesa(from git) on guest
- virglrenderer compiled with amdgpu-experimental renderer

you can get this running on nix with:

https://im.badat.dev/bad/amdgpu-native-contexts-microvm.nix

it still has performance issues(mainly with qemu), so it's not very usable yet
2
0
0

@Mae @awooo thanks

im trying to properly setup some media farm stuff, but putting everything into 1 VM and then sharing the bound GPU with dozens of containers doesnt feel very good

0
0
0
@charlotte @ShadowJonathan @awooo It's more that it has possibly to expose that capacity, than it having it right now.
0
0
1

@ShadowJonathan It's hell, the drivers barely work on linux guests (Wayland pls?) and on Windows they don't work with nested virtualization (if it's enabled at all the nvidia drivers throw error 43)

On AMD's side they have the gim driver which only supports 4.x kernels (last commit 6 years ago...)

I've been dealing with a customer who wants to deploy VDI for over two weeks now and I'm about to explode

1
0
0

@Mae @ShadowJonathan ooh this is exciting! at last, virtual GPUs without drivers that will lead you to insanity

1
0
0

@awooo still, what's a MxGPU? matrix GPU?

1
0
0

@ShadowJonathan that's AMD's branding for what's vGPU on Nvidia

0
0
0

@Mae @ShadowJonathan honestly gonna try it when I get home heh, maybe it's good enough to test some VR stuff on Windows, and it would be great for some friends who can't use the linux XR stack yet for various reasons and run pasdthrough VMs right now

1
0
0

@Mae @ShadowJonathan Oh wait, is it exclusive to Mesa on the guest?

1
0
0

@Mae @ShadowJonathan ahh, welp, still cool though

0
0
0
@awooo @ShadowJonathan there is some work to make it work with windows guest, but it's quite ehhhhh
0
0
0

@awooo wait, they've invented GPU virtualization? tbh it sounds kinda dope

1
0
0

@me they invented dividing a (expensive enterprise) GPU via SR-IOV with drivers so fucked up you won't be able to pay for the therapy you need even with how rich you must be to buy one of those things

1
0
0

@awooo expensive enterprise GPU, so it's probably for "cloud" providers anyway

I wonder if that's for the LLM/image generation models

1
0
0

@me it's also for companies that want to host virtual workstations on one big server, so people can connect over RDP and use CAD software and such

0
0
0