For years I’ve had a dream of building a rack mounted PC capable of splitting its resources to host multiple GPU intensive VMs:

  • a few gaming VMs
  • a VM for work that can run Davinci Resolve and Blender renders
  • an LLM server
  • a Stable Diffusion server
  • media server

Just to name a few possibilities…

Everytime I’ve looked into it, it seemed like the technology just wasn’t there yet. I remember a few years ago Linus TT took a shot at it, but in the end suggested the technology (for non-commercial entities) just wasn’t in a comfortable spot yet.

So how far off are we? Obviously AI focused companies seem to make it work, but what possibilities exist for us self-hosters who might also want to run multiple displays in addition to the web gui LLM servers? And without forking out crazy money for GPU virtualization software licenses?

  • TCB13@lemmy.world
    link
    fedilink
    English
    arrow-up
    49
    ·
    13 days ago

    The technology has “been there” for a while, it’s trivial do setup what you’re asking for, the issue is that games have anti cheat engines that will get triggered by the virtualization and ban you.

    • socphoenix@midwest.social
      link
      fedilink
      English
      arrow-up
      8
      ·
      13 days ago

      Which games do that? Running pasthrough gpu on windows for destiny and halo at least gave me 0 issues for years

      • You999@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        14
        ·
        13 days ago

        Anything using vanguard such as valorant and league of legends, battleye such as pubg, destiny 2, and rainbow 6 siege, and easy anti cheat such as fortnight blocks virtual machines. Vanguard is especially bad because it will not allow to run the game with Intel-VT/AMD-V enabled even if you are running bare metal as of its last update.

        • umbrella@lemmy.ml
          link
          fedilink
          English
          arrow-up
          8
          ·
          13 days ago

          this just makes me wanna install bare-metal goody-2-shoes windows and cheat using a 5$ arduino

        • socphoenix@midwest.social
          link
          fedilink
          English
          arrow-up
          7
          ·
          13 days ago

          That’s weird destiny 2 has never given me issue, though I don’t play super frequently so maybe I’m just lucky

        • vividspecter@lemm.ee
          link
          fedilink
          English
          arrow-up
          3
          ·
          13 days ago

          Vanguard is especially bad because it will not allow to run the game with Intel-VT/AMD-V enabled even if you are running bare metal as of its last update.

          The Vanguard anti-cheat is incredibly invasive and something akin to malware, so that’s not surprising.

      • Dark Arc@social.packetloss.gg
        link
        fedilink
        English
        arrow-up
        5
        ·
        13 days ago

        I’m surprised, I was pretty sure anything with Battleye flat out rejected virtualization.

        I thought Destiny used Battleye but I must be mistaken on one of these points.

      • TCB13@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        13 days ago

        Most likely everything Steam + VAC or Denuvo. There’s a lot of discussion on that topic around the web.