"For some types of games that could potentially be the case,"

Keep in mind that "external" memory doesn't directly add to the garbage collector work. For example, graphics textures could take up gigabytes of video/system memory but the GHC runtime only needs to keep track of pointers to where that data is, rather than all of the data itself.