In many cases, this has much to do with the app itself, certain settings in Windows 11/10, or your network connection. Thankfully, there are ways to increase the Download Speed in Xbox app ...

However, doing this will only cause your game to download slower. To most efficiently download a game, you not only want to not use your console for anything else, but close any running apps.