Skyrim: Special Edition (vanilla) crashes on the loading screen when starting a new game

So, when I start a new game via the main menu, the game will crash to the desktop.

Extra info:

• Models on main menu (dragon) and loading screen are both missing.
• The game crashes even when not using any mods.
• There is a dollar sign in front of some text.
• The game doesn't run in fullscreen mode, even when set to do so in the launcher.

Things that I already tried:

• Verifying the game's integrity via Steam.
• Removing the game and all folders and files that had something to do with the game (i.e. My Games/Skyrim: Special Edition) and then reinstalling the game.

Any information and/or help is greatly appreciated, even if it's just a suggestion that may provide some more info.

Edit:

I have since posting this question also tried the following things:

• Updating video drivers.
• Moving the install folder to another drive or just plain installing it there.