...well, yeah, that's normal.
Don't load every single mod in your folder into the game. The game doesn't like it: that's a lot of stuff to process at once.
If you're playing singleplayer, only load the mods you are going to play right *then*. If you want to switch characters or map packs or something, restart the game.