Tap this arrow.

Just build over it in the proper direction or look in your game settings for the controls?

When you build and drag in any directionele the belt direction is adjusted automatically.

Mindustry is amazing. Really fun to start over with the community mods.