On a brute taking both SP and Smite early does help build fury faster. I will drop SP later in the build once I have SL and MG and my attack chain is full without SP. I hear a lot of brutes also skip SM because the long animation isn't good for fury, but I take it and only use it once fury has built up since it is really the only AoE you get in the set.
I use Smite, SL, MG as my attack chain with Boxing on auto. I do reserve SM for those times I can hit 2 or more mobs with it.
I have gone through several build posts and I always see them with Smite, wouldn't it be better to take Shadow Punch for Fury? Or even both Shadow Punch and Smite instead of Shadow Maul and its long activation?
Shadow Punch , Smite , Siphon Life ..... Shadow Punch , Smite, Midnight Grasp
Seems more Viable after slotting