You can have 11 perk points if you don't want to use a secondary, a tactical, and a lethal.
This is what I have in mind and i will run this with a submachinegun.
Quickdraw=1
Toughness=1
Dexterity=2
Scavenger or Lightweight=2
Stoppping Power= 5
Total: 11 points