How are you getting the sneak attacks? Seems like you'd be limited to feinting, and from skill ranks via Swashbuckler, since it's not even a class skill for Fighters. I don't like feinting for sneak attack, the enemy adds BAB to the opposed check on top of skill mod, and even with a feat, it's still taking up part of the round's actions and only benefitting one attack. Much better is actually sneaking (at least until they act in the combat, all your attacks benefit) or using magic devices (also not a class skill) to summon a flanking buddy, lay down some grease, or sick a persistent blade on somebody.
And if you value dex to damage so much, you can dip Swordsage (or take 3 feats, but that's a little pricy to me) and pick up Shadow Blade. *Shrug* I'd think without amazing rolls or huge point buy, maintaining three good attack stats on top of con would be a chore not particularly worth bothering all on its own merits. Assassin's Stance and Craven feat are already likely to add more to your sneak attack damage anyway.
