IMO
Keep the scores for saves and skill, but don't them to attacks, spell DC, HP.
Also, classes add to scores. Strong people don't become barbarian, being a barbarian makes you strong.
I.e.
Roll 4d6, drop lowest.
Fighters then add +2 Str, +2 Dex, +2 Con.
Background and species can add a...