Try bumping up your calories and see where that will take you. Also eat more protein, anywhere from 1g-2g per body weight, and the rest can come from carbs and fats. Hope it helps.
I know what you mean man. I can only say what I've notice in myself, but when the body fat drops overall, it will sooner or later burn off. Unfortunately you can't spot reduce, so just keep your...