In a medium-size bowl, combine both flours, brown sugar, baking soda, cinnamon, nutmeg, and salt. In another medium-size bowl, whisk together the buttermilk, egg yolks, butter, and honey. Pour this mixture into the dry ingredients, stiffing with a few quick strokes to form a lumpy batter. In a small bowl beat the egg whites, and then fold them into the batter. Cook the waffles ~ 1.5-2 minutes, until golden brown or their edges look dry & they do not stick to the grids. Transfer them to the oven (200 degrees), placing them directly on the rack so they will stay crisp until serving time.