Balance of the Sisters + Dual Wield + Being Disarmed

Sorry, I lost the log in the scroll, but I'll try to describe it as best I can for you. I was fighting Dryzzel and Njaal in the Frigid Wastes. I was blinded somehow and then Dryzzel disarmed me (I can't remember if he stripped my weapon this time or did his War Master thing). Anyway, I still had a whip wielded in my offhand, but it wouldn't let me do any specs with it, even though I chose Balance of the Sisters for one of my legacies. Thanks.