But I'm seriously not remembering this "out of line"-ness of Hagrid's; where did he use Draco's fear against him? The closest I can think of is when he says "Fang is a coward." Draco insisted he wasn't going into the forest, and Hagrid (most likely being entirely truthful) told him that if he didn't carry out his detention he'd be expelled. It's Filch who uses fear against Draco.
no subject