Has he really been focused on avenging Milah though? Or has he been more focused on revenge for the embarrassment of having his hand cut off in front of his entire crew? Milah was definitely a part of it, but I think he might want to kill Rumpel mostly to fix his own wounded pride.