I think that if voldemort really wanted to kill harry potter the night the spell didn’t work on him he could’ve just picked him up and thrown him out a window given the fact that he was a one year old infant
you do realise that the spell rebounding made voldemort too weak to pick up so much as a feather right