On 87 minutes, Liverpool keeper Loris Karius was penalised for taking Harry Kane down in the penalty box.
Kane has been the Premier League's top scorer for the past two seasons and is now two goals ahead of Liverpool's Mohamed Salah in the Golden Boot race this campaign.
Jurgen Klopp sarcastically clapped the decision and claimed after the match that the linesman wanted to "put himself in the middle" of the game. Kane converted his second penalty of the game in the fifth minute of stoppage time.
It was a game of two halves when Liverpool hosted Tottenham at Anfield a few hours earlier.
"I think we were better after 90 minutes and maybe deserved to win, we dropped two points, but that is football and the most important thing is that the character and performance was fantastic from the team".
Anfield grew anxious as the 1-0 scoreline lasted and Liverpool started looking lost, inviting Spurs onto them. Much may have been made of revenge but this match was filled with absolute mayhem, as Liverpool drew with Spurs 2-2.
Israel soldiers kill Palestinian teenager in West Bank arrest raid
The Palestinian health ministry said the teenager killed on Saturday was 19-year-old Ahmad Abu Obeid. Netanyahu said the decision wasn't meant to provoke conflict.
In Tottenham's desperation to get back in the game, Alli was then booked for diving as Dejan Lovren carefully pulled out of a challenge inside the area. I think being champion is probably the dream, not only at Liverpool, but especially at Liverpool.
Ahead of this weekend's game, Klopp told the press: "The Tottenham game at Wembley was not a good game from us". If there was one matchday when one of us is losing and Arsenal is winning then they are only five points behind.
In the 18th minute, James Milner nearly doubled Liverpool's lead as his deflected half volley sailed past the upright for a corner.
However, there would be three more goals, two penalties and plenty of controversy before the final whistle blew.
"We could have defended better in a few moments, half spaces, the midfield was a little bit hard".
Smart: "If he's not touched the ball, it is offside, so you're chalking off the penalty".
"Sometimes we complain about them (officials)".
Karius opted to punch away a cross from the left rather than attempt to catch it, and was punished when Wanyama met the clearance with a rising, first-time strike that flew inside the post.