Marcus Thuram’s double put Gladbach on course for a famous victory until Real roared back with late efforts from Karim Benzema and Casemiro — three minutes into added time — to salvage a point.
But Real remain at the bottom of Group B after their shock 3-2 home defeat by a depleted Shakhtar Donetsk side in last week’s opener.
Zidane’s side also lost both legs of last season’s round-of-16 exit at the hands of Manchester City.
“For me, this draw is not a relief, it’s a deserved result,” said Real coach Zidane.
“We had an opponent who had us in trouble on two or three occasions, but we didn’t panic and came back with character.
“If we continue to play like that, we’ll do great things and we’ll win matches — that’s for sure.”
Shakhtar sit two points clear at the top of the table after a goalless draw with Inter Milan in Tuesday’s earlier Group B encounter.
Despite having more than 60 percent possession, Real rarely troubled Gladbach goalkeeper Yann Sommer until the frantic final scenes.
“Real Madrid are one of the best teams in the world and we should have known they’d throw everything at us,” said Thuram.
“We have to learn from this experience.”
Benzema had two early half-chances at Borussia Park, before Gladbach struck in style just after the half-hour mark.
A bad pass by Germany star Toni Kroos put the Spanish giants under pressure in their own half.
Gladbach midfielder Jonas Hofmann snapped up the loose ball and fed Alassane Plea, whose pin-point low pass to Thuram was buried into the back of the net.
Real have now kept clean sheets in just two of their last 13 Champions League games.
Thuram, the son of French 1998 World Cup winner Lilian Thuram, pounced to score his second in the 58th minute.
When Plea’s fierce shot was saved by Real goalkeeper Thibaut Courtois, Thuram was on hand to tap home the rebound from close range and leave the 13-time European champions reeling.
It could have been 3-0 a few moments later but Plea was denied when through on goal by Courtois.
Zidane threw on Luka Modric and Eden Hazard for the final 20 minutes in an attempt to avoid a damaging defeat.
Hazard released Benzema, who hit the side netting as Real desperately hunted for a goal.
With time almost up, Casemiro headed the ball back into play from a deep cross and Benzema diverted the ball in from point-blank range.
With Real attacking in waves, Modric clipped a cross to the far post, Sergio Ramos leapt highest and Casemiro drove the ball into the roof of the net.
“When you concede two late goals and drop the points it’s not a good feeling,” admitted Gladbach coach Marco Rose.
“It came down to the quality of Real.
“We wanted to defend better until the end, but sometimes you need a little bit of luck and we didn’t have that.”
For more news your way, download The Citizen’s app for iOS and Android.
Download our app and read this and other great stories on the move. Available for Android and iOS.