Jaiswal was clean bowled by Fernando for 45 runs and incident happened after the dismissal.
During the heated exchange, Jaiswal came close to punching Fernando. After being hit for three boundaries in the over, Fernando dismissed Jaiswal with the penultimate ball and appeared to send him out.
Jaiswal, who was walking back, turned to face the fast bowler. The two exchanged a few words, collided heads, and pushed until they were separated by the rest of the Sri Lankan players.
Manjrekar held Jaiswal responsible for the altercation, indicating that batters should not lose their cool during such moments.
"The guy (Jaiswal) was on his way to the pavilion when he took a few steps back and comes close to a fielder. And eventually, I think there was contact with the helmet. Am I right in saying that? I think there was contact. If I were the match referee, I would make a serious note of that. Because, see that contact? Jaiswal is the one who advanced towards the bowler," the former India player said on Sony Sports Network.
"Whatever was said is part and parcel of the game. Things are said. It is our job as batters to keep our cool. So, I find that, on this occasion, Jaiswal crossed the line for sure," he added.
Yashasvi Jaiswal had made 45 runs before his dismissal. Devdutt Padikkal made 117, and Shubman Gill made 50 runs, while Ravindra Jadeja contributed 43 runs as India ended day one on 300/5. Asitha Fernando picked three wickets for Sri Lanka.