Amir also lamented being constantly judged for the spot-fixing taint.
Amir, who has not been picked in the squad for the upcoming tour of New Zealand, feels communication and understanding need to be better between players and the management.
See Also: "It only motivates me to do better": Mohammad Amir on New Zealand tour snub
"The problem is that if a player musters the courage to say in Pakistan cricket that he wants rest, he is dropped, so players are now scared about speaking about it with the management," he told the 'News One' channel.
"There is a mindset in Pakistan cricket where players are scared of being dropped from the team. I think this communication gap should be removed between players and the management.
"If a player wants to take a break he should be happy to speak about it with the management and they should understand his point of view and give him a rest instead of dropping him from the team," he added.
Last year, Amir retired from Test cricket to prolong his career in the shorter formats and the left-armer reiterated that his decision to leave red-ball cricket was turned into an unnecessary controversy.
"Mickey Arthur was our head coach and anyone can ask him this. I was telling him since 2017 that if my workload is not managed I would have to leave Test cricket," he remarked.
"After I announced my decision no one spoke to me for six months about it and controversy was only created around my decision when we lost in Australia.
"...people lack common sense to understand the situation I was in after returning to cricket from the five-year ban," he added referring to the spot-fixing ban that he served.
Amir said people failed to understand his problems when he returned to cricket after the ban without any training.
"Ask the team physio the problems I was facing with my eyes, knees and shoulders and I kept on telling them to manage my workload no one listened," he asserted.
"I remember playing in the first match of the World Cup with spasms and after taking pain killers.
"I only decided to retire from Test cricket when I realised my body could not take it and if I wanted to prolong my career I had to do something. So I decided to give up Test cricket to prolong my career."
Amir also rued being constantly judged for the spot-fixing scandal.
"Yes what happened in 2010 was wrong and I paid for it by being out of cricket for five years so much so I couldn't even play club matches. But people still tend to judge you by the past, not from the present.
"I think only God has the power to be judgemental and I just believe if your conscience is clear it is okay. But there is more negativity than positivity in Pakistan cricket," he concluded.
(With PTI inputs)