Reduced performance after page is kept idle for 1minute

We have AX solution to track the hours of efforts by employees. The page will take less than second to perform any action after loading. If we leave the page idle for some time say 1 minute and now try to do any action the time will increase to 5-6 seconds
I am not able to know what the issue is. Any useful pointers/suggestions will be helpful