Session timers handling issue

Hi,
I am facing issue with session timers configuration in Asterisk 13.5.0, Following is the sip.conf for the same:

session-timers=originate
session-expires=180
;session-minse=90
session-refresher=uas

Issue is If the call released during session refresh in progress, BYE is not transmited to remote UE if session refresh fails at remote UE with 408 Request timeout. Is there any configuration option to forward BYE to remote UE for this case also. Otherwise session is still live at remote end when observed this case.

For reference enclosed call flow for the same.

Thanks
Anzi

Can anybody suggest workaround for this issue ?.