@Nivedita9 

I am not an expert in UI builder but since you mentioned it's an OOB then it's an issue because if that incident is clicked then it should open the existing incident without impacting the caller field value

If my response helped please mark it correct and close the thread so that it benefits future readers.

Regards,
Ankur
Certified Technical Architect  ||  10x ServiceNow MVP  ||  ServiceNow Community Leader