Token Exchange IDP mappers

Got my token exchange to work with an IDP, so my issue is this, we want to make it map the user by phone number and this is retrieved by the profile connect url. But I thought by setting a mapper during the exchange it would map it automatically, but that’s not the case. Was wondering if you have any pointers on how to achieve this or if its even possible.