linux – Setting key persistant to a modifier with xmodmap , not loading unless I source .xinitrc

So I’m just trying to assign Control_R , to a different function such as mod3 with xmodmap , for that I have added the following line on .xinitrc

(( -f ~/.Xmodmap )) && xmodmap ~/.Xmodmap

Beforehand I have done

xmodmap -pke > ~/.Xmodmap

And appended the lines I needed to add my functonality

clear control
add control = Control_L
add mod3 = Control_R

Anytime I startx if I xmodmap the output hasn’t changed , but as soon as I do source .xinitrc it does the change I desired:

shift       Shift_L (0x32),  Shift_R (0x3e)
lock        Caps_Lock (0x42)
control     Control_L (0x25)
mod1        Alt_L (0x40),  Meta_L (0xcd)
mod2        Num_Lock (0x4d)
mod3        Control_R (0x69)    ------------------------> 
mod4        Super_L (0x85),  Super_R (0x86),  Super_L (0xce),  Hyper_L (0xcf)
mod5        ISO_Level3_Shift (0x5c),  Mode_switch (0xcb)

How can you achieve this functionality in Debian Buster ?