magento2 – How to clear swatches cache when there is an update from an external source?

I have some changes where swatches should be greyed out for some product depending on its stock in physical stores.
I get the stock in physical stores from a webservice (which is ran every 5 mins by a cron) which is then populated in a table and this data is used to know if the swatch should be greyed out or not.
It works just fine for my use case, the only issue is whenever there is an update, it does not work unless i clear the cache.
I have tried clearing the associated product and configurable product cache programatically – but this does not help.
What am i missing?