magento2.3 – Moving some information from one server to another Magento 2.3.3

We do have some issues with our Magento 2.3.3 server and we want to move all the customer, products, sales info, and all the stuff that is important from the old server to the new one. Some of the issues are all the 3rd party module that is installed.

The old server is Magento 2.3.3 and the new one is a fresh 2.4 installation. Will this be possible? without bringing all the mess from the old server?

Any help and suggestions are appriciated.