unity – How can I make the ui text child to be ignored from the raw image trigger event?

I have a rawimage prefab and one of his childs is a ui text :

Event trigger

And the script that use the event trigger :

using System.Collections;
using System.Collections.Generic;
using System.Drawing;
using System.Drawing.Imaging;
using UnityEngine;
using UnityEngine.UI;

public class MouseHover : MonoBehaviour
{
    public SaveLoad saveLoad;
    public SceneFader sceneFader;

    private bool loadGame = false;

    public void OnHover()
    {
        Debug.Log("Enter");

        loadGame = true;
    }
    public void OnHoverExit()
    {
        Debug.Log("Exit");

        loadGame = false;
    }

    private void Update()
    {
        if(loadGame)
        {
            if (Input.GetMouseButtonDown(0))
            {
                StartCoroutine(sceneFader.FadeAndLoadScene(SceneFader.FadeDirection.In, "Game"));

                loadGame = false;
            }
        }
    }
}

The problem is that even if there is a space between each of the raw images when I move the mouse over the raw images in the game view window when the mouse pointer is on the ui text at the bottom or on the same line of the ui text it’s still showing “Enter” and it’s showing “Exit” only when the mouse pointer leave the ui text.

Is there any way to keep the ui text child of the raw image but to ignore the ui text in the event trigger ?