Why did the Duke of England try to get rid of his grandson?

Listen to rumors. Xu Jingye, a famous Tang Dynasty soldier, was smart and handsome since childhood, and his riding skills were superb, which was deeply loved by his family. However, his grandfather, Li Ji, a British civil servant, listened to rumors that although the child was clever, his face was ugly and would one day bring genocide to the whole family. Therefore, he tried to kill Xu Jingye several times, but he managed to escape.