Remove small lychee fruit with your fingers or a pair of sharp pruners. Remove entire branches, beginning with the longest branches first.. Be sure to remove any small, damaged, or misshapen fruit as soon as it appears.Whether or not gardeners agree on...