People often mistake the little folds in the plica fimbriata, which is a natural structure of the tongue, for skin tags. In other instances, a wart may be mistaken for a skin tag rather than the real tag itself. Mouth cancer is the only potentially fatal cause of a skin tag under the tongue; however, mouth cancer cases are far less common than other types of cancer.