On June 11 (local time), Facebook announced TextStyleBrush, an AI research project that can copy text styles with just one word in a photo. It can recognize handwriting and replace it with other characters while retaining that style.
According to Facebook, TextStyleBrush is the first self-supervised AI. Existing AI needed to learn large amounts of data, but AI can label itself based on input data. This allows you to copy text styles from a single word in an image.
You can use this to replace image text with other text while preserving its style. Applications such as AR display of translation results in other languages while maintaining the character style are conceivable. The Text Style Brush is said to still have problems recognizing text written in metallic materials or other colors.
Deepfakes that appear as if they were speaking by replacing them with other person images are often problematic, but a text style brush that replaces other characters while maintaining style is a dial deepfake. It is also intended to promote research that detects this technology by disclosing it. Related information can be found here.