Less than a month ago, the AI Salesforce team released a new text generation model, CTRL.

Less than a month ago, the AI Salesforce team released a new text generation model, CTRL.

The algorithm works by allowing you to input a web link, and it attempts to generate an article that could be found there. This model is truly massive—it is built on 1.6 billion parameters and is trained on three times the amount of data as GPT-2 (which was 8 million of the best pages from Reddit). I will demonstrate how it works using two links that I made up:

https://techcrunch.com/2020/05/26/best-mobile-game-with-advanced-ai
The Best Mobile Game with Advanced AI
In recent years, we have seen many games trying to do something new and different. One such example is "Minecraft," which has been around for quite some time, but recently added an interesting twist using artificial intelligence (AI) to help players build things like buildings, weapons, and other items.
However, this is not just any old AI. It is referred to as AI. It is used not only in Minecraft—though that is where most people will likely look first—but also in many other games, including Angry Birds, Star Wars, and Clash Royale.
What makes this particular type of AI special is its ability to learn from experience.
The DeepMind Labs team created a system that can play thousands of levels of Minecraft without getting bored. This is achieved through learning about the mechanics of the game over time, as well as analysing data collected during gameplay.
end
And here’s another link that I made up, along with the article compiled by the algorithm:

https://www.cnn.com/world/09/19/2019/beautiful-naked-girle-found-on-church-roof
Naked Woman Found on Church Roof
MUST SEE
(CNN) A naked woman was reportedly discovered on Sunday morning by a priest and his wife in the tower of St. Peter's Basilica in the Vatican.
The woman, believed to be around 30 years old, was seen earlier that day sitting atop the church's tower with her hands clasped over her knees, said Monsignor Pietro Parolin.
He told CNN that he does not know if she will have any identification or how long it will take for police authorities to identify her.

Read more

"The only thing we can say right now is that this person likely just came from elsewhere," Parolin said.
The woman's body vanished before dawn on Sunday, but police are still searching for her, he added.
Police are investigating whether other people were involved in the incident.
This occurred while Pope Francis was celebrating Mass in the basilica—one of the holiest sites in Catholicism—after returning from an international trip where he visited several countries, including South Korea, Israel, and Jordan.
end

It’s not perfect, but it’s still one of the best AI-generated fake news articles I’ve seen. It maintains context throughout the entire article and generates articles with great sensitivity to the server where it is supposedly located. You can also ask the algorithm questions. It answered me well when I asked who the first Czech president was—Václav Havel. When I asked what the meaning of life is, it replied, "life." When I inquired which metal is more expensive than gold, it answered nickel (though it clearly got that wrong—I checked, and it’s currently being bought at around 200 CZK per kilo :))

So, what do you think of the new CTRL model?

Sources:
Github: https://github.com/salesforce/ctrl
Collab to try it out: https://colab.research.google.com/drive/1hVveBQShDru1Mjnhe4C21uQv4A2eH1tV
Maxík's article: https://minimaxir.com/2019/09/ctrl-fake-news/

Originally published on Facebook — link to post