|Type of paper:||Essay|
|Categories:||Philosophy Languages Literature review Artificial intelligence|
This review holds an overview of two articles together with an evaluation of one section. The article better language models and Their Implications is all about the wording in artificial intelligence and what they imply in the technological life situation.GPT-2 model was acknowledged to people mostly to give the prediction of how the world can be with the internet forty gigabytes. GPT-2 is quite a large model with as many parameters as over one billion. The same numbers are trained on data sets for almost eight million websites. It is always the scale-up of mere GPT. It as well played many capabilities, for example, the generation of synthetic samples of high quality and even outperforming other models of languages, for instance, Wikipedia.
GPT-2 started leaning all the tasks without any specific data. It came up with a text sample towards an arbitrary input model that looks like a chameleon (Radford et al, 2019a). The same was helpful to the user since they could come up with realistic as well as continuation about a topic. For instance, scientist developed a herd of a unicorn in an interior valley which has never been explored. This unicorn could correctly speak English and was named Ovid's unicorn. Following continuous research by Perez and her team, they also found another creator on top of the mountain that could as well speak regular English.
The example discussed above implies that the model can come up with various prompts that are close to humanity. However, there are other weaknesses that were as well spotted with these models; for example, they started writing fire underwater. The same led to extra work in the field of research, and what they realized is that it is never easy to come up with a good sampler model. Researchers could come up with models which are fifty percent reasonable, but on the other side, half the percentage could contain similar throwbacks.
Moreover, GPT-2 gained achievements in state of the art. It came up with zero-shot, which was not trained on any data towards a specific task. About data set on zero-shot, there was a high score on accuracy to Winograd scheme challenge, lambada, as well as children's books test. There was a well outrageous result in language tasks like translation due to training the prompt model. The performance was hypothesized to increase at an alarming rate because of an increase in computer and data.
Regarding po0licy implications, large models could be as a result of the input of the society. GPT-2 could be used to perform tasks like better speech recognition, language translation, as well as dialogue agents. All the GPT-2 findings indicate that there is a reducing cost of coming up with fake content. Similarly, the concern of significant language led to the releasing of smaller version GPT-2 together with sampling code. It was in line with the decision that security will protect future publications. In the mid-twenty-nineteen, the update of GFPT-2 involved the release of the following that is sharing based on partnership and staged release (Radford et al, 2019b). Finally, the output dataset contained two hundred and fifty thousand model samples to assist in a wide range of research.
Evaluation of Marcus' Article
Following the overall discussion of GPT-2 all over, it implies a lot about natural as well as artificial intelligence. Considering the development of deep learning that is language and cognition, there have been intellectual in animal and humans as it goes to Plato and Kant. John Locke, which is a British philosopher, recommends that the only way to develop intelligence is through learning. The same get pronounced better due to interaction with different people and things across the world. Following the development of GPT-2, what John and cant narrated get considered as speculation since, due to computers, there can be the connection of neural networks and see what every other [person is learning across the world.
The development of a powerful transformer GPT-2 can get used to affirm the hypothesis of John Locke. The model had forty gigabytes, with 1.5 billion parameters to be adjusted based on training data without any knowledge before. The structured model with both input and output do not have inbuilt language and even lack the knowhow of what a verb or noun is. It can give a sentence in a tree structure form. However, the most excellent model of GPT-2 does not have such funny scenarios. The powerful transformer machine can define the category of most words.
Generally, following philosophers' points of argument, the GPT-2 machine works so well. It can generate a sentence as if human beings did it. It can take a set of the word as input and deliver it well as output. On the very last evaluation of GPT-2, it has a fluent output from sentence to paragraph level (Marcus, 2020). It is comparatively good in sticking to a particular topic. Concerning characters and titles in a passage, it can stick to them very well.GPT-2 has the ability to cope up with missing words and can even answer various technical questions.
List of References
Marcus, G., 2020. GPT-2 and the Nature of Intelligence. The Gradient. Retrieved from https://thegradient.pub/gpt2-and-the-nature-of-intelligence/
Radford, A., Wu, J., Amodei, D., Amodei, D., Clark, J., Brundage, M. and Sutskever, I., 2019a. Better language models and their implications. OpenAI Blog https://openai. com/blog/better-language-models.
Radford, A., Wu, J., Child, R., Luan, D., Amodei, D. and Sutskever, I., 2019b. Language models are unsupervised multitask learners. OpenAI Blog. Retrieved from https://openai.com/blog/better-language-models/.
Cite this page
Free Essay on Summary of Open AI Articles. (2023, May 17). Retrieved from https://speedypaper.com/essays/summary-of-open-ai-articles
If you are the original author of this essay and no longer wish to have it published on the SpeedyPaper website, please click below to request its removal:
- Professional Development for Teachers, Free Essay Sample
- Essay Outline Example on Hand Washing
- Free Essay on Children With Special Needs Inclusion
- Incidents in the Life of a Slave Girl - Literary Essay Example
- Free Essay Sample on Online Commerce and Marketing
- Free Essay on Financial and Accounting Market in China
- Essay Sample on Knowledge Management in UAE Organizations