An Introduction to GPT-3

by

When you think about the future of artificial intelligence (AI) technology, it’s likely that you don’t think of auto-completion. However, you probably should. In July 2020, OpenAI released a beta testing version of GPT-3, a new auto-completion program that could very likely define the next decade of AI programming. 

In this blog post, I will introduce you to OpenAI’s GPT-3 model, and present the strengths, limitations, and potential for this new technology. 

What is GPT-3?

Generative Pre-trained Transformer 3 (GPT-3) is AI technology developed by OpenAI, a company founded by Elon Musk and dedicated to AI investigation. It is the third model in OpenAI’s GPT series of autoregressive language tools. 

GPT-3 is a language model that uses deep learning to create human-like text. Like other language processing systems, GPT-3 predicts the probability of the sequence of words based on the given text and automatically provides the most likely answer. It is similar to the auto completion you see when you type something in the Google search bar or in the messaging application on your phone. 

How it Works

When GPT-3’s application programming interface (API) receives a small piece of text, it returns text based on the entry. The entry can be formulated as a phrase, a task, a question, or any kind of expression. 

GPT-3’s auto-completion success is based on the amount of data from which it is able to gather statistical information. GPT-3 has access to data from a wide range of sources, including data sets, common crawl, books, news, and internet web pages. Where GPT-2, GPT-3’s predecessor, had 1.5 billion parameters to analyze, GPT-3 has 175 billion parameters. To put it in perspective, the entirety of the English Wikipedia only makes up about 0.6 percent of GPT-3’s dataset. 

Emerging Tech Inspired by Self-Driving Cars

by

Self-driving technology is even more fascinating when applied to things other than cars

Alternate Title: The Self-Driving ABCs

My boyfriend’s dad’s car was recently broken into. By itself, this would be a pretty low note to start a blog post with, but rest assured that nothing was stolen and only one window of the car had to be replaced. The situation was made 100 times better by the fact that he was lent a Tesla Model X while his own car was being serviced.

Cybernetics: A cyborg-free introduction

by

It has been observed that the acceleration of Moore’s Law has left tech culture with a tendency to discount the past, which leads to issues when building for the long-term. If everything we do is going to be circular filed in a few years anyhow, why bother? I think we’re starting to see some of the limits of ahistorical strategies, especially because building for internet scale means that systems can affect higher-order aspects of society and culture in unexpected ways. This is why I want to talk a little bit about cybernetics.

Unmanned Grocery Stores

by

Unmanned Grocery Store

These days grocery stores are facing many challenges, like high maintenance costs, price competition with online stores, and limited business hours. All of these issues can be solved with unmanned grocery stores.

What Do We Look for in AI?

by

When we think of artificial intelligence at its peak, we usually think of one of two things: humans and robots coexisting happily together in society, or robots killing or enslaving humans. These are both very human things to want to do, and we have a storied history of doing both. These thoughts, or perhaps expectations, are informed by us, and the society we live in. As we develop artificial intelligence, we become robot parents, and we teach to our programmed children what we know.

The Elements of Style

by

A spate of applications have popped/cropped up in recent years with slogans like “Make Anything Art.”  They purport to transfer the style of one image and render the content of another image in that style.  In the sets of images below, the small inset image is the source of the “style” which is transferred to the larger image.  It’s an impressive trick, although I don’t know that it accurately represents what we mean by ‘style’.

Fake news

by

Traditional media is no longer the only source of news. Internet and social media have become the main platform for news sharing.
According to Pew Research Center 62% of Americans get their news from social media. This means anyone can create and share news stories, regardless of their truthiness.

A Brief Introduction to Game Theory

by

Game Theory is a field shared by math and economics that aims to describe strategies and outcomes of games. A game is simply a set of possible decisions and their outcomes. While Game Theory is immediately applicable to certain board games (Tic-Tac-Toe and Chess among others), its usefulness goes far beyond into areas such as public policy and business strategy.

An Introduction to Machine Learning

by

Machine learning (a field of artificial intelligence) is a rapidly expanding technology that we see  in use more and more in our daily lives. It is used to give us more accurate results when we do an internet search, suggest products to us when we are shopping, and offer diagnoses to our maladies.