#找个理由骗番茄# The Next Generation Of Artificial Intelligence (Part 1)

The Next Generation Of Artificial Intelligence (Part 1)

by Rob Toews

1. Unsupervised Learning
At a deeper level, supervised learning represents a narrow and circumscribed form of learning. Rather than being able to explore and absorb all the latent information, relationships and implications in a given dataset, supervised algorithms orient only to the concepts and categories that researchers have identified ahead of time.

In contrast, unsupervised learning is an approach to AI in which algorithms learn from data without human-provided labels or guidance.

Unsupervised learning more closely mirrors the way that humans learn about the world: through open-ended exploration and inference, without a need for the “training wheels” of supervised learning. One of its fundamental advantages is that there will always be far more unlabeled data than labeled data in the world (and the former is much easier to come by).

Unsupervised learning is already having a transformative impact in natural language processing. NLP has seen incredible progress recently thanks to a new unsupervised learning architecture known as the Transformer, which originated at Google about three years ago.

2. Federated Learning
The concept of federated learning was first formulated by researchers at Google in early 2017. The standard approach to building machine learning models today is to gather all the training data in one place, often in the cloud, and then to train the model on the data. But this approach is not practicable for much of the world’s data, which for privacy and security reasons cannot be moved to a central data repository. Rather than requiring one unified dataset to train a model, federated learning leaves the data where it is, distributed across numerous devices and servers on the edge. Instead, many versions of the model are sent out—one to each device with training data—and trained locally on each subset of data. The resulting model parameters, but not the training data itself, are then sent back to the cloud. When all these “mini-models” are aggregated, the result is one overall model that functions as if it had been trained on the entire dataset at once.

The original federated learning use case was to train AI models on personal data distributed across billions of mobile devices. More recently, healthcare has emerged as a particularly promising field for the application of federated learning. Beyond healthcare, federated learning may one day play a central role in the development of any AI application that involves sensitive data: from financial services to autonomous vehicles, from government use cases to consumer products of all kinds. Paired with other privacy-preserving techniques like differential privacy and homomorphic encryption, federated learning may provide the key to unlocking AI’s vast potential while mitigating the thorny challenge of data privacy.

3. Transformers
Transformers were introduced in a landmark 2017 research paper. Previously, state-of-the-art NLP methods had all been based on recurrent neural networks (e.g., LSTMs). By definition, recurrent neural networks process data sequentially—that is, one word at a time, in the order that the words appear.

Transformers’ great innovation is to make language processing parallelized: all the tokens in a given body of text are analyzed at the same time rather than in sequence. In order to support this parallelization, Transformers rely heavily on an AI mechanism known as attention. Attention enables a model to consider the relationships between words regardless of how far apart they are and to determine which words and phrases in a passage are most important to “pay attention to.”

Transformers have been associated almost exclusively with NLP to date, thanks to the success of models like GPT-3. But just this month, a groundbreaking new paper was released that successfully applies Transformers to computer vision. Many AI researchers believe this work could presage a new era in computer vision. (As well-known ML researcher Oriol Vinyals put it simply, “My take is: farewell convolutions.”)

[Source: Forbes]

  • 5
  • +10番茄
  • 192只自习生围观
  • 2020年11月27日 06:12打卡
  • 5 月,1 周前有动静
  • 引用
  • 举报
最近犒劳过的人

可怕。。

  • EasterBugs
  • 5 月,1 周前
  • 2020年11月29日 18:31
  • 卡主

可怕。。

啊?为啥?

啊?为啥?

没有没有【笑哭】只是被有点吓到
就是夸您强的意思【笑哭】

就是类似于看到一个很厉害的同辈做出很厉害的成就后情不自禁发出的感叹以及一点点自惭形秽 是这个意思

  • EasterBugs
  • 5 月,1 周前
  • 2020年11月29日 21:25
  • 卡主

就是类似于看到一个很厉害的同辈做出很厉害的成就后情不自禁发出的感叹以及一点点自惭形秽 是这个意思

哈?我只是为了骗点番茄而已╮( ̄▽ ̄)╭

作者的近日打卡

猜你喜欢

HOW DO SHUFFLE FEATURES ON PLAYLISTS ACTUALLY MAKE THEIR SELECTIONS? - Shuffle is supposed to play our music in
Make clear about the source of the power - Make clear about how to get the power an
  • 凌风
  • 凌风
  • ♂ 31
  • 6级
  • 自律力75.23
  • 多伦多
Learn to set the personality - Learn to set the personality in differen
  • 凌风
  • 凌风
  • ♂ 31
  • 6级
  • 自律力75.23
  • 多伦多
Short Communication - A short communication needs to be writte
  • Alisa
  • Alisa
  • ♀ 36
  • 自律力52.96
  • The Arctic Circl
Refresh and have more predictions and memories - Do things more efficiently
  • 凌风
  • 凌风
  • ♂ 31
  • 6级
  • 自律力75.23
  • 多伦多
IBM Launches Bayesian Optimization Appliance - *By John Russell* , , The appliance har
Hare Krishna temple & Menlo Park - Brain Bleach: What has been seen cannot
dual problem - starting with dual problem
  • Xchan
  • Xchan
  • ♂ 34
  • 6级
  • 自律力78.12
  • 新加坡
  • 工程师
Know that the infinite power is from your core area. - Practice is as important as awareness.
  • 凌风
  • 凌风
  • ♂ 31
  • 6级
  • 自律力75.23
  • 多伦多
The Next Generation Of Artificial Intelligence (Part 2) - **4. Neural Network Compression** , AI i

免费没广告,线上在线自习室晚自习。支持番茄工作法、四象限、打卡、作业清单、作业辅导、作业交流、作业跟踪、作业计划

行恒 © 行恒 2013