Thanks to Growth Intelligence for supporting this video. Discover new ways for your business to use language models: https://growthintelligence.com/

The age of AI is upon us, but can it help us save the planet? In this video, we'll take a look at an application of foundation language models (particularly transformers and Google's BERT) to the task of identifying sustainable businesses.

0:00 Intro
0:38 Machine Learning
1:46 Transformers
5:09 Foundation Models
6:19 BERT
7:49 Fine-Tuning for Sustainability
10:01 Bias
11:01 Outro

------------------

FURTHER READING

Transformers
https://arxiv.org/pdf/1706.03762.pdf
https://towardsdatascience.com/transf...
https://www.analyticsvidhya.com/blog/...
https://www.analyticsvidhya.com/blog/...
https://www.analyticsvidhya.com/blog/...
http://jalammar.github.io/illustrated...

Foundation Models
https://research.ibm.com/blog/what-ar...
https://deeplizard.com/learn/video/5T...

BERT
https://huggingface.co/blog/bert-101
https://www.analyticsvidhya.com/blog/...
https://towardsdatascience.com/what-e...

------------------

MUSIC

Glimpsing Infinity
Asher Fulero (YouTube Audio Library)

Lightless Dawn
Kevin MacLeod (incompetech)

One Sly Move
Kevin MacLeod (incompetech)

Stasis Attempt
Max McFerrin (YouTube Audio Library)

The World’s Fair
Godmode (YouTube Audio Library)