# FLAX/JAX Learning Resources

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fflax-jax-learning-resources%2F7725%3E%5C
**Category:** Flax/JAX Projects\
**Created:** [June 30, 2021, 9:51am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fflax-jax-learning-resources%2F7725 "2021-06-30T09:51:18Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![srisweet](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/srisweet/32/1829_2.png) [@srisweet](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsrisweet)%5C
**Post date:** [June 30, 2021, 9:51am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fflax-jax-learning-resources%2F7725%2F1 "2021-06-30T09:51:18Z")

</div>

Hello all,

I have tried my best to organize FLAX/JAX learning resources. I hope it will be useful for all of us.  
If you have more learning resources, drop a comment & I will add them here…

[JAX](https://github.com/google/jax) is a numerical computation library that exposes a NumPy-like API with tracing capabilities.

Flax is the most widely used JAX library, with [129 dependent projects](https://github.com/google/flax/network/dependents?package_id=UGFja2FnZS01MjEyMjA2MA%3D%3D) as of May 2021.  
[Flax](https://github.com/google/flax) builds on top of JAX with an ergonomic module abstraction using Python dataclasses that leads to concise and explicit code.

Flax’s “lifted” JAX transformations (e.g. `vmap` , `remat` ) allow you to nest JAX transformation and modules in any way you wish. It is also the library underlying all of the official Cloud TPU JAX examples.

Github links :  
[JAX Projects](https://github.com/huggingface/transformers/tree/master/examples/research_projects/jax-projects)  
[FLAX examples](https://github.com/huggingface/transformers/tree/master/examples/flax)

Colab links:  
[Causal Language Modelling on OSCAR](https://colab.research.google.com/github/huggingface/notebooks/blob/master/examples/causal_language_modeling_flax.ipynb)  
[Masked Language Modelling on OSCAR](https://colab.research.google.com/github/huggingface/notebooks/blob/master/examples/masked_language_modeling_flax.ipynb)  
[Text Classification on GLUE](https://colab.research.google.com/github/huggingface/notebooks/blob/master/examples/text_classification_flax.ipynb)

Docs:

[JAX 101 Tutorial](https://jax.readthedocs.io/en/latest/jax-101/index.html)  
[Flax Basics Colab](https://flax.readthedocs.io/en/latest/notebooks/flax_basics.html)  
[Flax examples](https://flax.readthedocs.io/en/latest/examples.html)

More useful links:

[Guide to run JAX on Google Cloud TPU](https://cloud.google.com/tpu/docs/jax-quickstart-tpu-vm).  
[Load Dataset in streaming mode](https://huggingface.co/docs/datasets/master/dataset_streaming.html?highlight=streaming)

_TALKS Date & Time:_

> 30.6.2021 : 9am - 11am PST [Zoom link](https://us02web.zoom.us/j/89844071286?pwd=RzZaL1VPLzM0Um5kYzJRWVBFMmtRQT09)

> 1.7.2021 : 8:30am - 10am PST [Zoom link](https://us02web.zoom.us/j/84443602508?pwd=NnZOMC84bXRBU3RaSHl3dTdBekIrZz09)

> 2.7.2021 : 8am - 10am PST [Zoom link](https://us02web.zoom.us/j/83307589607?pwd=NnNCN1doQkZKcjVSMlZwVEc2aVgrZz09)

---

<div class="post-metadata">

**Author:** ![patrickvonplaten](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/patrickvonplaten/32/2171_2.png) [@patrickvonplaten](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fpatrickvonplaten)%5C
**Post date:** [June 30, 2021, 12:15pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fflax-jax-learning-resources%2F7725%2F2 "2021-06-30T12:15:56Z")

</div>

Great summary - thanks a lot @srisweet !

---

<div class="post-metadata">

**Author:** ![srisweet](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/srisweet/32/1829_2.png) [@srisweet](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsrisweet)%5C
**Post date:** [June 30, 2021, 12:23pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fflax-jax-learning-resources%2F7725%2F3 "2021-06-30T12:23:12Z")

</div>

My pleasure ! @patrickvonplaten  
Can you please share the links to join the talks ?

---

<div class="post-metadata">

**Author:** ![patrickvonplaten](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/patrickvonplaten/32/2171_2.png) [@patrickvonplaten](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fpatrickvonplaten)%5C
**Post date:** [June 30, 2021, 12:28pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fflax-jax-learning-resources%2F7725%2F4 "2021-06-30T12:28:46Z")

</div>

There are online and accesable here: [transformers/examples/research\_projects/jax-projects at master · huggingface/transformers · GitHub](https://github.com/huggingface/transformers/tree/master/examples/research_projects/jax-projects#talks)

---

<div class="post-metadata">

**Author:** ![srisweet](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/srisweet/32/1829_2.png) [@srisweet](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsrisweet)%5C
**Post date:** [June 30, 2021, 12:29pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fflax-jax-learning-resources%2F7725%2F5 "2021-06-30T12:29:54Z")

</div>

Thank you very much ! @patrickvonplaten

---

<div class="post-metadata">

**Author:** ![srisweet](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/srisweet/32/1829_2.png) [@srisweet](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsrisweet)%5C
**Post date:** [June 30, 2021, 12:52pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fflax-jax-learning-resources%2F7725%2F7 "2021-06-30T12:52:35Z")

</div>

My pleasure @alexlau .

Patrick will help you with this question.  
@patrickvonplaten Can you tell us if the zoom talks will be recorded ?

---

<div class="post-metadata">

**Author:** ![srisweet](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/srisweet/32/1829_2.png) [@srisweet](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsrisweet)%5C
**Post date:** [July 1, 2021, 1:52am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fflax-jax-learning-resources%2F7725%2F8 "2021-07-01T01:52:19Z")

</div>

Hi @alexlau,  
Just found out that the zoom talks have been recorded…I will post the links once I get them…
