# Transformers and TensorFlow Extended (TFX)

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftransformers-and-tensorflow-extended-tfx%2F3686%3E%5C
**Category:** 🤗Transformers\
**Created:** [February 17, 2021, 10:48am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftransformers-and-tensorflow-extended-tfx%2F3686 "2021-02-17T10:48:48Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![saschaheyer](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/saschaheyer/32/1029_2.png) [@saschaheyer](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsaschaheyer)%5C
**Post date:** [February 17, 2021, 10:48am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftransformers-and-tensorflow-extended-tfx%2F3686%2F1 "2021-02-17T10:48:48Z")

</div>

Interested in the TFX support of Hugginface Transformers.  
Referring to this blog post

> The library has seen super-fast growth in PyTorch and has recently been ported to TensorFlow 2.0, offering an API that now works with Keras’ fit API, TensorFlow Extended, and TPUs 👏.

> **[Hugging Face: State-of-the-Art Natural Language Processing in ten lines of...](https://blog.tensorflow.org/2019/11/hugging-face-state-of-art-natural.html)**
>
> The TensorFlow blog contains regular news from the TensorFlow team and the community, with articles on Python, TensorFlow.js, TF Lite, TFX, and more.

To be precise for the preprocessing part we are using TensorFlow Transform as part of the TFX pipeline.

- Are there any reference implementations or experience with using Hugginface Transformers as part of the TensorFlow Transform (TFX Transform Component)?
- And even more important the possibility to integrate the preprocessing steps as part of the model graph?
- To integrate the transformation process the complete implementation needs to be implemented with TensorFlow Operations. Is this supported? I Assume if there is support for TPUs it is the case, but I could not find any documentation.

Looking forward if someone has experimented with it already.  
Happy to join a joint force to dig deeper into these possibilities.