Introduction

This is a pytorch implementation of Transformer [0] on one-dimensional data classification.

Usage

python test_synthetic.py to test on synthetic data

References

[0] Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information processing systems. 2017.