You can try use it with additional unwarping technic + linear classificator. But in most cases Attention RNN will works better.