Hi Adam Dziedzic!

Thanks for feedback!

Time passed and I can say that nowadays in Tensorflow there is no way to use Tensorflow ops in forward pass in context of overriding backprop.

Do you have operations that do not exist in numpy?

Thanks!