Torch FX as code generator for AD

[yingjerkao]

PyTorch 2.0 released the FX module, which consists of three main components: a symbolic tracer, an intermediate representation, and Python code generation.

https://pytorch.org/docs/stable/fx.html

Example code:
https://github.com/pytorch/examples/tree/1bef748fab064e2fc3beddcbda60fd51cb9612d2/fx

This allows for manipulation of computational graphs and potentially generation of AD code for tensor network algorithms.

This might provides an easier integration of AD to our library

[IvanaGyro]

arrayfire/arrayfire-ml#30 shows how Arrayfire initiates their AD. It may be a good reference if we want to implement AD in our library but do not want to add dependencies or completely replace the layers below the tensor.