Testing the effectiveness of a simple RNN and a simple transformer encoder layer in embedding on the Penn Tree Bank. Using Nsight-Compute, and the torch profiler tool, I was able to extract information from the GPU for roofline models and a kernel trace analysis.