I decided to try a new way of baking normal map details, using floating geometry. 3 hours of work in total. I tried to create a small scene in unity to test how well it performs in a game environment.
Raw
Unity test
AO + Normal Bake
Albedo
Wireframe: 6000 Triangles