That is bizarre. I have never seen 'nan' in RockSim before, now there are two posts about it in a span of two days. (See this
other thread.)
Summary: After a lot of trial and error, I determined that the problem is in your folding fins. Change the material from "Custom" to something else and the simulation will work.
Other recommendations:
1) Use the RockSim stability equations instead of Barrowman.
2) Do not use the Ring Tail Assembly in RockSim to simulate your ring tail. Instead use Bruce Levison's methods. I think Bruce's method is more accurate. RockSim adds a lot of drag for the ring tail, cutting the altitude by about 60%.
--------------------------------------
Here's all the stuff I did while trying to track this problem:
I tried running the model that you posted. In the 2D Flight Profile with Details enabled, the rocket icon starts out in the horizontal position with a flight angle of 'nan' degrees. At the first simulation time step, most of the other flight variables become nan as well.
I tried changing the Simulation Controls settings from Explicit Euler at 800 samples/sec to 4th Order Runge-Kuta at 2000 samples/sec. No help.
Changed the Calculation Method and Simulation Method from Barrowman stability equations to RockSim stability equations. No help.
Changed the Launch angle on the Starting State tab. No help.
Deleted the Ring fin. No help.
Changed engines. Use C11, F21W, and G55. No help.
Deleted one set of fins in the mid airframe. No help.
Deleted the other set of fins on the mid-body. MAGIC! Flies great to 2442 feet on an F21W-6. Hmmmm!
Reloaded the original model file. Deleted hinge fins. No good.
Reloaded the original model file. Deleted folding fins. Works fine. 1594 feet on a G55.
Reloaded the original model file. Edited folding fins. Changed plan points. No good.
Noticed that Calculated Component Mass for the fin = 0.0000 oz. Also noted that Material = Custom. Changed that to plywood and everything works.