My car (not a Skyline) made that noise when the thrust bearing was on the way out.
When it got worse, you could hear it when just ticking over in neutral and when I lifted the clutch pedal to create some slack in the pedal the noise would stop.
A couple of days later it failed completely and I just about managed to limp very noisily to a workshop to have it changed
