Ssh refuses connection...allows after service restarted

I am new to the group and I tried looking up for my problem in the
archieves first before posting...

Well I have cross compiled ssh from a intel machine to a Athlon

I am using PAM for authentication.

After this when I boot the athlon machine, it gives
"Connection Refused". But when I do ps on the machine, it shows that
sshd is running.

I kill sshd and retart it, after which it works fine.

Can someone help me with this!