P/Invoke declarations should be portable-CallNextHookEx

The error message is pretty obvious, your function has an incorrect return type. CallNextHookEx is documented as returning LRESULT and LRESULT is a LONG_PTR, that is, it is pointer sized. Change the return type from int to IntPtr.