That format appears to be what is called EBCDIC Zone-Decimal. In that format,the sign digit isb1101nnnn or b11010101for your example which is N in EBCDIC. The other digits are b1111nnnn. The following code simply uses the lower four digits to extract the decimal value, and tests the last digit for the sign. You will need to get each intput value into an array of char to use this code. The stringToChArarray function is probably suitable, as I presume your input file is being read as strings.
Dim Inarray() As Char = {Chr(&HF0), Chr(&HF0), Chr(&HF4), Chr(&HF3), Chr(&HF9), Chr(&HD5)}
'Dim Inarray() As Char = {Chr(&HF0), Chr(&HF0), Chr(&HF4), Chr(&HF3), Chr(&HF9), Chr(&HF5)}
Dim sign As Integer = 1
Dim R As Long = 0
For I As Integer = 0 To inarray.length - 1
Dim c As Integer = Asc(Inarray(I))
If I = Inarray.Length - 1 Then
If (c And &HF0) = &HD0 Then sign = -1 Else sign = 1
End If
c = c And &HF
R = R * 10 + c
Next
R *= sign
MsgBox(R.ToString)