The Indian Rupee (INR) holds onto losses near its all-time low against the US Dollar (USD) in the opening session on Thursday.