Chandhigarh, September, 30: Former Punjab CM Captain Amarinder Singh declared that shortly he will be leaving the Congress party.