The phrase "I have never thought of giving up" means that the speaker has never had any intention to stop doing what he/she had been doing before.
"To give up" means "to abandon hope for something" or "to to admit one's defeat or inability to do something"