Failing two cles in high school years, can it affect you getting into a good college?

I failed two cles because the school gave me two ESL cles in the middle of the semester and I felt it was wrong. I knew how to speak English and I am able to speak English well with others and as a result, I didn't go. Consequently, I failed the two cles and it went on my transcript. (By the way, it was two 40's >:O) My average decrease from a 80 to an average around 70 and now I am afraid that it might get in the way of be getting into a good college. Please give me some advice. By the way, I did try to fight the cles. Apparently, I wasn't born in America and English is a second language. >:O Whatever. Can you give me some urance?