Robustness of Inflation to Large Tensor Perturbations