"But the thing is, I never took us seriously"