"During the summer, our father would take the whole family"