On no, Zoe, that is really terrible. I am so sorry for you!
A swim bladder problem would not effect all your fish at one time - it's not contagious, but a malfunction of the air bladder inside the fish. I have a betta (Siamese fighting fish) with that problem, and he can swim, but irradically, and usually with his head end up and tail end down, which is very tiring for him, and so he spends most of his time hanging out in his floating "house." But not lying on the bottom.
Could there be fertilizer or a chemical run-off from somewhere near your pond, that got into the water?
I think the really cold winter, and late spring, has been tough on our outdoor pets. I had a mud turtle come out of hibertnation, and the last days has been acting unusually - lying on the bank of the pond in plain view, when usually, this species would be deep in the water, hiding. I thought he was seeking out the sun's rays for warmth. Because his behavior was so atypical, the other day I brought him inside, to a warmer tub of water. But this morning he was dead. I consider him a victim of the freeze.