Observations with the balloon borne SUNRISE/IMAX instrument provide us with unprecedented high spatial resolution (pixel size 40 km) measurements of the magnetic field in the photosphere of the quiet Sun. To investigate the magnetic structure of the chromosphere and corona we extrapolate these photospheric measurements into the upper solar atmosphere and analyse a timeseries with a cadence of 33s. We find that the majority of closed loops which reach into the chromosphere or corona have one foot point in strong photospheric magnetic field regions (B>300 G). Most loops are asymmetric and the weaker foot point is often located in the internetwork. We find that the magnetic connectivity of the loops changes rapidly with a typical recycling time of about 2 min in the upper solar atmosphere and 14 min in the photosphere. We discuss, to which extend the observed topological changes can be interpreted as evidence for magnetic reconnection and the relevance of these processes for coronal heating.