Ultracold gases in two dimensions : novel superfluid phases for bosons and fermions

This thesis concerns ultracold two-dimensional atomic gases and the associated novel superfluid phases in an optical lattice subjected to staggered rotations. In the first part, we study the Berezinskii-Kosterlitz-Thouless (BKT) transition in a two-dimensional Bose gas. Motivated by recent experiments on the cold gas in the BKT regime, we employ a modified Popov theory and a renormalization group theory to describe the system. The two-dimensional renormalization group flow equations display unique features, which we interpret as precursors of the BKT physics. We further calculate higher correlation functions close to the BKT transition, which can serve as observables for detecting effects beyond mean-field. Finally, we obtain the density profile under the conditions of the experiment performed in the group of Dalibard in Paris, France. In the second part of the thesis, we study a recent experimental proposal of a time-dependent optical lattice with staggered rotations. We show that in the tight-binding regime, the system can be effectively described by a (Bose-)Hubbard model subjected to an artificial staggered magnetic field. The staggered magnetic field (flux) in the lattice leads to conical points in the band structure which possesses distinct minima for different strength, and can give rise to Dirac-like dispersions. For bosons, we show that besides the homogenous superfluid phase, a staggered-vortex superfluid phase is stabilized for large flux values. We show that the staggered flux renormalizes the phase boundary and find a multi-critical point separating the two superfluid phases and the Mott insulating phase. Finally, the full phase diagram of the generalized Bose-Hubbard model at zero temperature is determined. We then generalize the model for a mixture of ultracold bosons and spin-1/2 fermions. By using the Bogoliubov theory for the bosonic sector, we show that the bosonic superfluid mediates attractive interactions between fermions up to the nearest-neighbor site. The resulting model is an extended Hubbard model in the presence of a staggered magnetic field, where the on-site and the nearest-neighbor attractive interactions can be tuned independently. We then employ the Bardeen-Cooper-Schrieffer theory for superconductivity, by considering an on-site pairing order parameter competing with a nearest-neighbor resonating-valence-bond order parameter. Due to conical points in the energy band, the system possesses quantum critical property and the resulting phase diagram displays features which are strikingly similar to that of high-critical-temperature superconductors or heavy-fermion superconductors.