The cation-independent mannose 6-phosphate receptor (CI-MPR) plays a critical role in intracellular transport of lysosomal enzymes as well as the uptake of recombinant proteins. To define the minimal glycan structure determinants necessary for receptor binding and cellular uptake, we synthesized a series of glycans containing mono-, di-, tri-, tetra-, and hexamannoses terminated with either one or two phosphates for conjugating to a model protein, recombinant human acid α-glucosidase. A high affinity interaction with the CI-MPR can be achieved for the enzyme conjugated to a dimannose glycan with a single phosphate. However, tightest binding to a CI-MPR affinity column was observed with a hexamannose structure containing two phosphates. Moreover, maximal cellular uptake and a 5-fold improvement in in vivo potency were achieved when the bisphosphorylated hexamannose glycan is conjugated to the protein by a β linker. Nevertheless, even a monophosphorylated dimannose glycan conjugate showed stronger binding to the receptor affinity column, higher cellular uptake, and significantly greater in vivo efficacy compared to the unconjugated protein which contains a low level of high affinity glycan structure. These results demonstrate that the phosphorylated dimannose moiety appears to be the minimal structure determinant for enhanced CI-MPR binding and that the orientation of the glycan is critical for maximum receptor interaction. In summary, we have improved the understanding of the mechanism of CI-MPR binding and developed a simple alternative for CI-MPR targeting.