In-plane negative magnetoresistance and quantum oscillations in van der Waals antiferromagnet DyTe₃

Two-dimensional van der Waals (vdW) magnetic materials, characterized by their tunable magnetism, spin transport properties, and remarkable quantum effects, provide significant promise for the development of efficient, low-power spintronic devices. Intriguingly, the rare earth tritelluride (RTe₃) materials have attracted great attention due to their unique magnetic structure, exotic electronic properties, multiple charge density wave (CDW), and superconductivity under pressure. Here, we report the successful synthesis of high-quality DyTe₃ single crystals using a self-flux method. DyTe₃ shows an antiferromagnetic transition at 4.5 K and demonstrates the magnetic field-induced ferromagnetism. The high-quality DyTe₃ single crystal demonstrates outstanding transport properties, featuring a high carrier mobility of approximately 1.4 × 10⁴ cm²⋅V⁻¹⋅s⁻¹ and large linear magnetoresistance of 1300%. Furthermore, distinct Shubnikov–de Haas (SdH) oscillations are observed in DyTe₃, revealing a small Fermi pocket and an effective mass of 0.24 m_e. Remarkably, the unconventional in-plane negative magnetoresistances appear along the a-axis below 2 T and c-axis until 9 T from 2 K to 17 K, which are attributed to the complex helimagnetic structures caused by CDW coupling and weak single-ion anisotropy. Our findings offer a significant platform for understanding the complex magnetoresistance behavior and quantum transport effects in RTe₃-type materials, holding great promise for advancing applications in electronic and spintronic devices.