Zhiyuan Zhang (Holly)

πŸ‘‹ Hi! I am a Ph.D. student in Computer Science at the University of California, Los Angeles (UCLA), advised by Prof. Jiaqi Ma and Prof. Yuan Tian. Before UCLA, I obtained a B.Sc. degree from The Hong Kong Polytechnic University.

My research focuses on privacy-preserving large language models, especially differentially private retrieval-augmented generation (RAG). I have also worked on human mobility modeling from GPS trajectories with LLMs, diffusion transformers for synthetic trajectory generation.

πŸ“ Selected Publications

From One Query to Many: A Critical Survey of Privacy Accounting in RAG

Zhiyuan Zhang

A critical survey of how privacy accounting evolves from single-query to multi-query DP-RAG, proposing that an Ξ΅ is only meaningful together with its protected unit, accounting scope, and release boundary.

Private-RAG: Answering Multiple Queries with LLMs while Keeping Your Data Private

Ruihan Wu*, Erchi Wang*, Zhiyuan Zhang, Yu-Xiang Wang

Two differentially private RAG algorithms (MuRAG and MuRAG-Ada) for the multi-query setting, where privacy loss depends on how often each document is retrieved rather than the total number of queries, scaling to hundreds of queries within a practical budget (Ξ΅ β‰ˆ 10).

Privacy-Preserving Retrieval-Augmented Generation with Differential Privacy

Tatsuki Koga*, Ruihan Wu*, Zhiyuan Zhang, Kamalika Chaudhuri

A differentially private RAG algorithm that spends privacy budget only on the tokens that need sensitive information and uses the non-private LLM for the rest, outperforming the non-RAG baseline at Ξ΅ β‰ˆ 10 across models and datasets.

πŸŽ“ Education

πŸ† Honors and Awards

  • 2026 UCLA Doctoral Travel Grant
  • 2024 Adlerbert Foreign Student Hospitality Foundation Scholarship, Chalmers University of Technology
  • 2023/24 Wong Tit-shing Student Exchange Scholarship, HK PolyU
  • 2023 Best GBA Solution, Cathay Hackathon 2023
  • 2022/23 Dean’s Honours List of Outstanding Students, HK PolyU

πŸ‘©β€πŸ« Teaching

  • 2026 TA of CEE 181/281 Traffic Engineering Systems, UCLA
  • 2023 Volunteer Teacher of Heartfire, HK PolyU

Last updated: October 2026