Roy Xie Small Image

Duke University

I am a second-year Computer Science Ph.D. student at Duke NLP, advised by Bhuwan Dhingra. My research focuses on developing efficient algorithms for language modeling. I am currently exploring methods to improve LLMs reasoning efficiency for complex tasks and long sequences using reinforcement learning.

My research is supported by the 2025 Apple Scholars in AI/ML PhD Fellowship and the 2024 National Science Foundation Graduate Research Fellowship. Before Duke, I worked with Antonios Anastasopoulos on low-resource NLP.

                




profile photo

Selected Publications

Publication Image
Knowing When to Stop: Dynamic Context Cutoff for Large Language Models
Roy Xie, Junlin Wang, Paul Rosu, Chunyuan Deng, Bolun Sun, Zihao Lin, Bhuwan Dhingra
Preprint, 2025
Publication Image
ReCaLL: Membership Inference via Relative Conditional Log-Likelihoods
Roy Xie, Junlin Wang, Ruomin Huang, Minxing Zhang, Rong Ge, Jian Pei, Neil Gong, Bhuwan Dhingra
EMNLP, 2024
Publication Image
Adversarial Math Word Problem Generation
Roy Xie, Chengxuan Huang, Junlin Wang, Bhuwan Dhingra
EMNLP Findings, 2024
Publication Image
Extracting Lexical Features from Dialects via Interpretable Dialect Classifiers
Roy Xie, Orevaoghene Ahia, Yulia Tsvetkov, Antonios Anastasopoulos
NAACL, 2024
Publication Image
Noisy Parallel Data Alignment
Roy Xie, Antonios Anastasopoulos
EACL Findings, 2023