Nayeema Nonta

Nayeema Nonta

Engineering Master's Student & Research Assistant at the University of Waterloo.

About / Research Interests

I am a Master's student at the University of Waterloo, supervised by Prof. Sirisha Rambhatla. My research focuses on safe post-training adaptation of large language models (LLMs), spanning tamper-resistance evaluation and parameter-efficient fine-tuning (PEFT) methods.

Publications

SubTrack++
NeurIPS 2025

SubTrack++ : Gradient Subspace Tracking for Scalable LLM Training

Sahar Rajabi, Nayeema Nonta, Sirisha Rambhatla

Training large language models (LLMs) is highly resource-intensive due to their massive number of parameters and the overhead of optimizer states. While recent work has aimed to reduce memory consumption, such efforts often entail trade-offs among memory efficiency, training time, and model performance. Yet, true democratization of LLMs requires simultaneous progress across all three dimensions. To this end, we propose SubTrack++ that leverages Grassmannian gradient subspace tracking combined with projection-aware optimizers, enabling Adam's internal statistics to adapt to subspace changes. Additionally, employing recovery scaling, a technique that restores information lost through low-rank projections, further enhances model performance. Our method demonstrates SOTA convergence by exploiting Grassmannian geometry, reducing training wall-time by up to 65% compared to the best performing baseline, LDAdam, while preserving the reduced memory footprint.

News

Making powerful AI more accessible to everyone
Dec 2025
Media

Making powerful AI more accessible to everyone

Featured in UWaterloo News for our work on SubTrack++, an advanced training technique that accelerates large language model pre-training by up to 65% while maintaining state-of-the-art accuracy — helping democratize AI by reducing computational costs.

Experience

Education

MASc, Management Engineering and Sciences (Thesis)

University of Waterloo, 2025 – Present

Supervised by Prof. Sirisha Rambhatla

BASc, Management Engineering (Computing Option)

University of Waterloo, 2019 – 2024

Leadership

Projects

ElectriFly

ElectriFly — Electric Plane Data Analysis & Decision Support

May 2023 – Apr 2024 · Engineering Capstone Project

Built a platform for analyzing flight data from the Pipistrel Velis Electro, the world's first type-certified electric plane. Leverages ML to optimize flight schedules based on weather forecasts and predict battery consumption for Canadian conditions.

With Meenakshi Andoorveedu, Peter Twarecki, Joanna Yang, Vikram Bhatt

Management Engineering Design Award Gregory Zhang - e-Zinc Award