Language models
Design and train small language-model systems from scratch.
AI RESEARCH / VRA SERIES · ACTIVE RESEARCH
Intelligence from first principles.
DVRA — DHAUL Vector Representation Architecture — researches and trains language models from first principles, beginning with the VRA series.
← Back to all projects
DVRA / DHAULAI RESEARCH / VRA SERIES
What we're working on.
We start with small original models, run controlled experiments, study results, and improve through learning.
Tokenization and data
Study how text data is prepared, tokenized and presented to models.
Training and evaluation
Examine checkpoints, training results and model behavior.
CURRENT STATUS — ACTIVE RESEARCHDVRA is an ongoing research effort. It is not a public AI service or downloadable consumer model.