Progressive fine-tuning turns Evo into a supervised functional genomics tool

The Evo genome foundation model was built for generative work across molecular and genomic scales, but its native training does not make it an automatic fit for supervised prediction tasks. In functional genomics, that gap matters because sequence models must do more than produce plausible DNA; they have to identify promoters, classify regulatory elements, and separate functional signal from the background noise of the genome. The new Evo-TSFT strategy was designed to close that divide by adapting Evo through a two-stage fine-tuning process rather than relying on the pre-trained model alone. Across 7 DNA functional genomics classification tasks and 24 datasets, the approach delivered strong overall performance and established a practical path for using large genomic foundation models in downstream prediction work.

The central challenge is straightforward. A model trained to understand broad sequence structure can still miss task-specific cues when asked to make a binary or multiclass decision about function. DNA regulation often depends on subtle motifs, local context, and longer-range dependencies that are easy to preserve in a generative architecture but harder to exploit in a classifier without supervision. Evo-TSFT responds to that problem by combining LoRA-based fine-tuning with selective layer unfreezing, allowing the model to retain the general sequence knowledge acquired during pre-training while gradually becoming sensitive to the supervised signal in each task.

Two-stage adaptation balances preservation and specialization

The first stage of Evo-TSFT uses LoRA, a low-rank adaptation method that updates a limited number of parameters instead of retraining the full model. In a genomic foundation model, that constraint is more than an engineering convenience. It helps preserve the broad representational structure learned from multi-species DNA while steering the model toward a new objective, which is exactly what supervised functional genomics demands. The second stage selectively unfreezes layers, enabling deeper adjustment once the model has already absorbed the task-specific direction from the earlier step.

This progressive design reflects a common problem in biological modeling: too much adaptation too soon can erase generalizable features, while too little adaptation leaves the model unable to recognize the patterns that distinguish active regulatory DNA from inert sequence. By sequencing the updates instead of applying a single monolithic training pass, Evo-TSFT aims to keep both forms of knowledge in play. The strategy is especially relevant for promoter detection and related tasks, where performance often hinges on recognizing compact sequence motifs in the right contextual setting rather than merely detecting recurring character patterns.

The results across 7 tasks suggest that this balance was achieved with enough consistency to make the method competitive. Across 24 datasets, Evo-TSFT showed strong overall performance, indicating that the model could be steered from a generative DNA foundation toward supervised classification without discarding the value of its original pre-training.

Functional genomics models often fail at the point where general sequence intelligence must become task-specific judgment.

Why foundation models need task-aware training in genomics

Large language models have changed how researchers think about sequence data because they can encode long-range relationships that conventional architectures often miss. In genomics, that capability is attractive for exactly the same reason: DNA function rarely depends on a single local signal alone. Enhancer activity, promoter architecture, and other regulatory features emerge from combinations of motifs, spacing, and genomic context. A model such as Evo already carries some of that structural awareness, but adaptation is still required to make predictions aligned with a labeled functional endpoint.

Evo-TSFT is meaningful because it treats adaptation as a biological problem, not just a computational one. Functional genomics is not asking whether a sequence looks plausible; it is asking whether that sequence behaves like a promoter, regulatory element, or other functional class. That difference shifts the burden onto the fine-tuning strategy. A model trained on vast DNA corpora may understand sequence grammar in a broad sense, yet supervised tasks require discrimination at a finer scale, often with limited task-specific data compared with the scale of the original pre-training corpus.

Selective layer unfreezing addresses that tension by letting higher-order representations change only after the low-rank adaptation has already oriented the model toward the endpoint. In practical terms, this can be viewed as a staged recalibration of the network’s internal representation: first, the model learns what kind of decision it is expected to make; then it adjusts deeper features to support that decision. For DNA classification, where the relevant signal may be sparse and biologically subtle, that sequence of updates can be more efficient than wholesale retraining.

Implications for promoter detection and downstream genomic prediction

Among the functional genomics tasks named in the study, core promoter detection illustrates why supervised adaptation is necessary. Promoters are defined less by a single universal motif than by a constellation of sequence features and positional cues, many of which vary across context. A generative model trained on broad DNA patterns may encode enough of that structure to be useful, but it needs supervised tuning to translate latent sequence knowledge into a confident prediction.

The performance of Evo-TSFT across multiple datasets suggests that the method may support a wider range of DNA classification problems beyond promoter prediction alone. In translational terms, robust functional genomics models can help prioritize variants, annotate regulatory regions, and refine the interpretation of sequence changes that may alter gene expression. Those uses remain downstream of the model itself, but they are exactly where foundation models become clinically and biologically relevant: not by replacing domain expertise, but by scaling the initial filter that identifies candidate functional elements.

The study also reinforces a broader principle in computational genomics. Foundation models become truly useful when their training objective matches the biological question being asked. Generative competence is a strong starting point, yet supervised functional tasks require an additional layer of alignment. Evo-TSFT provides one workable route for that alignment by preserving the pre-trained model’s breadth while injecting task-specific focus in a controlled, progressive way.

A practical path for extending genomic foundation models

Evo-TSFT does not claim to solve every limitation of genomic modeling, and the data presented here stay within classification tasks rather than moving into every possible downstream use. Even so, the results across 24 datasets argue that progressive fine-tuning can make a large foundation model more adaptable without starting from scratch. For researchers building DNA prediction systems, that matters because training a new model from the ground up is expensive, data-hungry, and often unnecessary when a capable foundation model already exists.

The next questions are technical rather than rhetorical: how well will this strategy hold across other regulatory endpoints, how sensitive is it to dataset composition, and whether the same progressive logic generalizes to more complex genomic prediction settings. For now, Evo-TSFT establishes that a two-stage adaptation pipeline can convert Evo from a broad generative model into a competitive classifier for functional genomics tasks, including promoter-related prediction. The study’s value lies in that transition, which is concrete, reproducible, and directly tied to how genomic foundation models will be used in the next wave of sequence analysis.


Reporting by Dr. Clara Evans, DDS, MS, FACS for Medicine World Foundation, with additional data provided by New England Journal of Medicine.