Screening
Evaluation Portal

Assess your sequence screening performance against standard test sets.

IBBIS is partnering with the US National Institute of Standards and Technology to share a standard evaluation test set which can be used to assess baseline sequence screening performance. Synthesis providers can use this portal to evaluate their screening protocol performance, while screening tool developers can evaluate their screening tools.

Read more about the development of this test set in the preprint “Inter-tool analysis of a NIST dataset for assessing baseline nucleic acid sequence screening”. All screening tools evaluated as part of that study achieved high levels of sensitivity and specificity.

Download the Study Guide

Test your screening system on a small, labelled dataset of sequences before running an evaluation on a full dataset.

Study Guide FASTA

≈50 labelled sequences · FASTA

Download

Sample Submission

Reporting format · CSV

Download

How the evaluation works

Process

Screen using your standard procedure after receiving the dataset. You’ll apply your normal workflow to the sequences you download. Results should be uploaded in the reporting format we have indicated.

Scoring & thresholds

Results are summarized as PASS/FAIL against two metrics calculated on the graded subset: Accuracy = (TP + TN) / T, threshold ≥ 75%; Sensitivity = TP / (TP + FN), threshold ≥ 95%.

Timing

Please upload your results within 10 business days to ensure the dataset is not expired.