IBBIS Screening Evaluation Portal

IBBIS is partnering with the US National Institute of Standards and Technology to share a standard evaluation test set which can be used to assess baseline sequence screening performance. Synthesis providers can use this portal to evaluate their screening protocol performance, while screening tool developers can evaluate their screening tools.

Read more about the development of this test set in the preprint Inter-tool analysis of a NIST dataset for assessing baseline nucleic acid sequence screening All screening tools evaluated as part of that study achieved high levels of sensitivity and specificity.

Sign Up to Start Evaluating

Download the Study Guide

Test your screening system on a small, labelled dataset of sequences before running an evaluation on a full dataset.

FASTA icon Study Guide FASTA Download Sample Submission

How the evaluation works

  • Process: Screen using your standard procedure after receiving the dataset. You’ll apply your normal workflow to the sequences you download. Results should be uploaded in the reporting format we have indicated.
  • Scoring & thresholds: Results are summarized as PASS/FAIL against two metrics calculated on the graded subset:
    • Accuracy = (TP + TN) / T, threshold ≥ 75%
    • Sensitivity = TP / (TP + FN), threshold ≥ 95%
  • Please upload your results within 10 business days to ensure the dataset is not expired