Boxes, lines, circles
Results CSV
Identifiers and Case Structure
| Term | Definition |
|---|---|
| Case ID | Unique identifier for cases in our system. |
| Origin | Original file identifier or filepath. |
| Origin Created At | Date and time file was uploaded to our Centaur system. |
| Content ID | Unique identifier for the content (e.g. image, text, audio, etc.) in the case. |
| URL | Click this URL to view the case on the Centaur Portal. |
| Labeling State | Click the information icon next to “Status” to see the definitions of labeling states. |
| Series (if applicable) | Unique identifier for the video or content sequence (e.g. image frames) that the case is associated with. A series can contain multiple cases, and a case can cover part or all of a series. |
| Series Index (if applicable) | Unique identifier for the content as part of its series (e.g. image frames). |
| Patch (if applicable) | Area of interest on an image to be annotated for the case, in WKT format with coordinates rescaled to a 0-100 scale. |
| Study UID (if applicable) | Unique ID of the DICOM study that the annotated image was from. |
| Series UID (if applicable) | Unique ID of the series within the DICOM study that the annotated image was from. |
| Instance UID (if applicable) | Unique ID of the image within the DICOM series that was annotated. |
Reads and Annotations
Term | Definition |
|---|---|
Qualified Reads | Number of reads (“opinions”) on the case. Qualified Reads are those which meet a predefined accuracy criterion. |
Correct Label | If Gold Standard case, the label in WKT format, as assigned by you and/or an admin. If Labeled case, the Majority Label in WKT format when the case has met a predefined consensus criterion. Based on the origin (0,0) in the top-left corner of the x/y plane. |
Majority Label | Annotation in WKT format derived from Qualified Reads. Based on the origin (0,0) in the top-left corner of the x/y plane. |
Top Reads | Qualified Reads used to create the Majority Label. |
Number of ROIs / Number of Correct Lines | Number of regions of interest or correct lines on the case in the Correct Label. All coordinates provided in WKT format in the CSV are relative coordinates; coordinates are relative to the max width and height, which are each defined as 100. |
Measures of Confidence
| Term | Definition |
|---|---|
| Difficulty | 1 - the average F1 score for the Top Reads based on their similarity to the Correct Label. |
| Agreement | Average F1 score for the Top Reads based on their similarity to the Majority Label. |
Other Information
| Term | Definition |
|---|---|
| Internal Notes | Any notes internal to your team or tracked by Centaur relevant to the case. |
| Comments | Comments on the case by our labelers. |
| Flags | Flags on the case by our labelers. |
| Explanation | Notes written by you and/or an admin to help train and educate labelers. The explanation is shown to labelers after they have submitted a read. |
| Pre-answer explainers | Additional text information provided to labelers about a case prior to viewing. |
| Static Highlight | Range and entity highlighted for any static highlights present on the case (e.g., [{'range':[6,15], 'text': "this cell"}]). |
COCO JSON
Info
| Term | Definition |
|---|---|
| Description | Description of the project (includes the task name). |
| Contributor | Organization the results file was prepared by (Centaur Diagnostics, Inc.). |
| Date_Created | Date the results file was produced. |
Images
| Term | Definition |
|---|---|
| ID | A unique identifier for the image. The id field maps to the image_id field in the annotations array (where bounding box information is stored). It also maps to the Content ID in the results csv. |
| Case_ID | Unique identifier of the case the image is part of. This field maps to the Case ID in the results csv. |
| Width | The width of the image. |
| Height | The height of the image. |
| File_Name | The image filename, which maps to the Origin in the results csv. |
Annotations
| Term | Definition |
|---|---|
| ID | The identifier for the annotation. |
| Image_ID | Corresponds to the id in the images array. |
| Case_ID | Corresponds to the case_id in the images array. |
| Category_ID | The identifier for the label that identifies the object within a segmentation. It maps to the id field of the categories array. |
| Segmentation | Correct Label annotations for objects on an image in absolute coordinates (pixels). |
| WKT | Correct Label annotations for objects on an image in WKT format (relative coordinates). |
| Area | The area of the annotation relative to the total area of the image. |
| Box | Contains the absolute coordinates of a bounding box around an object on the image. |
Categories
| Term | Definition |
|---|---|
| ID | The identifier for the category. |
| Name | Name of the category, which will either be a finding or no finding. |
Reads CSV
| Term | Definition |
|---|---|
| Case ID | Unique identifier for cases in our system. |
| User ID | Unique identifier for users in our system. |
| Read ID | Unique identifier for reads in our system |
| Qscore | The trailing average accuracy for the user when they submitted an answer to the associated case ID. Read more about trailing average accuracy (Qscore) here. |
| Frame ID | Identifier for the frame number in the case. |
| Label Class | The class assigned to the label. |
| User Label | Read provided by the user. |
_Note: Only the top reads used to create the majority label are included.
Updated 2 months ago