A3Mark Evaluation Results - Version 1

We compute quality measures with respect to the four ground truth seismic cubes depending on their discrete or continuous amplitude values. The metrics are summarized below, for more precise mathematical details, please refer to our paper [1].

Discrete group:

• precision: Percentage of true positives of extracted edges/faults in attributes to all extracted edges/faults.
• recall: Percentage of true positives of extracted edges/faults in attributes to all ground truth edges/faults.
• rmsDistance: Root mean square weighted by the nonlinear distance (sigmf([1:1:30],[0.5 10])) between edges/faults in attributes and their closest edges/faults in ground truth. Extracted edges/faults using the seismic attributes are treated differently depending on their distance to the closest object in the ground truth.

Continuous group:

• recall: Percentage of true positives of extracted attributes to ground truth.
• rms: Root mean square between attributes and ground truth.
• rmsDiscontinuity: Root mean square between attributes and ground truth without including the edges/faults area. This originates from the fact that most structural attributes (except edge attributes) are undefined at (or very near) edges or discontinuities. This is because derivatives are undefined at discontinuities.

The threshold for a true positive is different for each ground truth category. For each continuous group, the threshold D is 20% of the difference between the maximum and minimum of its ground truth. If the submitted seismic attribute for edge/fault is continuous, not discrete, they will be discretized according to the top 20% rule.

We have computed their varieties, both in 3D and 2D, as well as in different dip regions [0°, 90°] and [0°, 45°]. In the 3D version, the quality measures are computed over the entire seismic cube, whereas in 2D they are first computed on every inline, crossline, and time section of the cube, followed by a mean operation. A caveat of the above metrics is that they do not discriminate between attributes at different dip angle ranges. However, in practice, it is very hard to image structural dips beyond 45 degrees for most types of seismic data. Therefore, more quality metrics (named *_LowDip), which account only for the dip in the 0-45 degrees range, are developed.

Submit and evaluate your own attributes.

• Recall3D
• Rms3D
• RmsDiscontinuity3D
• Rms2D
• RmsDiscontinuity2D
• Recall3D_LowDip
• Rms3D_LowDip
• RmsDiscontinuity3D_LowDip
• Rms2D_LowDip
• RmsDiscontinuity2D_LowDip