public classCustomValidationConfigextendsValidationConfig
Provides custom validation data for benchmarking.
Nested Class Summary
| interface | CustomValidationConfig.AccuracyValidator | Defines custom accuracy validation rule. | |
| class | CustomValidationConfig.Builder | Builder class. | |
Inherited Constant Summary
Field Summary
| public static final CustomValidationConfig.AccuracyValidator | BYTE_MATCHING_VALIDATOR | Validates model outputs byte-by-byte. |
| public static final AccelerationConfig | DEFAULT_GOLDEN_CONFIG | Default config used to calculate golden output when golden is not provided. |
| public static final CustomValidationConfig.AccuracyValidator | SKIP_VALIDATION | No-op validator to skip accuracy validation. |
Public Method Summary
| CustomValidationConfig.AccuracyValidator |
accuracyValidator()
Gets accuracy validator value.
|
| int |
batchSize()
Gets batch size value.
|
| AccelerationConfig |
goldenConfig()
Gets golden config value.
|
| Object[] |
goldenInputs()
Gets golden inputs value.
|
| ByteBuffer[] |
goldenOutputs()
Gets golden outputs value.
|
Inherited Method Summary
Fields
public static final CustomValidationConfig.AccuracyValidator BYTE_MATCHING_VALIDATOR
Validates model outputs byte-by-byte. Output tensors are compared using
ByteBuffer.equals(Object)
function. This validator will returnfalseif either golden output or
benchmark output isnull,or their dimensions do not match.
public static finalAccelerationConfig DEFAULT_GOLDEN_CONFIG
Default config used to calculate golden output when golden is not provided.
public static final CustomValidationConfig.AccuracyValidatorSKIP_VALIDATION
No-op validator to skip accuracy validation.
Public Methods
public CustomValidationConfig.AccuracyValidatoraccuracyValidator()
Gets accuracy validator value.
public intbatchSize()
Gets batch size value.
publicAccelerationConfig goldenConfig()
Gets golden config value.
publicObject[]goldenInputs()
Gets golden inputs value.
publicByteBuffer[] goldenOutputs()
Gets golden outputs value.