spark.core.config_validation

spark.core.config_validation#

`ConfigurationValidator`	Base class for validators for the fields in a SparkConfig.
`TypeValidator`	Validates the type of the field against a set of valid_types defined in the metadata.
`PositiveValidator`	Validates that the value(s) of the attribute are greater than zero.
`BinaryValidator`	Validates that the value(s) of the attribute are in the set {0,1}.
`ZeroOneValidator`	Validates that the value(s) of the attribute are in the range [0,1].

class spark.core.config_validation.ConfigurationValidator(field)[source]#

Base class for validators for the fields in a SparkConfig.

abstractmethod validate(value)[source]#

class spark.core.config_validation.TypeValidator(field)[source]#

Validates the type of the field against a set of valid_types defined in the metadata.

validate(value)[source]#

class spark.core.config_validation.PositiveValidator(field)[source]#

Validates that the value(s) of the attribute are greater than zero.

validate(value)[source]#

class spark.core.config_validation.BinaryValidator(field)[source]#

Validates that the value(s) of the attribute are in the set {0,1}.

validate(value)[source]#

class spark.core.config_validation.ZeroOneValidator(field)[source]#

Validates that the value(s) of the attribute are in the range [0,1].

validate(value)[source]#