tempo.serve.metadata moduleΒΆ
-
class
tempo.serve.metadata.
ClientDetails
(*, url: str, headers: Dict[str, str], verify_ssl: bool)ΒΆ Bases:
pydantic.main.BaseModel
-
headers
: Dict[str, str]ΒΆ
-
url
: strΒΆ
-
verify_ssl
: boolΒΆ
-
-
class
tempo.serve.metadata.
DockerOptions
(*, runtime: str = 'tempo.seldon.SeldonDockerRuntime', state_options: tempo.serve.metadata.StateOptions = StateOptions(state_type=<StateTypes.LOCAL: 'LOCAL'>, key_prefix='', host='', port=''), insights_options: tempo.serve.metadata.InsightsOptions = InsightsOptions(worker_endpoint='', batch_size=1, parallelism=1, retries=3, window_time=0, mode_type=<InsightRequestModes.NONE: 'NONE'>, in_asyncio=False), ingress_options: tempo.serve.metadata.IngressOptions = IngressOptions(ingress='tempo.ingress.istio.IstioIngress', ssl=False, verify_ssl=True))ΒΆ Bases:
tempo.serve.metadata._BaseRuntimeOptions
-
runtime
: strΒΆ
-
-
class
tempo.serve.metadata.
EnterpriseRuntimeAuthType
(value)ΒΆ Bases:
enum.Enum
An enumeration.
-
oidc
= 'oidc'ΒΆ
-
-
class
tempo.serve.metadata.
EnterpriseRuntimeOptions
(*, runtime: str = 'tempo.seldon.SeldonDeployRunime', state_options: tempo.serve.metadata.StateOptions = StateOptions(state_type=<StateTypes.LOCAL: 'LOCAL'>, key_prefix='', host='', port=''), insights_options: tempo.serve.metadata.InsightsOptions = InsightsOptions(worker_endpoint='', batch_size=1, parallelism=1, retries=3, window_time=0, mode_type=<InsightRequestModes.NONE: 'NONE'>, in_asyncio=False), ingress_options: tempo.serve.metadata.IngressOptions = IngressOptions(ingress='tempo.ingress.istio.IstioIngress', ssl=False, verify_ssl=True), host: str, user: str, password: str, auth_type: tempo.serve.metadata.EnterpriseRuntimeAuthType = <EnterpriseRuntimeAuthType.session_cookie: 'session_cookie'>, oidc_client_id: str, oidc_server: str, verify_ssl: bool = True)ΒΆ Bases:
tempo.serve.metadata._BaseRuntimeOptions
-
host
: strΒΆ
-
oidc_client_id
: strΒΆ
-
oidc_server
: strΒΆ
-
password
: strΒΆ
-
runtime
: strΒΆ
-
user
: strΒΆ
-
verify_ssl
: boolΒΆ
-
-
class
tempo.serve.metadata.
IngressOptions
(*, ingress: str = 'tempo.ingress.istio.IstioIngress', ssl: bool = False, verify_ssl: bool = True)ΒΆ Bases:
pydantic.main.BaseModel
-
ingress
: strΒΆ
-
ssl
: boolΒΆ
-
verify_ssl
: boolΒΆ
-
-
class
tempo.serve.metadata.
InsightRequestModes
(value)ΒΆ Bases:
enum.Enum
An enumeration.
-
ALL
= 'ALL'ΒΆ
-
NONE
= 'NONE'ΒΆ
-
REQUEST
= 'REQUEST'ΒΆ
-
RESPONSE
= 'RESPONSE'ΒΆ
-
-
class
tempo.serve.metadata.
InsightsOptions
(*, worker_endpoint: str = '', batch_size: int = 1, parallelism: int = 1, retries: int = 3, window_time: int = 0, mode_type: tempo.serve.metadata.InsightRequestModes = <InsightRequestModes.NONE: 'NONE'>, in_asyncio: bool = False)ΒΆ Bases:
pydantic.main.BaseModel
-
batch_size
: intΒΆ
-
in_asyncio
: boolΒΆ
-
mode_type
: tempo.serve.metadata.InsightRequestModesΒΆ
-
parallelism
: intΒΆ
-
retries
: intΒΆ
-
window_time
: intΒΆ
-
worker_endpoint
: strΒΆ
-
-
class
tempo.serve.metadata.
InsightsPayload
(*, request_id: str = '', data: Any = None, insights_type: tempo.serve.metadata.InsightsTypes = <InsightsTypes.CUSTOM_INSIGHT: 'io.seldon.serving.inference.custominsight'>)ΒΆ Bases:
pydantic.main.BaseModel
-
data
: AnyΒΆ
-
insights_type
: tempo.serve.metadata.InsightsTypesΒΆ
-
request_id
: strΒΆ
-
-
class
tempo.serve.metadata.
InsightsTypes
(value)ΒΆ Bases:
enum.Enum
An enumeration.
-
CUSTOM_INSIGHT
: str = 'io.seldon.serving.inference.custominsight'ΒΆ
-
INFER_REQUEST
: str = 'io.seldon.serving.inference.request'ΒΆ
-
INFER_RESPONSE
: str = 'io.seldon.serving.inference.response'ΒΆ
-
-
class
tempo.serve.metadata.
KFServingOptions
(*, local_options: tempo.serve.metadata.DockerOptions = DockerOptions(runtime='tempo.seldon.SeldonDockerRuntime', state_options=StateOptions(state_type=<StateTypes.LOCAL: 'LOCAL'>, key_prefix='', host='', port=''), insights_options=InsightsOptions(worker_endpoint='', batch_size=1, parallelism=1, retries=3, window_time=0, mode_type=<InsightRequestModes.NONE: 'NONE'>, in_asyncio=False), ingress_options=IngressOptions(ingress='tempo.ingress.istio.IstioIngress', ssl=False, verify_ssl=True)), remote_options: tempo.serve.metadata.KubernetesRuntimeOptions = KubernetesRuntimeOptions(runtime='tempo.kfserving.KFservingKubernetesRuntime', state_options=StateOptions(state_type=<StateTypes.LOCAL: 'LOCAL'>, key_prefix='', host='', port=''), insights_options=InsightsOptions(worker_endpoint='', batch_size=1, parallelism=1, retries=3, window_time=0, mode_type=<InsightRequestModes.NONE: 'NONE'>, in_asyncio=False), ingress_options=IngressOptions(ingress='tempo.ingress.istio.IstioIngress', ssl=False, verify_ssl=True), replicas=1, minReplicas=None, maxReplicas=None, authSecretName=None, serviceAccountName=None, add_svc_orchestrator=False, namespace='default'))ΒΆ Bases:
tempo.serve.metadata._BaseProductOptions
-
remote_options
: tempo.serve.metadata.KubernetesRuntimeOptionsΒΆ
-
-
class
tempo.serve.metadata.
KubernetesRuntimeOptions
(*, runtime: str = 'tempo.seldon.SeldonKubernetesRuntime', state_options: tempo.serve.metadata.StateOptions = StateOptions(state_type=<StateTypes.LOCAL: 'LOCAL'>, key_prefix='', host='', port=''), insights_options: tempo.serve.metadata.InsightsOptions = InsightsOptions(worker_endpoint='', batch_size=1, parallelism=1, retries=3, window_time=0, mode_type=<InsightRequestModes.NONE: 'NONE'>, in_asyncio=False), ingress_options: tempo.serve.metadata.IngressOptions = IngressOptions(ingress='tempo.ingress.istio.IstioIngress', ssl=False, verify_ssl=True), replicas: int = 1, minReplicas: int = None, maxReplicas: int = None, authSecretName: str = None, serviceAccountName: str = None, add_svc_orchestrator: bool = False, namespace: str = 'default')ΒΆ Bases:
tempo.serve.metadata._BaseRuntimeOptions
-
add_svc_orchestrator
: boolΒΆ
-
authSecretName
: Optional[str]ΒΆ
-
maxReplicas
: Optional[int]ΒΆ
-
minReplicas
: Optional[int]ΒΆ
-
replicas
: intΒΆ
-
runtime
: strΒΆ
-
serviceAccountName
: Optional[str]ΒΆ
-
-
class
tempo.serve.metadata.
ModelDataArg
(*, ty: Type, name: str = None)ΒΆ Bases:
pydantic.main.BaseModel
-
class
Config
ΒΆ Bases:
object
-
json_encoders
= {<class 'type'>: <function ModelDataArg.Config.<lambda>>}ΒΆ
-
-
classmethod
ensure_type
(v)ΒΆ
-
name
: Optional[str]ΒΆ
-
ty
: TypeΒΆ
-
class
-
class
tempo.serve.metadata.
ModelDataArgs
(*, args: List[tempo.serve.metadata.ModelDataArg])ΒΆ Bases:
pydantic.main.BaseModel
-
class
Config
ΒΆ Bases:
object
-
json_encoders
= {<class 'type'>: <function ModelDataArgs.Config.<lambda>>}ΒΆ
-
-
args
: List[tempo.serve.metadata.ModelDataArg]ΒΆ
-
class
-
class
tempo.serve.metadata.
ModelDetails
(*, name: str, local_folder: str, uri: str, platform: tempo.serve.metadata.ModelFramework, inputs: tempo.serve.metadata.ModelDataArgs, outputs: tempo.serve.metadata.ModelDataArgs, description: str = '')ΒΆ Bases:
pydantic.main.BaseModel
-
description
: strΒΆ
-
local_folder
: strΒΆ
-
name
: strΒΆ
-
outputs
: tempo.serve.metadata.ModelDataArgsΒΆ
-
platform
: tempo.serve.metadata.ModelFrameworkΒΆ
-
uri
: strΒΆ
-
-
class
tempo.serve.metadata.
ModelFramework
(value)ΒΆ Bases:
enum.Enum
An enumeration.
-
Alibi
= 'alibi'ΒΆ
-
Custom
= 'custom'ΒΆ
-
MLFlow
= 'mlflow'ΒΆ
-
ONNX
= 'ONNX'ΒΆ
-
PyTorch
= 'pytorch'ΒΆ
-
SKLearn
= 'sklearn'ΒΆ
-
TempoPipeline
= 'tempo'ΒΆ
-
TensorRT
= 'tensorrt'ΒΆ
-
Tensorflow
= 'tensorflow'ΒΆ
-
XGBoost
= 'xgboost'ΒΆ
-
-
class
tempo.serve.metadata.
SeldonCoreOptions
(*, local_options: tempo.serve.metadata.DockerOptions = DockerOptions(runtime='tempo.seldon.SeldonDockerRuntime', state_options=StateOptions(state_type=<StateTypes.LOCAL: 'LOCAL'>, key_prefix='', host='', port=''), insights_options=InsightsOptions(worker_endpoint='', batch_size=1, parallelism=1, retries=3, window_time=0, mode_type=<InsightRequestModes.NONE: 'NONE'>, in_asyncio=False), ingress_options=IngressOptions(ingress='tempo.ingress.istio.IstioIngress', ssl=False, verify_ssl=True)), remote_options: tempo.serve.metadata.KubernetesRuntimeOptions = KubernetesRuntimeOptions(runtime='tempo.seldon.SeldonKubernetesRuntime', state_options=StateOptions(state_type=<StateTypes.LOCAL: 'LOCAL'>, key_prefix='', host='', port=''), insights_options=InsightsOptions(worker_endpoint='', batch_size=1, parallelism=1, retries=3, window_time=0, mode_type=<InsightRequestModes.NONE: 'NONE'>, in_asyncio=False), ingress_options=IngressOptions(ingress='tempo.ingress.istio.IstioIngress', ssl=False, verify_ssl=True), replicas=1, minReplicas=None, maxReplicas=None, authSecretName=None, serviceAccountName=None, add_svc_orchestrator=False, namespace='default'))ΒΆ Bases:
tempo.serve.metadata._BaseProductOptions
-
remote_options
: tempo.serve.metadata.KubernetesRuntimeOptionsΒΆ
-
-
class
tempo.serve.metadata.
SeldonEnterpriseOptions
(*, local_options: tempo.serve.metadata.DockerOptions = DockerOptions(runtime='tempo.seldon.SeldonDockerRuntime', state_options=StateOptions(state_type=<StateTypes.LOCAL: 'LOCAL'>, key_prefix='', host='', port=''), insights_options=InsightsOptions(worker_endpoint='', batch_size=1, parallelism=1, retries=3, window_time=0, mode_type=<InsightRequestModes.NONE: 'NONE'>, in_asyncio=False), ingress_options=IngressOptions(ingress='tempo.ingress.istio.IstioIngress', ssl=False, verify_ssl=True)), remote_options: tempo.serve.metadata.EnterpriseRuntimeOptions)ΒΆ Bases:
tempo.serve.metadata._BaseProductOptions
-
remote_options
: tempo.serve.metadata.EnterpriseRuntimeOptionsΒΆ
-
-
class
tempo.serve.metadata.
StateOptions
(*, state_type: tempo.serve.metadata.StateTypes = <StateTypes.LOCAL: 'LOCAL'>, key_prefix: str = '', host: str = '', port: str = '')ΒΆ Bases:
pydantic.main.BaseModel
-
host
: strΒΆ
-
key_prefix
: strΒΆ
-
port
: strΒΆ
-
state_type
: Optional[tempo.serve.metadata.StateTypes]ΒΆ
-
-
class
tempo.serve.metadata.
StateTypes
(value)ΒΆ Bases:
enum.Enum
An enumeration.
-
LOCAL
= 'LOCAL'ΒΆ
-
REDIS
= 'REDIS'ΒΆ
-
-
tempo.serve.metadata.
dict_to_runtime
(d: Dict) β Union[tempo.serve.metadata.KubernetesRuntimeOptions, tempo.serve.metadata.DockerOptions, tempo.serve.metadata.EnterpriseRuntimeOptions]ΒΆ