Welcome to RxInferServer
The implementation is work in progress and the API is not yet stable and may undergo significant changes. Use at your own risk.
RxInferServer is a Julia package that provides an implementation of a REST API server for RxInfer.jl, enabling remote access to inference capabilities through HTTP endpoints. The server is built on top of HTTP.jl and follows OpenAPI specifications. Read more about the OpenAPI specification here.
While the server is technically implemented as a Julia package, it relies on locally auto-generated code from the OpenAPI specification. This makes it more challenging (though not impossible) to use it as a direct dependency in another Julia project. For the same reason, the server is not registered as a Julia package and cannot be installed using Pkg.jl. Please refer to the Pkg.jl documentation for more information on working with such packages.
Getting started
- See the Getting started section to learn how to use the server.
- See the Configuration section to learn how to configure the server.
- See the How to Add a Model manual to learn how to create and add your own models.
- See the Developers guide section for more details on the development process and implementation details.
- See the OpenAPI documentation section for more details on the OpenAPI specification and the generated server and client code.
Available SDKs
RxInferServer provides official SDKs for different programming languages:
- Julia SDK: Included in this repository under the
openapi/client
folder. This SDK is automatically generated from the OpenAPI specification and is the most up-to-date implementation. - Python SDK: Available as a separate package at RxInferClient.py. This client provides a Python interface to interact with RxInferServer.
License
This project is licensed under the GNU Affero General Public License v3.0 - see the LICENSE in the repository for details. For companies and organizations that require different licensing terms, alternative licensing options are available from Lazy Dynamics. Please contact Lazy Dynamics for more information about licensing options that may better suit your specific needs and use cases.
Index
RxInferServer.Models
RxInferServer.Serialization.DistributionsData
RxInferServer.Serialization.DistributionsRepr
RxInferServer.Serialization.MultiDimensionalArrayData
RxInferServer.Serialization.MultiDimensionalArrayRepr
RxInferServer.DEFAULT_DEV_TOKEN
RxInferServer.DEFAULT_DEV_TOKEN_ROLES
RxInferServer.Serialization.DistributionsData.MeanCov
RxInferServer.Serialization.DistributionsData.NamedParams
RxInferServer.Serialization.DistributionsData.None
RxInferServer.Serialization.DistributionsData.Params
RxInferServer.Serialization.DistributionsData.Unknown
RxInferServer.Serialization.DistributionsRepr.Data
RxInferServer.Serialization.DistributionsRepr.Dict
RxInferServer.Serialization.DistributionsRepr.DictTag
RxInferServer.Serialization.DistributionsRepr.DictTypeAndTag
RxInferServer.Serialization.DistributionsRepr.Unknown
RxInferServer.Serialization.MultiDimensionalArrayData.ArrayOfArrays
RxInferServer.Serialization.MultiDimensionalArrayData.Diagonal
RxInferServer.Serialization.MultiDimensionalArrayData.None
RxInferServer.Serialization.MultiDimensionalArrayData.ReshapeColumnMajor
RxInferServer.Serialization.MultiDimensionalArrayData.ReshapeRowMajor
RxInferServer.Serialization.MultiDimensionalArrayData.Unknown
RxInferServer.Serialization.MultiDimensionalArrayRepr.Data
RxInferServer.Serialization.MultiDimensionalArrayRepr.Dict
RxInferServer.Serialization.MultiDimensionalArrayRepr.DictShape
RxInferServer.Serialization.MultiDimensionalArrayRepr.DictTypeAndShape
RxInferServer.Serialization.MultiDimensionalArrayRepr.Unknown
RxInferServer.Database.DatabaseFailedConnectionError
RxInferServer.Database.RedactedURL
RxInferServer.Models.LoadedModel
RxInferServer.Models.ModelConfigurationValidationError
RxInferServer.Models.ModelsDispatcher
RxInferServer.RequestPreferences
RxInferServer.RoutesHandler
RxInferServer.Serialization.JSONSerialization
RxInferServer.Serialization.UnsupportedPreferenceError
RxInferServer.ServerState
RxInferServer.Database.RXINFER_SERVER_MONGODB_DATABASE
RxInferServer.Database.RXINFER_SERVER_MONGODB_URL
RxInferServer.Database.RXINFER_SERVER_SSL_CA_FILE
RxInferServer.Database.client
RxInferServer.Database.collection
RxInferServer.Database.database
RxInferServer.Database.find_ssl_certificates
RxInferServer.Database.inject_tls_ca_file
RxInferServer.Database.with_connection
RxInferServer.Logging.RXINFER_SERVER_ENABLE_DEBUG_LOGGING
RxInferServer.Logging.RXINFER_SERVER_LOGS_LOCATION
RxInferServer.Logging.filter_by_group
RxInferServer.Logging.filter_by_level
RxInferServer.Logging.filter_by_module
RxInferServer.Logging.with_logger
RxInferServer.Logging.with_simple_logger
RxInferServer.Models.RXINFER_SERVER_LOAD_TEST_MODELS
RxInferServer.Models.RXINFER_SERVER_MODELS_LOCATIONS
RxInferServer.Models.deserialize_parameters
RxInferServer.Models.deserialize_state
RxInferServer.Models.get_model
RxInferServer.Models.get_models
RxInferServer.Models.get_models_dispatcher
RxInferServer.Models.load_models!
RxInferServer.Models.parse_model_config_default_arguments
RxInferServer.Models.reload!
RxInferServer.Models.serialize_parameters
RxInferServer.Models.serialize_state
RxInferServer.Models.validate_model_config_arguments
RxInferServer.Models.validate_model_config_header
RxInferServer.Models.with_models
RxInferServer.RXINFER_SERVER_CORS_ACCESS_CONTROL_ALLOW_HEADERS
RxInferServer.RXINFER_SERVER_CORS_ACCESS_CONTROL_ALLOW_METHODS
RxInferServer.RXINFER_SERVER_CORS_ACCESS_CONTROL_ALLOW_ORIGIN
RxInferServer.RXINFER_SERVER_EDITION
RxInferServer.RXINFER_SERVER_ENABLE_DEV_TOKEN
RxInferServer.RXINFER_SERVER_ENABLE_HOT_RELOAD
RxInferServer.RXINFER_SERVER_ENV
RxInferServer.RXINFER_SERVER_ENV_OVERRIDE
RxInferServer.RXINFER_SERVER_ENV_PWD
RxInferServer.RXINFER_SERVER_LISTEN_KEYBOARD
RxInferServer.RXINFER_SERVER_PORT
RxInferServer.RXINFER_SERVER_SHOW_BANNER
RxInferServer.Serialization.from_json
RxInferServer.Serialization.to_json
RxInferServer.check_dev_token
RxInferServer.current_roles
RxInferServer.current_token
RxInferServer.is_authorized
RxInferServer.is_hot_reload_enabled
RxInferServer.is_server_errored
RxInferServer.is_server_running
RxInferServer.notify_instantiated
RxInferServer.pid_server_event
RxInferServer.serve
RxInferServer.set_server_errored
RxInferServer.set_server_running
RxInferServer.wait_instantiated
RxInferServer.@expect