Keys Components
Last updated
Last updated
The InfiniRoute system contains three main component groups
The Inference Engine is the heart of the InfiniRoute system, responsible for dynamically routing AI inference requests to the most suitable models. This component is designed to optimise performance based on cost and accuracy parameters, ensuring each prompt is processed by the best available model.
The Actively Verification Service (AVS) using is a critical component for secure and transparent metadata management within the InfiniRoute architecture. It ensures that all metadata generated during inference is securely stored onchain, providing verifiable and immutable records.
The Models Marketplace has externally hosted models, specialised AI models hosted on various platforms and utilised by the Inference Engine for processing prompts. These models are fine-tuned with proprietary data. Model producers connect their models into the marketplace through APIs and that makes it accessible to the router.