Contents Menu Expand Light mode Dark mode Auto light/dark, in light mode Auto light/dark, in dark mode Skip to content
Cross-Facility Federated Learning v0.2.1 documentation
Cross-Facility Federated Learning v0.2.1 documentation
  • Usage
  • API Reference
    • xffl
      • xffl.cli
        • xffl.cli.cli
        • xffl.cli.config
        • xffl.cli.exec
        • xffl.cli.parser
        • xffl.cli.run
        • xffl.cli.utils
      • xffl.custom
        • xffl.custom.datasets
          • xffl.custom.datasets.clean_mc4_it
          • xffl.custom.datasets.dataset_info
        • xffl.custom.formatter
        • xffl.custom.models
          • xffl.custom.models.llama
          • xffl.custom.models.mixtral
          • xffl.custom.models.model_info
        • xffl.custom.parser
        • xffl.custom.types
      • xffl.distributed
        • xffl.distributed.aggregation
        • xffl.distributed.distributed
        • xffl.distributed.distributed_state
        • xffl.distributed.networking
        • xffl.distributed.utils
      • xffl.learning
        • xffl.learning.data
        • xffl.learning.modelling
        • xffl.learning.processing
        • xffl.learning.utils
      • xffl.utils
        • xffl.utils.constants
        • xffl.utils.logging
        • xffl.utils.utils
      • xffl.workflow
        • xffl.workflow.config
        • xffl.workflow.streamflow
        • xffl.workflow.templates
          • xffl.workflow.templates.aggregation_application
          • xffl.workflow.templates.cwl
          • xffl.workflow.templates.streamflow
        • xffl.workflow.utils
Back to top
View this page

xffl.custom.models.mixtral¶

Mixtral modelling

Classes¶

Mixtral

Mixtral essential information

Module Contents¶

class xffl.custom.models.mixtral.Mixtral¶

Bases: xffl.custom.models.model_info.ModelInfo

Mixtral essential information

model_type: Type¶
decoder_layer: Type¶
wrapping_policy: Callable¶
path: xffl.custom.types.FolderLike = '/path/to/mixtral/model'¶
Next
xffl.custom.models.model_info
Previous
xffl.custom.models.llama
Copyright © 2024, Gianluca Mittone, Alberto Mulone, Giulio Malenza, Iacopo Colonnelli, Robert Birke, Marco Aldinucci
Made with Sphinx and @pradyunsg's Furo
On this page
  • xffl.custom.models.mixtral
    • Classes
    • Module Contents
      • Mixtral
        • Mixtral.model_type
        • Mixtral.decoder_layer
        • Mixtral.wrapping_policy
        • Mixtral.path