Multimodal_Llm

MULTIMODAL_LLM

XAttMultiModalLM

        classDiagram
    class XAttMultiModalLM {
        +forward() Tensor
    }
    class Module
    <<abstract>> Module
    Module <|-- XAttMultiModalLM : herits
    

XAttMultiModalLM

A multimodal LLM with cross attention.

Fuyu

        classDiagram
    class Fuyu {
        +forward() Tensor
    }
    class Module
    <<abstract>> Module
    Module <|-- Fuyu : herits
    

Fuyu	A multimodal LLM : vision/weather and txt inspired by Fuyu.