#

attention

Here are 1,050 public repositories matching this topic...

google / jetstream-pytorch

PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"

inference pytorch batching attention llama gemma model-serving tpu llm llm-inference llama2

Updated May 31, 2024
Python

kyegomez / awesome-multi-agent-papers

A compilation of the best multi-agent papers

transformers multi-agent attention multiagent swarms agents autonomous-agents llms swarms-of-agents

Updated May 31, 2024

miniHuiHui / awesome-high-order-neural-network

computer-vision attention hadamard-product bilinear-pooling self-attention vision-transformer polynomial-neural-network quadratic-neural-network second-order-neural-network high-order-neural-network

Updated May 30, 2024

erfanzar / FJFormer

Embark on a journey of paralleled/unparalleled computational prowess with FJFormer 🔥 - an arsenal of custom Jax Flax Functions and Utils that elevate your AI endeavors to new heights!

numpy attention llama flax attention-mechanism lax jax llm easydel

Updated May 30, 2024
Python

ywyue / AGILE3D

[ICLR 2024] AGILE3D: Attention Guided Interactive Multi-object 3D Segmentation

attention 3d-point-clouds 3d-annotation 3d-segmentation interactive-segmentation 3d-scene-understanding click-as-query 3d-labelling

Updated May 30, 2024
Python

google-research / scenic

Scenic: A Jax Library for Computer Vision Research and Beyond

research computer-vision deep-learning transformers attention jax vision-transformer

Updated May 30, 2024
Python

codingonion / awesome-yolo-object-detection

🚀🚀🚀 A collection of some awesome public YOLO object detection series projects.

Updated May 29, 2024

FlagAttention

FlagOpen / FlagAttention

A collection of memory efficient attention operators implemented in the Triton language.

attention triton-lang

Updated May 29, 2024
Python

ai4co / rl4co

A PyTorch library for all things Reinforcement Learning (RL) for Combinatorial Optimization (CO)

benchmark reinforcement-learning hydra attention tsp operations-research cvrp combinatorial-optimization attention-model neural-combinatorial-optimization electronic-design-automation pytorch-lightning torchrl tensordict

Updated May 31, 2024
Python

leondgarse / keras_cv_attention_models

Keras beit,caformer,CMT,CoAtNet,convnext,davit,dino,efficientdet,edgenext,efficientformer,efficientnet,eva,fasternet,fastervit,fastvit,flexivit,gcvit,ghostnet,gpvit,hornet,hiera,iformer,inceptionnext,lcnet,levit,maxvit,mobilevit,moganet,nat,nfnets,pvt,swin,tinynet,tinyvit,uniformer,volo,vanillanet,yolor,yolov7,yolov8,yolox,gpt2,llama2, alias kecam

recognition tensorflow model detection keras tf2 imagenet attention coco clip tf visualizing ddpm stable-diffusion segment-anything

Updated May 29, 2024
Python

NotShrirang / QuillGPT

QuillGPT is an implementation of the GPT decoder block based on the architecture from Attention is All You Need paper by Vaswani et. al. in PyTorch. Additionally, this repository contains two pre-trained models — Shakespearean GPT and Harpoon GPT, a Streamlit Playground, Containerized FastAPI Microservice, training - inference scripts & notebooks.

nlp docker decoder pytorch transformer attention gpt attention-mechanism fastapi streamlit generative-ai

Updated May 29, 2024
Jupyter Notebook

nachiket273 / crias

A Baby Llama model

python pytorch transformer attention activation normalization llm

Updated May 28, 2024
Jupyter Notebook

MAGICS-LAB / OutEffHop

[ICML 2024] Outlier-Efficient Hopfield Layers for Large Transformer-Based Models

transformer outliers attention attention-mechanism outlier-removal outlier hopfield-neural-network ptq outlier-treatment modern-hopfield-networks modern-hopfield-model icml-2024 softmax-1 quantized-friendly no-op-outlier

Updated May 27, 2024
Python

sushantkumar23 / nano-gpt

Simple character level Transformer

transformers pytorch attention attention-mechanism rope self-attention multi-head-attention shakespeare-dataset transformer-architecture llm rmsnorm

Updated May 27, 2024
Jupyter Notebook

DoranLyong / Awesome-TokenMixer-pytorch

Pytorch implementation of various token mixers; Attention Mechanisms, MLP, and etc for understanding computer vision papers and other tasks.

computer-vision paper pytorch attention convolution token mlp awesome-vision-transformer awesome-token-mixer

Updated May 27, 2024
Python

nanodl

HMUNACHI / nanodl

A Jax-based library for designing and training transformer models from scratch.

nlp machine-learning deep-learning transformer attention llama flax gpt attention-mechanism mistral distributed-training jax

Updated May 26, 2024
Python

knotgrass / Griffin

Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models

h3 linear attention language-model griffin mamba gelu conv1d rmsnorm rg-lru shift-ssm

Updated May 26, 2024
Python

alessioborgi / AdaViT

Project Name: AdaViT | PyTorch Lightning, Python

attention adaptive attention-is-all-you-need halting self-at attentio vision-transformer mlp-mixer transforme

Updated May 25, 2024
Python

ViTAE-Transformer / LeMeViT

The official repo for [IJCAI'24] "LeMeViT: Efficient Vision Transformer with Learnable Meta Tokens for Remote Sensing Image Interpretation"

deep-learning remote-sensing attention object-detection semantic-segmentation scene-classification vision-transformer

Updated May 22, 2024
Python

RichardScottOZ / grid-mae

Investigate possibilities for Vision Transformers with multiscale grids

grid deep-learning geoscience geophysics autoencoder attention mineral-exploration masked-autoencoder vision-transformer

Updated May 22, 2024
Python

Improve this page

Add a description, image, and links to the attention topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the attention topic, visit your repo's landing page and select "manage topics."