#

position-embedding

Here are 10 public repositories matching this topic...

thu-ml / DiT-Extrapolation

Official implementation for "RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformers" (ICML 2025) and "UltraViCo: Breaking Extrapolation Limits in Video Diffusion Transformers"

generative-model rope diffusion extrapolation dit video-generation position-embedding diffusion-models long-video-generation diffusion-transformer cogvideox hunyuan-video

Updated Nov 26, 2025
Python

naver-ai / rope-vit

[ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"

transformer self-attention position-embedding vision-transformer rotary-position-embedding eccv2024

Updated Oct 29, 2025
Python

erogol / BlaGPT

Experimental playground for benchmarking language model (LM) architectures, layers, and tricks on smaller datasets. Designed for flexible experimentation and exploration.

machine-learning deep-learning transformers pytorch gpt attention-mechanisms gpt-2 position-embedding large-language-models llm llm-training hymba diffusion-llm dllm

Updated Nov 12, 2025
Python

Haochen-Wang409 / DropPos

[NeurIPS'23] DropPos: Pre-Training Vision Transformers by Reconstructing Dropped Positions

computer-vision deep-learning detection imagenet image-classification coco segmentation ade20k self-supervised-learning position-embedding vision-transformer neurips-2023

Updated Apr 30, 2024
Python

cosmaadrian / time-enriched-multimodal-depression-detection

Official source code for the paper: "It’s Just a Matter of Time: Detecting Depression with Time-Enriched Multimodal Transformers"

multimodal-learning transformer-architecture depression-detection position-embedding

Updated Jan 17, 2024
Python

yhlleo / MJP

[CVPR 2023] An official Pytorch implementation of "Masked Jigsaw Puzzle: A Versatile Position Embedding for Vision Transformers".

privacy-protection position-embedding vision-transformer gradient-attack

Updated Dec 21, 2024
Python

hrlics / HoPE

[NeurIPS 2025] HoPE: Hybrid of Position Embedding for Long Context Vision-Language Models

position-embedding long-video-understanding long-context-modeling vision-language-models

Updated Oct 30, 2025
Python

CyberZHG / torch-position-embedding

Position embedding in PyTorch

pytorch embeddings position-embedding

Updated Jul 11, 2020
Python

akanyaani / embedding-visualizer

Word and Position Embedding visualization of all pre-trained transformer models like BERT

word-embeddings embeddings transformer tensorboard-visualizations position-embedding bert-embeddings embedding-visualization

Updated Aug 15, 2021
Jupyter Notebook

lartpang / RotaryPositionEmbedding

rope position-embedding

Updated Mar 28, 2024
Jupyter Notebook

Improve this page

Add a description, image, and links to the position-embedding topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the position-embedding topic, visit your repo's landing page and select "manage topics."