Skip to content

Add TIPSv2 segmentation DPT inference notebook#21

Open
bingyic wants to merge 2 commits intomainfrom
add-segmentation-dpt-notebook
Open

Add TIPSv2 segmentation DPT inference notebook#21
bingyic wants to merge 2 commits intomainfrom
add-segmentation-dpt-notebook

Conversation

@bingyic
Copy link
Copy Markdown
Collaborator

@bingyic bingyic commented Apr 14, 2026

Add a Colab notebook for zero-shot semantic segmentation using TIPSv2 DPT head.

Changes

  • Downloads ADE20K validation images from the official MIT source
  • Supports all model variants (B, L, So, g)
  • Includes DPT head definition and Flax-to-PyTorch weight loading
  • Visualizes segmentation results with ADE20K palette

bingyic added 2 commits April 14, 2026 07:09
Add a Colab notebook demonstrating zero-shot semantic segmentation using the
TIPSv2 DPT head. The notebook downloads ADE20K validation images directly
from http://data.csail.mit.edu/places/ADEchallenge/ADEChallengeData2016.zip
instead of hosting images in the repository.
…line DPT definition

- Remove ~200 lines of redundant inline DPTSegmentationHead code
- Import SegmentationDecoder and load_decoder_weights from tips.pytorch.decoders (PR #18)
- Clone add-decoders-module branch for the decoders module
- Use per-variant INTERMEDIATE_LAYERS_MAP instead of hardcoded layer indices
- Download ADE20K images at runtime instead of hosting in repo
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant