Skip to content

[Feature]: Deepseek R1 reference implementation #297

@arekay-nv

Description

@arekay-nv

Motivation

A reference implementation for Deepseek-r1. The implementation should include the dataset (and sampled versions if needed for lower concurrency runs), as well as accuracy checks and allowed optimizations.

Proposed Solution

Possibly using the MLPerf inference setup and tweaking for different concurrency points. Concurrency=1 would require more thought.

Alternatives Considered

No response

Additional Context

No response

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions