Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix wgpu performance issue: revert to wgpu 0.18.0 #1221

Merged
merged 2 commits into from
Feb 1, 2024
Merged

Conversation

nathanielsimard
Copy link
Member

@nathanielsimard nathanielsimard commented Feb 1, 2024

It appears that the new wgpu release has introduced a significant performance issue.

I conducted some benchmarks by training a transformer for 1 epoch on the ag-news dataset using the text-classification example:

  • fix: 3m5.907s
  • v0.11.1: 4m22.933s
  • v0.12.0: after 3 minutes, only 34% completed (66% remaining)

All benchmarks were performed on Pop OS with an Nvidia 3070. The backend in use was Fusion<Wgpu>.

We plan to incorporate more automated benchmarks in the future to proactively identify and address performance regressions like this one.

Fix #1213

Copy link
Member

@louisfd louisfd left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fix clippy, then LGTM

Copy link

codecov bot commented Feb 1, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (4aa13d6) 84.42% compared to head (051915a) 84.42%.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1221       /-   ##
==========================================
- Coverage   84.42%   84.42%   -0.01%     
==========================================
  Files         549      549              
  Lines       61921    61920       -1     
==========================================
- Hits        52278    52277       -1     
  Misses       9643     9643              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@syl20bnr syl20bnr merged commit abb7ee1 into main Feb 1, 2024
15 checks passed
syl20bnr pushed a commit that referenced this pull request Feb 1, 2024
@nathanielsimard nathanielsimard deleted the fix/slow-wgpu branch February 1, 2024 17:58
syl20bnr pushed a commit that referenced this pull request Feb 1, 2024
syl20bnr pushed a commit that referenced this pull request Feb 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[webgpu] - drop in calculation speed for webgpu in v0.12
3 participants