Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[pyspark] Don't stack for non feature columns #9088

Merged
merged 1 commit into from
Apr 25, 2023

Conversation

wbo4958
Copy link
Contributor

@wbo4958 wbo4958 commented Apr 25, 2023

To close #9016. I did some benchmark tests, this PR can bring ~1x speed up. Please see the details #9016 (comment)

@wbo4958
Copy link
Contributor Author

wbo4958 commented Apr 25, 2023

Hi @trivialfis @WeichenXu123, Please help to review this PR. Thx

Copy link
Member

@trivialfis trivialfis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for the fix. Looks good to me assuming all tests pass.

@trivialfis trivialfis merged commit 17add47 into dmlc:master Apr 25, 2023
@wbo4958 wbo4958 deleted the pyspark-reg branch April 25, 2023 23:28
@wbo4958 wbo4958 restored the pyspark-reg branch April 25, 2023 23:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Regression in pyspark fit time for columnar input spark-rapids gpu
2 participants