Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

What is proper way to configure mxnet? #7

Open
kingsj0405 opened this issue Sep 22, 2020 · 3 comments
Open

What is proper way to configure mxnet? #7

kingsj0405 opened this issue Sep 22, 2020 · 3 comments

Comments

@kingsj0405
Copy link

kingsj0405 commented Sep 22, 2020 •
edited
Loading

Hello. I'm trying to reproduce your work. Thank you for sharing the code perfectly. But I have some problems to configure mxnet(Not sure, maybe).

Currently, I use the docker image from Nvidia. (https://ngc.nvidia.com/catalog/containers/nvidia:mxnet)

It seems your gridifyop need headers on 3rdparty, src and include to build. So I added apache/incubator-mxnet on my workspace with following command.

git clone -b 1.5.0 --recursive https://github.com/apache/incubator-mxnet mxnet

And I update Makefile as the following image.

image

Then, I got an error like the followings.

$ CUDA_VISIBLE_DEVICES=1 python -u train/train_gpu_ggcn_mdl40.py > .
./../GAPCN/GridGCN_v1_20200921/mdl40.log
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
Aborted (core dumped

Now, I have some questions.

  1. Is there a docker image that you use?
  2. Do I have to build mxnet from the source?
  3. Is there a way to get more detail debug log?

Thank you :)
@sheshap
Copy link

sheshap commented Oct 5, 2020

@kingsj0405 what are the versions of the following?

gcc
g
cuda

@kingsj0405
Copy link
Author

gcc: 7.5.0
g : not installed
cuda:

  • /usr/local/cuda point /usr/local-cuda-11.0
root@5fb047ad07a2:/workspace# gcc --version
gcc (Ubuntu 7.5.0-3ubuntu1~18.04) 7.5.0
Copyright (C) 2017 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

root@5fb047ad07a2:/workspace# g   -- version
g  : error: version: No such file or directory
g  : error: unrecognized command line option ‘--’
g  : fatal error: no input files
compilation terminated.
root@5fb047ad07a2:/workspace# nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2020 NVIDIA Corporation
Built on Wed_Jul_22_19:09:09_PDT_2020
Cuda compilation tools, release 11.0, V11.0.221
Build cuda_11.0_bu.TC445_37.28845127_0
root@5fb047ad07a2:/workspace# nvidia-smi
Tue Oct  6 02:08:03 2020       
 ----------------------------------------------------------------------------- 
| NVIDIA-SMI 435.21       Driver Version: 435.21       CUDA Version: 10.1     |
|------------------------------- ---------------------- ---------------------- 
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|=============================== ====================== ======================|
|   0  GeForce GTX 108...  Off  | 00000000:19:00.0 Off |                  N/A |
|  0%   40C    P8    14W / 250W |      0MiB / 11178MiB |      0%      Default |
 ------------------------------- ---------------------- ---------------------- 
|   1  GeForce GTX 108...  Off  | 00000000:1A:00.0 Off |                  N/A |
|  0%   42C    P8     9W / 250W |      0MiB / 11178MiB |      0%      Default |
 ------------------------------- ---------------------- ---------------------- 
|   2  GeForce GTX 108...  Off  | 00000000:68:00.0 Off |                  N/A |
|  0%   55C    P8    19W / 250W |      0MiB / 11178MiB |      0%      Default |
 ------------------------------- ---------------------- ---------------------- 
                                                                               
 ----------------------------------------------------------------------------- 
| Processes:                                                       GPU Memory |
|  GPU       PID   Type   Process name                             Usage      |
|=============================================================================|
|  No running processes found                                                 |
 -----------------------------------------------------------------------------

@zcy1065670505
Copy link

@kingsj0405 , I have also the same method in building mxnet from source code , I added apache/incubator-mxne on my workspace ,
But I found there is no direction ''mxnet/3rdparty/nnvm/include'' in ''mxnet/3rdparty/''，As follows:
Screenshot from 2020-10-13 22-01-47

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@sheshap @kingsj0405 @zcy1065670505