Logo

MATLAB and NVIDIA with OpenOnDemand. - Shared screen with speaker view
Alan Chalker (Ohio Supercomputer Center)
14:30
If possible, please rename yourself to include your org name so we can know where people are from
Alan Chalker (Ohio Supercomputer Center)
23:05
If possible, please rename yourself to include your org name so we can know where people are from
Bennet Fauber - Umich
36:42
Does MATLAB use the GPU for display? The GPU is being shared. Did the job reserve the GPU for one user?
Maicon Faria (HPCNow!)
38:07
How does the multigpu setup works on matlab? There is support for distributed GPUs?
Grigory Shamov, UManitoba, Canada
38:26
I hope there will be some technical advice as to how to setup NVIDIA software to both visualize and compute.
Robert Settlage (VT)
39:05
Correct, we do not share GPUs
Shawn Doughty-Tufts University
39:29
I missed the comment about VNC vs running the interface directly in the browser? Does matlab now have a web interface via s socket or how is this working?
Virginia Williams ( UNC-CH)
39:36
could you repeat #2 gpu demo? the video here in that instance went from smooth ( cpu case, though slower ) to choppy video
Martin Cuma - U of Utah
39:57
Can you please show how you reserve the GPUs via the VT's OOD setup. Just curious how it differs from our setup.
Lisa Kempler (MathWorks)
40:02
I'll answer Shawn's question
Bennet Fauber - Umich
40:32
So, this requires VirtualGL and setting compute mode to shared
Ayush Chaturvedi (VT)
40:50
@martin : we just create a reservation for user and that you can give it in the form when you submit the job
Lisa Kempler (MathWorks)
41:04
Shawn - Yes, there is a way to set up MATLAB to run in a web browser, instead of using VNC. If there are people/sites interested in this, please let us know and we can talk with you offline
Ayush Chaturvedi (VT)
41:36
@martin: this has screenshots for your ref. https://github.com/AdvancedResearchComputing/OnDemandApps/tree/main/bc_vt_matlab_html
Lisa Kempler (MathWorks)
41:58
VT was kind enough to test this out with Open OnDemand. (Thanks)
Bruce Carpenter (UGA GACRC)
42:17
Lisa: yes definitely interested, do you have some documentation or references we could take a look at?
Martin Cuma - U of Utah
42:20
Thanks Ayush, the screen shot was what I was curious about.
Alex Townsend (FSU)
42:57
Does the new native interface put out by MATLAB for the MATLAB App make any adjustments to the way the Display system works with OOD? We've seen some issues here with window resizing so I'm curious if the newer native interface makes any changes to how that's done.
slaton (Genentech)
43:16
@Alex same here with window resizing issues.
Lisa Kempler (MathWorks)
43:17
Bruce, Shawn - I've captured your names. We'll get back to you with more.
Chun-Min Chang
43:18
In your comparison between CPU and GPU, how many CPUs and GPUs were used? What kind of CPU? How fast of the CPU?
Mikael Öhman (Chalmers University of Technology)
43:19
I am also interested in a solution without VNC.
Andy Evans @UVM
43:33
What license changes are required for GPU or browser-based interface?
Alan Chalker (Ohio Supercomputer Center)
44:20
I believe the demos were showing an AMD EPYC 64 core CPU vs. an NVIDIA A100 GPU
Chun-Min Chang
44:41
Thank you
Ayush Chaturvedi (VT)
44:42
@chun-min: the resources used were AMD rome 7702 https://en.wikichip.org/wiki/amd/epyc/7702 and Nvidia a100 SMX 80GB
Fangping Mu
44:43
Ia the new matlab interface a web application similar to jupyter or rstudio server?
Justin Richardson (University of Florida)
44:49
I am also interested in how to run MATLAB outside the VNC interface.
Zhiyong Zhang
44:51
how fast is the GUI for matlab through open ondemand? Is it comparable with x11 forwarding or, say, VNC type of applications?
Ayush Chaturvedi (VT)
45:33
@fangpin: yes
Martin Cuma - U of Utah
46:06
Some details of VT setup from the GitHub repo - why do you run it in SIngularity, not standalone via TurboVNC?
Ayush Chaturvedi (VT)
46:55
@zhi zhang: it usually also depends on compute resource underlying but In our experience , no i
Ayush Chaturvedi (VT)
47:14
@matin: for portability
Robert Settlage (VT)
47:39
And that is how Mathworks gave us the html interface
Lisa Kempler (MathWorks)
47:53
@andy evans - GPU support is part of the Parallel Computing Toolbox. the browser-based version relies on the (your) site's MATLAB licenses. In other words, no new licenses ought to be required. We can discuss offline to make sure we're addressing your question.
Alan Chalker (Ohio Supercomputer Center)
48:07
@ayush, I assume you meant to say that the GUI version IS comparable to the x11 / VNC version in terms of user latency / interactions / etc
Bennet Fauber - Umich
48:37
Is the web browser interface a MathWorks product included in a TAH, all Toolboxes?
Ayush Chaturvedi (VT)
48:38
@alan : yes
Robert Settlage (VT)
48:43
It is basically a docker image. Our Matlab is actually outside the container in a module. It is just the interface in the container.
Shawn Doughty-Tufts University
49:18
Do all sites use OOD to reserve entire node for GPU usage or do some allow multiple users per node with the scheduler (slurp, etc) allocation cpu, memory. Hopefully limited with cgroups so users don’t stomp on each other. Feel free to just reply in chat or whatever works best for people.
Bennet Fauber - Umich
49:23
What release of Matlab is required for the new interface?
Robert Settlage (VT)
49:42
We share nodes and have cgroups enabled.
Shawn Doughty-Tufts University
49:57
Are any sites using this within a composable computing environment all Liqid or GigIO?
Grigory Shamov, UManitoba, Canada
49:59
We share nodes and have groups. Slurm 19+ isolates GPUs I believe.
Bennet Fauber - Umich
50:00
We use cgroups and Slurm with shared nodes, GPUs in 'single process' compute mode.
Robert Settlage (VT)
50:00
These GPU boxes are the HPE 6500 8x a100s.
Bennet Fauber - Umich
50:06
No VirtualGL
Grigory Shamov, UManitoba, Canada
51:02
QUESTION: what version of Matlab is needed for the new Web interface?
Lisa Kempler (MathWorks)
51:13
@bennet Fauber - The browser interface runs on top of whatever your license is. No charge. If it's a site-license with all the toolboxes, then that's what runs. There are some limitations on Simulink products, fair warning.
Nick Choi (MathWorks)
51:18
@Grigory, the web-based interface requires R2020b or later
Mikael Öhman (Chalmers University of Technology)
51:24
@Shawn Node sharing and normal SLURM TRES + cgroups. I run VirtualGL with EGL backend (no background X-server required) so rendering also occurs on the (first) allocated GPU ( i wrote down all virtualgl details on discourse: https://discourse.osc.edu/t/virtualgl-in-ood-apps/750 )
Susan Litzinger
51:31
can someone copy the VT link?
Ayush Chaturvedi (VT)
51:42
https://github.com/AdvancedResearchComputing/OnDemandApps/tree/main/bc_vt_matlab_html
Bennet Fauber - Umich
51:43
https://github.com/AdvancedResearchComputing/OnDemandApps
Martin Cuma - U of Utah
51:52
Good to see another GitHub repo on OOD aps. I love stealing ideas from those ;-)
Ayush Chaturvedi (VT)
51:56
we will publish this on ondemand.org soon
Alan Chalker (Ohio Supercomputer Center)
51:58
The slides are available already on the OpenOnDemand.org website under the webinar section
Prasad Maddumage (FSU)
52:50
Can you take a minute to explain how matlab can run without vnc?
David Reddy
53:04
Will the recording be available so we can share it with colleagues such as our OOD admin and ML/DL domain scientists?
Alan Chalker (Ohio Supercomputer Center)
53:30
Yes, we will be posting the recording shortly on the OpenOnDemand.org website under the webinars sections
David Reddy
54:11
Great, thanks.
Christopher Benjamin Coffey
56:13
Hi, is there a VT howto for the ansys workbench app too pls?
Martin Cuma - U of Utah
57:41
We have Ansys at https://github.com/CHPC-UofU/OOD-apps/tree/master/ansys_workbench_app
Grigory Shamov, UManitoba, Canada
58:02
How easy it is allocate Matlab jobs from SLURM?
Christopher Benjamin Coffey
58:03
Thx! Is there a general app repo somewhere?
Tony Elam (UKy)
58:09
Do you use and support virtualization of the A100 into multiple GPUs/Cores?
Christopher Benjamin Coffey
58:12
That would be nice
Prasad Maddumage (FSU)
58:53
Basically windows get stuck and unable to resize
Robert Settlage (VT)
58:54
@Christopher there is a growing list on the OnDemand site
Thomas Green - Cardiff University, Wales
59:03
Its worth enforcing the use of gres in Slurm - otherwise users have access to all GPUs - maybe some other clever Slurm configuration can stop that.
Prasad Maddumage (FSU)
59:22
Not just matlab, it happens to all apps under centos 8
Ayush Chaturvedi (VT)
59:33
just reiterating if someone recently joined https://github.com/AdvancedResearchComputing/OnDemandApps/tree/main/bc_vt_matlab_html
Bennet Fauber - Umich
59:39
Thanks, Prasad! That that's good info
Bennet Fauber - Umich
59:58
We don't see it with CentOS 7 using MESA
Nicholas Ide - MathWorks
01:00:05
@Tony Elam: Does this answer your question https://www.mathworks.com/matlabcentral/answers/1468051-how-do-i-use-multi-instance-gpu-mig-mode-gpus-with-matlab-for-computation
Prasad Maddumage (FSU)
01:00:15
We found the fix by just adding "unset DBUS_SESSION_BUS_ADDRESS" in the script.sh.erb
Ruth Marinshaw (Stanford)
01:01:08
Thanks for your work, Virginia Tech!
Martin Cuma - U of Utah
01:01:11
For SLURM gres enforcing - if I remember right we have noticed that all the GPUs are visible so our admins did some tightening up in the prolog, like setting cgroup and CUDA_VISIBLE_DEVICES. Though this may have been fixed in newer SLURM versions.
Nick Choi (MathWorks)
01:01:37
R2020b or later
Ayush Chaturvedi (VT)
01:01:43
feel free to post your questions on https://openondemand.slack.com/
Prasad Maddumage (FSU)
01:01:58
Yes
Bennet Fauber - Umich
01:02:08
Still not clear whether the HTML framework needs a separate license....
Robert Settlage (VT)
01:02:15
no
Nick Choi (MathWorks)
01:02:23
The web interface does not require a separate license
Nick Choi (MathWorks)
01:03:56
The code to make the interface available with an existing MATLAB is free of charge
Bennet Fauber - Umich
01:04:03
Not at toolbox, but does it require anything additional to be installed either in the browser or on the server?
Martin Cuma - U of Utah
01:04:09
DO you have instructions to get the MATLAB we app working?
Martin Cuma - U of Utah
01:04:22
(web app)
Thomas Green - Cardiff University, Wales
01:06:00
The Slack link - seems to be restricted to certain edu domains.
Ayush Chaturvedi (VT)
01:06:02
@martin, the GitHub repo has the dev guide link at the bottom
Martin Cuma - U of Utah
01:06:15
I see that, thanks.
Lisa Kempler (MathWorks)
01:06:25
Thanks, Bob, for sharing your experience.
Alan Chalker (Ohio Supercomputer Center)
01:06:47
I'd recommend using DIscourse instead of Slack: https://discourse.osc.edu/c/open-ondemand/5
Alan Chalker (Ohio Supercomputer Center)
01:06:56
Although we also monitor slack too
Bennet Fauber - Umich
01:07:11
Perhaps we could have something separately later just on installation and configuration? This doesn't sound like it can be installed on top of a local filesystem installation.
Ruth Marinshaw (Stanford)
01:07:25
Thanks for the seminar!
Chun-Min Chang
01:07:28
Does MATLAB have any deep learning program similar to python TensorFlow or PyTorch packages? How's the comparison between your program and the python packages?
Ayush Chaturvedi (VT)
01:07:31
@bennet yes
Alex Townsend (FSU)
01:07:36
Thanks!
Fritz
01:07:37
is there a way to get the video of the presenation
Lisa Kempler (MathWorks)
01:07:40
Thanks, Andy and Alan!
Mark Allen
01:07:42
Thanks!
Shawn Doughty-Tufts University
01:07:42
tnx!
Franz J Klein
01:07:44
thanks!
Martin Cuma - U of Utah
01:07:47
Thanks, very useful.
Bennet Fauber - Umich
01:07:47
Thanks everyone!!
Alan Chalker (Ohio Supercomputer Center)
01:07:48
the video will be posted to OpenOnDemand.org shortly
Fritz
01:07:49
and the slides?
Andy Evans @UVM
01:07:52
Thank you!
Bala Desinghu (Rutgers)
01:07:54
Thank you all
Justin Richardson (University of Florida)
01:07:54
Thank you!
Nick Choi (MathWorks)
01:07:55
Thanks everyone!
Alan Chalker (Ohio Supercomputer Center)
01:07:56
the slides are already posted
Thomas Green - Cardiff University, Wales
01:07:58
Thanks.
David Reddy
01:08:04
Thanks!