Skip to main content

Questions tagged [high-performance]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
33 views

How to run HPL on multiple Nvidia GPUs locally?

I am trying to run HPL benchmark on my cluster. I want to run it locally and the file I use is hpl-2.0-FERMIV15. However, I don't know how to run this with multiple GPUs locally. I don't know how to ...
mendax1234's user avatar
-2 votes
1 answer
381 views

How to display only the number of jobs running in HPC by specific user?

I want to Display only the number of jobs running in the HPC related to my username! I don't wanna see all the jobs as the command squeue does! Thanks!
Mahedi's user avatar
  • 1
0 votes
0 answers
108 views

Is it possible to install Virtual Box or other free virtual machines on a cluster?

We have a CentOS HPC cluster and despite asking, the admins do not like to give us root access. I have more experience with finding the packages I need in Ubuntu's apt and conda-forge etc. I am ...
MathX's user avatar
  • 101
0 votes
1 answer
481 views

Why is RAMFS much slower than Ram?

I have a 64GB DDR4 3200MHz memory installed on my PC. When I run sysbench, I get the following results: # sysbench memory --memory-block-size=1M --memory-total-size=10G run sysbench 1.0.20 (using ...
Diogo Melo's user avatar
1 vote
0 answers
85 views

slub_min_objects : How comes 0 can stand as a valid / default value / rationale?

In the comments of the source code (mm/slub.c) of my linux_5.4 kernel, I can read : In order to reach satisfactory performance we must ensure that a minimum number of objects is in one slab. Otherwise ...
MC68020's user avatar
  • 8,241
0 votes
2 answers
82 views

Is It Possible To Track GPU Performance Increase?

CentOS7 I'm about to upgrade my gpu. Before I take action I am curious if there are any tests I can run on the cli that will track the performance of my current gpu so I can compare to the new gpu? ...
mister mcdoogle's user avatar
0 votes
1 answer
364 views

How to tune the linux Scheduler for parallel computation?

I have a linux machine dedicated to running some parallel computation, and I'm trying to understand how to choose / tune the scheduler, and perhaps other parameters, to extract the most performance (...
Just Me's user avatar
  • 101
9 votes
2 answers
5k views

Set CPU to high performance

I spent hours searching for an answer in Internet. All I could find doesn't help. I have Intel i9-9980HK, running under Ubuntu 20.04, kernel 5.4.0-33. The problem is that under the full load the CPU ...
facetus's user avatar
  • 268
3 votes
0 answers
982 views

How can I display graphics on the screen from the kernel over the top of my X11/Wayland session?

I want to draw simple (2D bitmapped) graphics onto my screen (in response to (simple) external inputs) with the lowest latency possible (the order of tens of milliseconds) so I can empirically test ...
i336_'s user avatar
  • 1,027
1 vote
1 answer
382 views

Live changing bjobs output

When using LSF command bjobs, I would like to get instantly changing output if I submit another job, because I feel stressful to run the same command again and again. I would like something like top ...
Joshua Salazar's user avatar
1 vote
1 answer
117 views

Is LSF queue allowed to preempt itself?

I have an LSF queue, say it's queue A. I only want higher priority jobs in queue A to preempt lower priority jobs in queue A, but not jobs in any other queues. If I set queue A to be preemptable, ...
Peng's user avatar
  • 11
1 vote
0 answers
126 views

Linux (kernel 3.x and 4.x) Pthread and general process scheduling algorithms

I was wondering if both scheduling (contention) scopes (SYSTEM and PROCESS) are used in the Linux kernel scheduling logic. POSIX supports PROCESS scope pthreads (MXN model) and SYSTEM scope pthreads (...
tamumiket's user avatar
15 votes
4 answers
55k views

Linux: how to know which processes are pinned to which core?

Is there a way to know which cores currently have a process pinned to them? Even processes run by other users should be listed in the output. Or, is it possible to try pinning a process to a core ...
daruma's user avatar
  • 436
0 votes
1 answer
515 views

Lustre and HPC configuration

I have an HPC cluster with 22 nodes, and one head node as a master running Rocks Cluster OS (which is based on CentOS). The nodes and master communicate with private network (10.10.0.0/16). And we ...
luthfi.imanal's user avatar
0 votes
0 answers
130 views

high performance computing cluster setup

In my lab, we have several servers used for the simulation programs, but they worked independently. Now I want to combine them to become a cluster using MPICH to make them communicate. But there ...
zmwang's user avatar
  • 1
2 votes
1 answer
325 views

Is the coordination overhead between two processes significant?

I have 24 compute intensive processes, each process running in a single thread, each running about 2 hours. I'm on a 8 core CPU. Does it make a difference on the total run time, if I run all 24 ...
lukstei's user avatar
  • 141
5 votes
1 answer
5k views

Do I need to explicitly enable jumbo frames in NFSv4?

I'm using NFS to share data between VMs. I've already set up working jumbo frames between VMs and host. My question is - do I need to somehow explicitly tell nfs to use jumbo frames or it'll just ...
Lapsio's user avatar
  • 1,323
2 votes
1 answer
297 views

PBS code for submitting a job on the cluster

I'm trying to write a code to submit a job on the cluster, and am using someone else's previous code as a template; is there any way someone could explain each line step by step to me? I think I ...
Sophia H's user avatar
4 votes
1 answer
2k views

SoftIRQs and Fast Packet Processing on Linux network

I have been reading about performance tuning of Linux to get the fastest packet processing times when receiving financial market data. I see that when the NIC receives a packet, it puts it in memory ...
Nidhi's user avatar
  • 41
5 votes
0 answers
537 views

Restoring in-memory/swapped page state on resume from hibernation

I'm a big fan of Linux's hibernation support, which works extremely well on all the (admittedly slightly older) hardware I've tried it on. I highly prefer it to full shutdown and power up. There's ...
i336_'s user avatar
  • 1,027
18 votes
10 answers
4k views

Filter file by line number

Given a file L with one non-negative integer per line and text file F, what would be a fast way to keep only those lines in F, whose line number appears in file L? Example: $ cat L.txt 1 3 $ cat F....
miku's user avatar
  • 673
3 votes
1 answer
2k views

Io redirection vs file logging performance c/c++

Is there a performance difference from a latency point of view if we do a regular printf and redirect stdout to a file when running the program ( e.g., ./a.out > log.txt 2>&1 ) vs using fprintf ...
Shanky's user avatar
  • 33
2 votes
2 answers
1k views

Code for submitting job on cluster

I use the following code to submit a job on a cluster, but I don't know what these code means. Can some one explain me what the following code means if possible line-by-line. #!/bin/bash #PBS -N ...
pkj's user avatar
  • 123
3 votes
1 answer
241 views

Using SLURM without a feature

Suppose my super computer has the following NODELIST's with the included features: NODELIST FEATURES NodeA (none) NodeB specialfeature and I am trying to benchmark performance ...
chessofnerd's user avatar
1 vote
2 answers
560 views

apache mod_security and performance

I have a list of bots to block, so I was thinking that fail2ban could be a solution until I realized that mod_security would be more efficient in this kind of tasks. The number of bots is huge, so ...
4m1nh4j1's user avatar
  • 1,893
2 votes
1 answer
798 views

Strategies for building distributed computing system with hybrid Mac and Linux systems

I want to build a distributed computing system to run Matlab, C and other programming languages for scientific computing. Now I've several old Mac machines with Lion Mac OS installed acted as web ...
Xiaodong Qi's user avatar
3 votes
1 answer
2k views

tmpfs performance

I use avconv to make screen recording of gameplays on linux (yeah, I'm sorry, I am one of them, but I get more excited about the scripts than playing it self), but recently my harddrive has gone and ...
Rarlei's user avatar
  • 39
4 votes
2 answers
3k views

Is there a drawback when using a chroot in high performance computing?

My (small) company uses an out-of-date linux (centos) software stack to run a proprietary software on a small cluster. Understandingly, IT is reluctant to upgrade since everything works now. I'd like ...
Sebastian's user avatar
  • 8,857
2 votes
1 answer
2k views

How do I make a multi-threaded app use all the cores on Ubuntu under VMWare?

I have a multi-threaded C++ app (using pThreads) that processes a massive flat file that works great on Windows - uses all four cores on my puny CPU. Client wants to run the same code on Red Hat on a ...
Jeff's user avatar
  • 701
42 votes
4 answers
7k views

Why is Linux commonly used as operating system for supercomputers?

As of November 2010, Linux is used on 459 out of the 500 supercomputers of the TOP500. Refer to the table via Internet Archive. What are the reasons behind this massive use of Linux in the ...
orftz's user avatar
  • 691