You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 07:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Eltec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot5s.osadl.org (updated Thu Sep 18, 2025 00:43:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
121540ksoftirqd/1117450irq/72-mmc021:25:191
398950520irq/29-eth0_g0_9546-21unixbench_singl22:40:230
121520ksoftirqd/1399050irq/30-eth0_g0_23:34:551
121510ksoftirqd/1399050irq/30-eth0_g0_23:55:160
121510ksoftirqd/1399050irq/30-eth0_g0_23:20:181
121510ksoftirqd/1399050irq/30-eth0_g0_22:56:121
121490ksoftirqd/1399050irq/30-eth0_g0_22:38:291
121490ksoftirqd/1399050irq/30-eth0_g0_00:12:381
7860994815cyclictest23756-21proc_pri20:40:211
121480ksoftirqd/1398950irq/29-eth0_g0_22:45:221
121480ksoftirqd/1398950irq/29-eth0_g0_22:45:221
7860994712cyclictest31448-21cat21:35:031
7860994712cyclictest16033-21cpu19:55:111
121470ksoftirqd/1399050irq/30-eth0_g0_23:45:171
399050460irq/30-eth0_g0_786099cyclictest00:05:251
399050460irq/30-eth0_g0_786099cyclictest00:05:251
121460ksoftirqd/1399050irq/30-eth0_g0_23:32:500
121460ksoftirqd/1399050irq/30-eth0_g0_00:31:330
121460ksoftirqd/1399050irq/30-eth0_g0_00:29:240
121460ksoftirqd/1399050irq/30-eth0_g0_00:22:260
121460ksoftirqd/1398950irq/29-eth0_g0_22:15:531
121460ksoftirqd/1398950irq/29-eth0_g0_00:22:031
7860994540cyclictest18101-21proc_pri20:05:221
7860994515cyclictest21523-21unixbench_multi20:25:231
7860994515cyclictest21523-21unixbench_multi20:25:231
7860994515cyclictest20945-21latency_hist23:55:021
7860994513cyclictest3136-21latency_hist22:05:021
7860994512cyclictest7446-21if_eth022:30:171
7860994512cyclictest18292-21rt-features23:35:231
121450ksoftirqd/1399050irq/30-eth0_g0_22:51:491
121450ksoftirqd/1399050irq/30-eth0_g0_21:18:071
121450ksoftirqd/1398950irq/29-eth0_g0_23:00:091
121450ksoftirqd/1398950irq/29-eth0_g0_21:57:181
121450ksoftirqd/1398950irq/29-eth0_g0_20:20:211
121450ksoftirqd/1398950irq/29-eth0_g0_20:20:211
121450ksoftirqd/1398950irq/29-eth0_g0_00:31:361
7860994412cyclictest29749-21grep21:20:241
7860994412cyclictest22231-21sendmail_mailtr20:30:231
7860994411cyclictest6092-21proc_pri22:20:201
398950440irq/29-eth0_g0_22885-21kworker/0:221:24:390
121440ksoftirqd/1399050irq/30-eth0_g0_23:57:321
786099439cyclictest18677-21/usr/sbin/munin20:10:171
7860994315cyclictest16403-21latency23:25:141
7860994314cyclictest14999-21ps23:15:231
7860994311cyclictest4255-21irqstats22:10:161
7860994311cyclictest25664-21latency_hist20:55:021
7860994311cyclictest17197-21netstat20:00:191
7860994311cyclictest14987-21timerandwakeup19:45:251
7860994310cyclictest14324-21sshd19:42:441
398950430irq/29-eth0_g0_22885-21kworker/0:222:47:520
398950430irq/29-eth0_g0_22885-21kworker/0:222:47:520
398950430irq/29-eth0_g0_22885-21kworker/0:222:23:120
121430ksoftirqd/1399050irq/30-eth0_g0_23:09:271
121430ksoftirqd/1399050irq/30-eth0_g0_22:40:311
121430ksoftirqd/1399050irq/30-eth0_g0_22:15:120
121430ksoftirqd/1398950irq/29-eth0_g0_23:11:281
121430ksoftirqd/1398950irq/29-eth0_g0_21:13:031
121430ksoftirqd/1398950irq/29-eth0_g0_00:00:561
786099429cyclictest19326-21df_abs20:15:141
7860994212cyclictest471-21unixbench_multi21:40:221
7860994212cyclictest32220-21sshd21:38:441
398950420irq/29-eth0_g0_22885-21kworker/0:222:52:590
398950420irq/29-eth0_g0_22885-21kworker/0:222:03:290
398950420irq/29-eth0_g0_22885-21kworker/0:221:27:500
398950420irq/29-eth0_g0_22885-21kworker/0:200:18:030
121420ksoftirqd/1399050irq/30-eth0_g0_22:06:561
121420ksoftirqd/1399050irq/30-eth0_g0_21:54:021
121420ksoftirqd/1399050irq/30-eth0_g0_00:28:271
121420ksoftirqd/1398950irq/29-eth0_g0_22:27:320
121420ksoftirqd/1398950irq/29-eth0_g0_00:17:121
786099419cyclictest8448-21rt-features19:05:221
786099418cyclictest13077-21memory19:35:171
7860994116cyclictest9509-21latency_hist19:15:021
7860994111cyclictest6508-21df22:25:141
7860994111cyclictest24542-21open_inodes20:45:241
7860994110cyclictest470-21kworker/1:119:50:201
7860994110cyclictest470-21kworker/1:119:30:221
7860994110cyclictest22786-21memory20:35:171
398950410irq/29-eth0_g0_8305-21irqstats22:35:170
398950410irq/29-eth0_g0_7202-21df_abs19:00:140
398950410irq/29-eth0_g0_22885-21kworker/0:223:46:240
398950410irq/29-eth0_g0_22885-21kworker/0:223:36:100
398950410irq/29-eth0_g0_22885-21kworker/0:223:05:190
398950410irq/29-eth0_g0_22885-21kworker/0:223:03:510
398950410irq/29-eth0_g0_22885-21kworker/0:222:31:350
398950410irq/29-eth0_g0_22885-21kworker/0:222:13:270
398950410irq/29-eth0_g0_22885-21kworker/0:222:05:040
398950410irq/29-eth0_g0_22885-21kworker/0:221:49:470
398950410irq/29-eth0_g0_22885-21kworker/0:221:43:280
398950410irq/29-eth0_g0_22885-21kworker/0:221:36:060
398950410irq/29-eth0_g0_22885-21kworker/0:200:02:030
121410ksoftirqd/1398950irq/29-eth0_g0_21:06:011
786099409cyclictest470-21kworker/1:123:40:221
786099409cyclictest399050irq/30-eth0_g0_19:15:181
786099408cyclictest399050irq/30-eth0_g0_19:20:191
398950400irq/29-eth0_g0_785999cyclictest23:25:170
398950400irq/29-eth0_g0_785999cyclictest00:11:490
398950400irq/29-eth0_g0_22885-21kworker/0:223:42:440
398950400irq/29-eth0_g0_22885-21kworker/0:223:21:040
398950400irq/29-eth0_g0_22885-21kworker/0:223:15:170
398950400irq/29-eth0_g0_22885-21kworker/0:221:56:000
398950400irq/29-eth0_g0_22885-21kworker/0:221:50:220
398950400irq/29-eth0_g0_22885-21kworker/0:221:11:420
398950400irq/29-eth0_g0_22885-21kworker/0:200:08:360
398950400irq/29-eth0_g0_22885-21kworker/0:200:08:360
398950400irq/29-eth0_g0_21597-21vmstat20:25:230
398950400irq/29-eth0_g0_21597-21vmstat20:25:230
7860993912cyclictest26363-21unixbench_multi20:55:241
398950390irq/29-eth0_g0_22885-21kworker/0:223:52:560
398950390irq/29-eth0_g0_22885-21kworker/0:223:11:560
398950390irq/29-eth0_g0_22885-21kworker/0:222:59:040
398950390irq/29-eth0_g0_22885-21kworker/0:221:31:490
398950390irq/29-eth0_g0_22885-21kworker/0:221:07:100
7860993810cyclictest470-21kworker/1:121:46:411
398950380irq/29-eth0_g0_22885-21kworker/0:221:16:190
7860993711cyclictest11459-21memory19:25:191
398950370irq/29-eth0_g0_26185-21ps20:55:210
398950370irq/29-eth0_g0_10997-21unixbench_multi19:20:210
121370ksoftirqd/1399050irq/30-eth0_g0_21:04:441
398950360irq/29-eth0_g0_15671-21ps19:50:200
398950360irq/29-eth0_g0_13329-21sendmail_mailtr19:35:220
399050350irq/30-eth0_g0_7200-21df19:00:141
398950350irq/29-eth0_g0_9265-21find19:10:240
398950350irq/29-eth0_g0_8177-21grep19:05:170
398950350irq/29-eth0_g0_25546-21unixbench_multi20:50:230
398950350irq/29-eth0_g0_22313-21unixbench_multi20:30:240
398950350irq/29-eth0_g0_19908-21unixbench_multi20:15:230
398950350irq/29-eth0_g0_17578-21latency_hist20:05:030
398950340irq/29-eth0_g0_12592-21unixbench_multi19:30:230
398950340irq/29-eth0_g0_10074-21find19:15:220
398950330irq/29-eth0_g0_24042-21pluginstate20:45:020
398950330irq/29-eth0_g0_23089-21sort20:35:220
398950330irq/29-eth0_g0_18301-21unixbench_singl20:05:240
398950330irq/29-eth0_g0_16158-21df_abs19:55:120
398950330irq/29-eth0_g0_11716-21/usr/sbin/munin19:25:240
398950320irq/29-eth0_g0_20615-21sendmail_mailtr20:20:230
398950320irq/29-eth0_g0_20615-21sendmail_mailtr20:20:230
398950320irq/29-eth0_g0_14119-21find19:40:220
398950320irq/29-eth0_g0_0-21swapper/020:45:220
398950310irq/29-eth0_g0_14408-21/usr/sbin/munin19:45:240
398950300irq/29-eth0_g0_18454-21/usr/sbin/munin20:10:170
398950280irq/29-eth0_g0_26548-21sshd21:01:440
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional