You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-12 - 15:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Sat Sep 12, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25171992915,14cyclictest0-21swapper/021:52:040
2518599250,24cyclictest22106-21ssh23:07:183
2518599250,24cyclictest19989-21diskmemload00:29:003
25181992523,1cyclictest16998-21cat00:32:052
2518199250,24cyclictest0-21swapper/221:17:122
2517999250,24cyclictest19989-21diskmemload21:10:441
2517999250,24cyclictest0-21swapper/121:43:121
2517999250,24cyclictest0-21swapper/100:10:501
2517999250,24cyclictest0-21swapper/100:05:231
2517199250,24cyclictest19989-21diskmemload23:24:340
25185992422,1cyclictest19989-21diskmemload22:52:093
25185992420,3cyclictest16102-21cut22:05:013
25185992420,3cyclictest15192-21tr21:00:003
2518599240,23cyclictest19989-21diskmemload00:31:583
2518599240,0cyclictest0-21swapper/300:15:353
25181992424,0cyclictest0-21swapper/223:20:582
2518199240,23cyclictest5638-21sshd22:24:172
2518199240,23cyclictest19989-21diskmemload00:16:462
2518199240,1cyclictest4041-21ssh21:53:572
25179992423,0cyclictest0-21swapper/121:23:051
25179992421,2cyclictest606-21dbus-daemon00:30:001
2517999240,23cyclictest0-21swapper/122:17:451
2517999240,0cyclictest24215-1kworker/u9:123:53:571
2517999240,0cyclictest19989-21diskmemload22:28:401
2517999240,0cyclictest0-21swapper/122:51:081
2517999240,0cyclictest0-21swapper/122:43:171
25171992422,1cyclictest8330-21ssh23:53:590
25171992421,2cyclictest30173-21ssh22:47:020
25171992421,2cyclictest0-21swapper/023:28:450
2517199241,1cyclictest62550irq/127-eno100:22:310
2517199240,24cyclictest0-21swapper/022:08:570
2517199240,23cyclictest19989-21diskmemload00:30:580
2517199240,23cyclictest16196-21sh22:33:300
2517199240,1cyclictest62550irq/127-eno122:44:100
2517199240,0cyclictest19989-21diskmemload22:24:430
2517199240,0cyclictest19989-21diskmemload00:16:090
2517199240,0cyclictest0-21swapper/023:12:070
25185992323,0cyclictest0-21swapper/321:51:163
25185992323,0cyclictest0-21swapper/321:35:103
25185992323,0cyclictest0-21swapper/300:01:423
2518599230,23cyclictest0-21swapper/322:47:033
2518599230,23cyclictest0-21swapper/321:28:283
2518599230,23cyclictest0-21swapper/321:21:423
2518599230,22cyclictest30686-21ssh23:16:293
2518599230,22cyclictest29505-21munin-run23:15:003
2518599230,22cyclictest23198-21sendmail-msp22:40:003
2518599230,22cyclictest19989-21diskmemload00:10:323
2518599230,22cyclictest14785-21cut19:55:013
2518599230,22cyclictest14345-21sh21:33:353
2518599230,22cyclictest0-21swapper/300:36:483
2518599230,1cyclictest0-21swapper/323:55:343
2518599230,0cyclictest0-21swapper/323:34:103
2518599230,0cyclictest0-21swapper/321:10:323
25181992323,0cyclictest0-21swapper/223:31:072
25181992323,0cyclictest0-21swapper/223:13:012
25181992323,0cyclictest0-21swapper/223:02:042
25181992321,1cyclictest11836-21cstates21:32:072
25181992321,1cyclictest0-21swapper/222:32:122
25181992319,1cyclictest0-21swapper/222:28:292
2518199230,2cyclictest16131-21ssh21:35:392
2518199230,23cyclictest0-21swapper/223:49:122
2518199230,23cyclictest0-21swapper/223:18:152
2518199230,23cyclictest0-21swapper/222:00:582
2518199230,23cyclictest0-21swapper/221:23:582
2518199230,23cyclictest0-21swapper/200:20:392
2518199230,22cyclictest4738-21ssh22:52:112
2518199230,22cyclictest27573-21df00:12:052
2518199230,22cyclictest20683-21ssh22:08:332
2518199230,22cyclictest19465-21ssh23:06:002
2518199230,22cyclictest0-21swapper/223:56:202
2518199230,1cyclictest24839-21ssh00:38:202
2518199230,0cyclictest21662-21ssh21:40:582
2518199230,0cyclictest0-21swapper/223:43:452
2518199230,0cyclictest0-21swapper/221:11:042
2518199230,0cyclictest0-21swapper/200:09:012
25179992323,0cyclictest19989-21diskmemload23:58:361
25179992323,0cyclictest19989-21diskmemload23:38:351
25179992323,0cyclictest0-21swapper/123:11:111
25179992323,0cyclictest0-21swapper/122:04:521
25179992322,1cyclictest0-21swapper/123:25:571
25179992321,1cyclictest19353-21sh00:33:241
25179992321,1cyclictest0-21swapper/123:48:571
25179992321,1cyclictest0-21swapper/123:16:401
2517999231,1cyclictest2605-21apt-get23:20:021
2517999230,23cyclictest0-21swapper/100:15:341
2517999230,22cyclictest989-21ssh22:20:071
2517999230,22cyclictest6039-21/usr/sbin/munin21:27:051
2517999230,22cyclictest16841-21sh23:32:091
2517999230,22cyclictest13694-21ssh23:01:041
2517999230,22cyclictest0-21swapper/123:40:351
2517999230,22cyclictest0-21swapper/122:45:531
2517999230,22cyclictest0-21swapper/121:54:361
2517999230,21cyclictest0-21swapper/122:32:041
2517999230,1cyclictest8009-21ssh22:55:541
2517999230,0cyclictest19989-21diskmemload21:15:281
2517999230,0cyclictest0-21swapper/121:32:301
2517999230,0cyclictest0-21swapper/100:36:431
25171992323,0cyclictest62550irq/127-eno123:18:560
25171992323,0cyclictest0-21swapper/023:09:330
25171992323,0cyclictest0-21swapper/022:38:120
25171992323,0cyclictest0-21swapper/022:26:070
25171992323,0cyclictest0-21swapper/000:25:160
25171992321,1cyclictest21674-21apt-get00:07:040
25171992321,1cyclictest0-21swapper/023:45:500
25171992321,1cyclictest0-21swapper/022:02:010
25171992321,1cyclictest0-21swapper/021:13:480
25171992320,2cyclictest0-21swapper/023:37:120
25171992320,2cyclictest0-21swapper/000:37:070
2517199230,2cyclictest28089-21sh22:15:190
2517199230,2cyclictest12664-21tr23:00:010
2517199230,23cyclictest0-21swapper/023:02:220
2517199230,22cyclictest27536-21grep19:15:010
2517199230,22cyclictest26031-21sh21:15:080
2517199230,22cyclictest19989-21diskmemload21:57:050
2517199230,22cyclictest0-21swapper/023:56:520
2517199230,1cyclictest0-21swapper/000:04:060
2517199230,0cyclictest0-21swapper/022:12:370
2517199230,0cyclictest0-21swapper/021:42:540
2517199230,0cyclictest0-21swapper/021:26:460
2517199230,0cyclictest0-21swapper/021:20:240
2517199230,0cyclictest0-21swapper/000:11:140
25185992222,0cyclictest19989-21diskmemload23:00:133
25185992222,0cyclictest0-21swapper/323:45:333
25185992222,0cyclictest0-21swapper/322:20:153
25185992222,0cyclictest0-21swapper/322:13:253
25185992222,0cyclictest0-21swapper/300:21:093
25185992221,1cyclictest20790-21ssh00:05:423
25185992221,1cyclictest15177-21apt-get19:57:013
25185992220,1cyclictest6134-21irqstats23:52:103
25185992220,1cyclictest30363-21sh20:25:003
25185992220,1cyclictest0-21swapper/322:05:023
25185992220,1cyclictest0-21swapper/321:15:073
25185992219,2cyclictest26594-21sh21:45:033
2518599220,2cyclictest23914-21rm22:40:483
2518599220,2cyclictest10076-21ssh22:27:473
2518599220,22cyclictest0-21swapper/321:56:273
2518599220,21cyclictest2605-21apt-get23:20:013
2518599220,21cyclictest21995-21ssh21:41:233
2518599220,21cyclictest17803-21apt-get20:00:023
2518599220,21cyclictest0-21swapper/323:40:283
2518599220,21cyclictest0-21swapper/321:02:043
2518599220,1cyclictest606-21dbus-daemon20:30:003
2518599220,0cyclictest19989-21diskmemload23:38:283
25181992222,0cyclictest19989-21diskmemload23:29:242
25181992222,0cyclictest19989-21diskmemload22:10:282
25181992222,0cyclictest0-21swapper/223:50:092
25181992221,0cyclictest0-21swapper/220:47:032
25181992220,1cyclictest9974-21apt19:45:002
25181992220,1cyclictest5432-21ssh21:55:342
25181992220,1cyclictest27644-21apt-config22:15:012
25181992220,1cyclictest25538-21apt-get19:12:032
25181992220,1cyclictest10262-21ssh00:25:412
25181992220,1cyclictest0-21swapper/222:56:382
2518199220,21cyclictest7125-21apt-get19:40:002
2518199220,21cyclictest12814-21munin-run20:55:002
2518199220,21cyclictest0-21swapper/222:42:042
2518199220,21cyclictest0-21swapper/222:35:042
2518199220,21cyclictest0-21swapper/220:05:012
2518199220,1cyclictest605-21avahi-daemon19:20:002
2518199220,1cyclictest27291-21sh21:46:102
2518199220,1cyclictest20078-21ssh23:35:272
2518199220,0cyclictest19989-21diskmemload00:00:572
25179992220,1cyclictest0-21swapper/121:45:051
2517999220,22cyclictest0-21swapper/122:12:191
2517999220,21cyclictest6384-21ssh21:56:461
2517999220,21cyclictest25153-21apt-get20:15:021
2517999220,21cyclictest0-21swapper/123:05:021
2517999220,21cyclictest0-21swapper/122:05:091
2517999220,21cyclictest0-21swapper/120:57:031
2517999220,1cyclictest0-21swapper/121:35:091
2517999220,1cyclictest0-21swapper/100:21:511
25171992222,0cyclictest19989-21diskmemload22:50:330
25171992222,0cyclictest19989-21diskmemload21:35:030
25171992220,1cyclictest606-21dbus-daemon20:10:000
25171992220,1cyclictest0-21swapper/020:12:050
2517199220,21cyclictest25574-21ssh23:40:270
2517199220,21cyclictest0-21swapper/021:48:480
2517199220,1cyclictest0-21swapper/023:33:310
2517199220,1cyclictest0-21swapper/021:30:090
25185992121,0cyclictest30353-21apt-get19:22:043
25185992121,0cyclictest0-21swapper/319:17:043
25185992120,1cyclictest9041-21ssh23:25:243
2518599210,20cyclictest0-21swapper/319:27:053
2518599210,1cyclictest20776-21apt-get20:07:043
2518599210,1cyclictest11970-21ssh22:30:023
2518599210,1cyclictest0-21swapper/322:15:013
2518199210,21cyclictest0-21swapper/222:46:152
2518199210,1cyclictest15636-21apt-get21:02:042
25179992121,0cyclictest0-21swapper/119:52:031
25179992121,0cyclictest0-21swapper/100:01:031
25179992120,1cyclictest29904-21sendmail19:20:001
25179992119,1cyclictest783-21snmpd20:37:021
2517999210,20cyclictest2739-21awk20:35:011
2517999210,20cyclictest2739-21awk20:35:011
2517999210,0cyclictest0-21swapper/121:02:041
2517999210,0cyclictest0-21swapper/119:47:031
2517999210,0cyclictest0-21swapper/119:22:041
25171992119,1cyclictest0-21swapper/020:22:020
2517199210,0cyclictest0-21swapper/019:57:010
25185992017,2cyclictest10637-21runrttasks20:50:043
2518599200,0cyclictest0-21swapper/319:42:033
2518599200,0cyclictest0-21swapper/319:37:033
25181992019,1cyclictest0-21swapper/220:57:032
2518199200,0cyclictest0-21swapper/220:22:022
25179992020,0cyclictest20022-21perf21:10:001
25179992020,0cyclictest17992-21apt-get20:02:031
25179992020,0cyclictest0-21swapper/120:22:021
25171992020,0cyclictest2734-21apt-get19:32:030
25171992020,0cyclictest0-21swapper/019:27:050
25171992020,0cyclictest0-21swapper/019:17:040
25171992019,0cyclictest7980-21apt-get20:47:030
2517199200,20cyclictest0-21swapper/019:37:030
25185991919,0cyclictest0-21swapper/320:15:023
25185991919,0cyclictest0-21swapper/319:32:033
25181991919,0cyclictest0-21swapper/219:47:032
25181991919,0cyclictest0-21swapper/219:27:052
25181991917,1cyclictest25779-21apt-get20:15:022
25181991917,1cyclictest14783-21munin-run19:55:012
25179991919,0cyclictest0-21swapper/119:57:021
25179991918,0cyclictest0-21swapper/120:47:031
2517999190,1cyclictest5131-21apt-get19:37:031
25171991919,0cyclictest0-21swapper/020:02:030
25171991917,1cyclictest12797-21latency_hist20:55:000
25185991818,0cyclictest0-21swapper/320:12:043
25181991816,1cyclictest2733-21cron20:35:012
25181991816,1cyclictest2733-21cron20:35:012
25179991818,0cyclictest0-21swapper/120:50:041
25179991818,0cyclictest0-21swapper/119:12:031
25171991818,0cyclictest13220-21apt-get20:57:030
25171991818,0cyclictest0-21swapper/021:07:030
25171991818,0cyclictest0-21swapper/021:02:040
25171991818,0cyclictest0-21swapper/020:42:040
25171991818,0cyclictest0-21swapper/020:17:030
25171991818,0cyclictest0-21swapper/019:22:040
25171991816,1cyclictest9972-21turbostat.cron19:45:000
25185991717,0cyclictest0-21swapper/320:42:033
25185991717,0cyclictest0-21swapper/320:37:033
25185991716,0cyclictest0-21swapper/320:47:033
25185991714,2cyclictest313-21systemd-journal20:35:013
25185991714,2cyclictest313-21systemd-journal20:35:013
25181991717,0cyclictest0-21swapper/220:37:032
25181991715,1cyclictest20029-21munin-run21:10:002
25179991717,0cyclictest0-21swapper/119:27:051
25171991717,0cyclictest0-21swapper/020:27:040
25171991717,0cyclictest0-21swapper/019:52:030
2517199170,16cyclictest0-21swapper/020:37:040
25185991616,0cyclictest0-21swapper/321:07:033
25185991616,0cyclictest0-21swapper/319:12:033
2518199160,15cyclictest7555-21awk20:45:012
2518199160,15cyclictest0-21swapper/219:57:012
2517999160,16cyclictest0-21swapper/120:05:011
25181991515,0cyclictest0-21swapper/220:02:032
25179991515,0cyclictest0-21swapper/120:12:051
2518599140,14cyclictest0-21swapper/319:45:433
2518199140,14cyclictest0-21swapper/220:25:502
2518199140,14cyclictest0-21swapper/220:11:392
2518199140,0cyclictest0-21swapper/219:30:422
2517999140,14cyclictest0-21swapper/120:43:281
2517999140,0cyclictest0-21swapper/119:30:021
25171991414,0cyclictest0-21swapper/020:30:110
25171991414,0cyclictest0-21swapper/020:30:110
2517199140,14cyclictest0-21swapper/019:45:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional