You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-06 - 00:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Wed Aug 05, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22982993332,1cyclictest1690-21lspci11:31:502
22984992928,1cyclictest103-1kworker/3:1H11:31:503
22982992623,1cyclictest313-21systemd-journal08:40:002
22979992624,1cyclictest26818-21apt-get10:13:580
2298199250,1cyclictest6263-21cron10:35:011
2298499240,23cyclictest6794-21diskmemload09:10:013
2298499240,1cyclictest13539-21cron09:35:003
2298299240,24cyclictest6794-21diskmemload09:12:172
2298299240,23cyclictest26463-21apt-get11:19:012
2298199240,23cyclictest2343-21perf08:35:001
22979992420,3cyclictest12855-21apt09:30:000
2297999240,23cyclictest6519-21perf11:40:010
2297999240,22cyclictest313-21systemd-journal11:00:000
2297999240,1cyclictest0-21swapper/009:12:380
22984992321,1cyclictest0-21swapper/309:10:143
2298499230,22cyclictest15878-21cron10:55:003
2298499230,0cyclictest0-21swapper/311:19:013
2298299230,2cyclictest30273-21cron08:00:002
2298299230,23cyclictest0-21swapper/211:45:012
2298299230,22cyclictest0-21swapper/212:30:012
22981992321,1cyclictest8918-21munin-run11:45:001
2298199230,2cyclictest12213-21idleruntime-cro09:25:001
2298199230,22cyclictest0-21swapper/109:12:051
22984992220,1cyclictest3004-21perf08:40:003
22984992220,1cyclictest15857-21perf09:50:013
22984992220,1cyclictest15857-21perf09:50:013
2298499220,21cyclictest28967-21perf07:50:003
2298499220,21cyclictest25288-21dump-pmu-power07:25:013
2298499220,21cyclictest0-21swapper/310:00:023
2298499220,1cyclictest0-21swapper/309:20:033
22982992220,1cyclictest6285-21sh10:35:012
22982992220,1cyclictest21352-21munin-run12:10:002
22982992218,3cyclictest1712-21latency_hist08:30:012
2298299220,21cyclictest15885-21turbostat10:55:002
2298299220,1cyclictest24338-21apt-get12:19:002
22981992222,0cyclictest0-21swapper/110:58:581
22981992220,1cyclictest20682-21munin-run10:00:011
22981992220,1cyclictest18962-21awk12:05:001
22981992220,1cyclictest0-21swapper/111:31:501
22981992220,1cyclictest0-21swapper/110:30:001
22981992220,1cyclictest0-21swapper/108:50:001
22981992213,7cyclictest27794-21gltestperf12:24:001
2298199220,21cyclictest28661-21perf10:15:001
2298199220,21cyclictest26157-21tr12:20:011
2298199220,21cyclictest0-21swapper/112:28:591
2298199220,21cyclictest0-21swapper/111:45:021
2298199220,21cyclictest0-21swapper/109:53:541
2298199220,1cyclictest16506-21idleruntime-cro12:00:001
22979992221,0cyclictest0-21swapper/011:23:590
22979992221,0cyclictest0-21swapper/011:23:590
22979992220,1cyclictest0-21swapper/011:50:000
2297999221,20cyclictest15453-21apt-get09:45:030
2297999221,20cyclictest15453-21apt-get09:45:030
2297999220,1cyclictest2339-21latency_hist08:35:000
22984992120,1cyclictest0-21swapper/311:38:593
22984992120,0cyclictest32419-21apt-get12:33:593
22984992120,0cyclictest25844-21apt-get10:10:023
22984992119,1cyclictest29264-21apt-get10:15:023
22984992119,1cyclictest24032-21apt-get10:08:593
22984992119,1cyclictest23669-21apt-get11:13:583
2298499210,1cyclictest14842-21grep09:45:003
2298499210,0cyclictest19509-21apt-get12:08:593
2298499210,0cyclictest0-21swapper/312:19:003
2298499210,0cyclictest0-21swapper/310:23:583
22982992121,0cyclictest0-21swapper/211:13:582
22982992119,1cyclictest27938-21awk07:45:002
22982992119,1cyclictest14194-21latency_hist09:40:002
22982992119,1cyclictest11208-21munin-plugin-st09:20:012
22982992119,1cyclictest0-21swapper/209:55:012
2298299210,20cyclictest12264-21apt-get11:53:582
2298299210,0cyclictest6853-21apt-get10:39:002
22981992121,0cyclictest0-21swapper/110:39:001
22981992119,1cyclictest606-21dbus-daemon11:25:011
22981992119,1cyclictest606-21dbus-daemon11:25:011
2298199210,0cyclictest0-21swapper/111:53:571
22979992119,1cyclictest25858-21dpkg10:10:000
22979992119,1cyclictest0-21swapper/011:15:000
22979992119,1cyclictest0-21swapper/010:55:000
22979992118,2cyclictest5530-21latency_hist09:00:000
2297999210,20cyclictest18254-21dump-pmu-power09:55:010
2297999210,20cyclictest0-21swapper/010:28:580
2297999210,1cyclictest6173-21cron09:05:010
2297999210,0cyclictest151rcu_preempt12:04:000
22984992020,0cyclictest0-21swapper/311:58:573
22984992020,0cyclictest0-21swapper/310:48:583
22984992018,1cyclictest0-21swapper/308:05:003
22982992020,0cyclictest0-21swapper/212:13:582
22982992020,0cyclictest0-21swapper/210:08:592
22982992019,0cyclictest0-21swapper/210:28:582
22982992017,2cyclictest1493-21latency_hist10:25:002
2298299200,20cyclictest0-21swapper/212:23:582
2298299200,0cyclictest0-21swapper/209:50:012
2298299200,0cyclictest0-21swapper/209:50:012
22981992020,0cyclictest2402-21apt-get12:39:001
22981992019,0cyclictest0-21swapper/111:38:591
22979992020,0cyclictest21268-21apt-get11:08:590
22979992020,0cyclictest0-21swapper/011:29:000
22979992020,0cyclictest0-21swapper/011:03:580
22979992020,0cyclictest0-21swapper/010:23:580
22979992018,1cyclictest11094-21cron10:45:010
22979992017,2cyclictest1702-21turbostat08:30:010
2297999200,0cyclictest0-21swapper/012:23:580
22984991919,0cyclictest0-21swapper/311:03:583
22984991917,1cyclictest8921-21awk11:45:003
2298499190,18cyclictest0-21swapper/309:05:013
22982991919,0cyclictest20673-21perf10:00:012
22982991919,0cyclictest0-21swapper/211:58:572
22982991919,0cyclictest0-21swapper/210:48:582
22982991917,1cyclictest18874-21apt-get11:03:582
22982991917,1cyclictest12224-21perf09:25:002
22981991919,0cyclictest0-21swapper/110:54:001
22981991919,0cyclictest0-21swapper/110:03:591
22981991917,1cyclictest14168-21cron09:40:001
22979991919,0cyclictest0-21swapper/012:39:000
22979991917,1cyclictest14206-21grep09:40:000
22979991917,1cyclictest0-21swapper/010:04:070
22984991818,0cyclictest0-21swapper/310:43:593
22984991818,0cyclictest0-21swapper/309:53:543
22984991817,1cyclictest29008-21apt-get12:25:023
22984991816,1cyclictest313-21systemd-journal07:10:023
22984991816,1cyclictest18818-21apt-get09:58:593
22982991818,0cyclictest0-21swapper/210:43:592
22982991816,1cyclictest24653-21munin-run07:20:002
22982991815,2cyclictest13526-21idleruntime-cro09:35:002
2298299180,0cyclictest0-21swapper/211:08:592
2298199182,15cyclictest6850-21sed09:10:011
22981991818,0cyclictest22916-21apt-get07:10:021
22981991818,0cyclictest0-21swapper/111:08:591
22981991818,0cyclictest0-21swapper/111:03:581
22981991816,2cyclictest13488-21cron10:50:011
22981991816,1cyclictest9272-21apt-get10:43:591
22981991816,1cyclictest25844-21apt10:10:001
22979991818,0cyclictest32217-21perf08:15:010
22979991818,0cyclictest0-21swapper/012:33:590
22979991818,0cyclictest0-21swapper/012:25:020
22979991818,0cyclictest0-21swapper/011:58:570
22979991818,0cyclictest0-21swapper/008:25:010
22979991818,0cyclictest0-21swapper/007:45:030
22979991817,1cyclictest13230-21dpkg09:31:390
22979991817,1cyclictest0-21swapper/011:31:500
22984991717,0cyclictest0-21swapper/311:08:593
22984991715,1cyclictest5553-21turbostat.cron09:00:003
22984991715,1cyclictest24648-21wc07:20:003
22982991717,0cyclictest0-21swapper/212:39:002
22982991717,0cyclictest0-21swapper/211:29:002
22982991715,1cyclictest5557-21perf09:00:012
22982991715,1cyclictest20660-21apt-get10:00:022
22982991714,2cyclictest313-21systemd-journal12:05:002
22982991714,2cyclictest27283-21cron07:40:012
22981991717,0cyclictest0-21swapper/112:33:591
22981991717,0cyclictest0-21swapper/111:15:021
22981991715,1cyclictest722-21dump-pmu-power11:30:011
22979991717,0cyclictest0-21swapper/011:43:580
22984991616,0cyclictest0-21swapper/311:53:583
22984991616,0cyclictest0-21swapper/311:23:583
22984991616,0cyclictest0-21swapper/311:23:583
22984991616,0cyclictest0-21swapper/310:39:003
22984991616,0cyclictest0-21swapper/310:34:003
22984991615,1cyclictest1706-21perf08:30:013
22984991614,1cyclictest29660-21perf07:55:003
22984991614,1cyclictest0-21swapper/308:45:003
22982991616,0cyclictest0-21swapper/211:38:592
22982991616,0cyclictest0-21swapper/210:18:592
22982991616,0cyclictest0-21swapper/210:10:012
22982991614,1cyclictest611-21irqbalance07:21:572
22982991614,1cyclictest31576-21wc08:10:002
22982991614,1cyclictest25921-21munin-run07:30:012
22982991614,1cyclictest0-21swapper/211:44:072
22982991613,2cyclictest14819-21cron09:45:002
22981991614,1cyclictest4944-21latency_hist08:55:001
22981991614,1cyclictest0-21swapper/108:20:011
2298199160,15cyclictest1710-21apache208:00:071
22979991616,0cyclictest0-21swapper/008:45:510
22979991614,1cyclictest0-21swapper/009:59:010
22984991515,0cyclictest0-21swapper/312:20:023
22984991513,1cyclictest32258-21cat08:15:013
2298499150,1cyclictest27357-21munin-run07:40:013
2298499150,1cyclictest11237-21date09:20:013
2298499150,1cyclictest0-21swapper/310:29:013
2298499150,14cyclictest0-21swapper/312:14:013
2298499150,14cyclictest0-21swapper/310:57:073
2298499150,14cyclictest0-21swapper/307:44:353
22982991515,0cyclictest0-21swapper/207:10:022
22982991513,1cyclictest3647-21munin-run08:45:002
22981991513,1cyclictest29704-21latency_hist07:55:001
22981991513,1cyclictest24627-21basename07:20:001
22981991513,1cyclictest1081-21munin-run08:25:011
22981991513,1cyclictest0-21swapper/109:45:021
22981991513,1cyclictest0-21swapper/109:45:021
22981991513,1cyclictest0-21swapper/107:32:071
22979991515,0cyclictest0-21swapper/010:39:000
22979991515,0cyclictest0-21swapper/007:17:010
22979991513,1cyclictest606-21dbus-daemon10:35:010
22979991513,1cyclictest3644-21perf08:45:000
2297999150,1cyclictest0-21swapper/011:19:010
2297999150,14cyclictest25631-21sed12:19:070
2297999150,0cyclictest0-21swapper/009:42:170
22984991414,0cyclictest0-21swapper/308:16:163
22984991414,0cyclictest0-21swapper/307:26:403
22984991412,1cyclictest3917-21chrt08:45:503
2298499140,14cyclictest0-21swapper/312:39:173
2298499140,14cyclictest0-21swapper/309:36:423
2298499140,14cyclictest0-21swapper/309:25:343
2298499140,14cyclictest0-21swapper/308:52:393
2298499140,14cyclictest0-21swapper/308:31:103
2298499140,14cyclictest0-21swapper/307:30:063
2298499140,0cyclictest0-21swapper/308:08:183
22982991414,0cyclictest0-21swapper/208:48:352
22982991414,0cyclictest0-21swapper/208:23:052
2298299140,14cyclictest0-21swapper/211:20:092
2298299140,14cyclictest0-21swapper/211:20:092
2298299140,14cyclictest0-21swapper/209:05:122
2298299140,14cyclictest0-21swapper/209:00:192
2298299140,14cyclictest0-21swapper/208:53:472
2298299140,14cyclictest0-21swapper/208:30:082
2298299140,14cyclictest0-21swapper/208:17:152
2298299140,14cyclictest0-21swapper/208:10:092
2298299140,14cyclictest0-21swapper/208:00:132
2298299140,14cyclictest0-21swapper/207:50:222
2298299140,0cyclictest0-21swapper/210:55:112
2298299140,0cyclictest0-21swapper/209:25:352
2298299140,0cyclictest0-21swapper/207:46:442
2298299140,0cyclictest0-21swapper/207:30:052
22981991414,0cyclictest0-21swapper/111:10:221
22981991414,0cyclictest0-21swapper/109:31:551
22981991414,0cyclictest0-21swapper/108:36:061
2298199140,14cyclictest0-21swapper/110:20:311
2298199140,14cyclictest0-21swapper/110:17:091
2298199140,14cyclictest0-21swapper/108:55:181
2298199140,14cyclictest0-21swapper/108:42:411
2298199140,14cyclictest0-21swapper/107:56:091
2298199140,14cyclictest0-21swapper/107:40:261
2298199140,14cyclictest0-21swapper/107:20:191
2298199140,0cyclictest0-21swapper/112:06:461
2298199140,0cyclictest0-21swapper/109:40:241
2298199140,0cyclictest0-21swapper/109:16:461
2298199140,0cyclictest0-21swapper/108:08:041
2298199140,0cyclictest0-21swapper/107:45:401
2298199140,0cyclictest0-21swapper/107:35:111
2298199140,0cyclictest0-21swapper/107:25:311
22979991414,0cyclictest0-21swapper/010:47:170
22979991414,0cyclictest0-21swapper/010:15:180
22979991414,0cyclictest0-21swapper/008:36:090
22979991414,0cyclictest0-21swapper/008:15:310
22979991414,0cyclictest0-21swapper/007:55:250
22979991414,0cyclictest0-21swapper/007:21:380
2297999140,14cyclictest0-21swapper/012:10:240
2297999140,14cyclictest0-21swapper/012:05:090
2297999140,14cyclictest0-21swapper/009:20:290
2297999140,14cyclictest0-21swapper/009:16:120
2297999140,14cyclictest0-21swapper/009:05:220
2297999140,14cyclictest0-21swapper/008:53:250
2297999140,14cyclictest0-21swapper/008:00:060
2297999140,14cyclictest0-21swapper/007:50:090
2297999140,14cyclictest0-21swapper/007:41:000
2297999140,14cyclictest0-21swapper/007:35:210
2297999140,14cyclictest0-21swapper/007:30:270
2297999140,14cyclictest0-21swapper/007:25:120
2297999140,0cyclictest0-21swapper/011:50:080
2297999140,0cyclictest0-21swapper/008:08:010
2297999140,0cyclictest0-21swapper/007:10:110
22984991313,0cyclictest0-21swapper/311:45:243
22984991313,0cyclictest0-21swapper/308:21:283
22984991313,0cyclictest0-21swapper/307:55:573
2298499131,11cyclictest17117-21apt-get12:04:003
22982991313,0cyclictest0-21swapper/212:31:492
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional