You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-12 - 22:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Wed Aug 12, 2026 12:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29952199184,11sleep10-21swapper/107:07:191
30902190155,13sleep00-21swapper/007:08:310
29972190174,12sleep30-21swapper/307:07:213
28792161143,13sleep20-21swapper/207:05:472
228822420,0sleep00-21swapper/011:15:270
172582410,0sleep00-21swapper/009:50:590
339999102,4cyclictest6477-21idleruntime-cro12:30:010
339999100,1cyclictest32677-21ssh11:37:010
33999991,5cyclictest963-21taskset08:05:550
33999990,6cyclictest10102-21chrt11:09:550
33999990,1cyclictest9482-21ssh11:58:270
33999990,1cyclictest26493-21ssh09:40:030
33999990,1cyclictest26028-21ssh12:06:140
33999990,1cyclictest17823-21interrupts12:35:140
33999990,1cyclictest13237-21ssh11:43:590
33999990,1cyclictest12944-21ssh12:16:010
33999990,1cyclictest12395-21ssh10:54:410
33999990,0cyclictest6367-21ssh10:02:030
33999990,0cyclictest25096-21ssh09:39:190
24660290,0sleep30-21swapper/308:55:133
33999980,5cyclictest29473-21ssh10:14:100
33999980,1cyclictest32363-21/usr/sbin/munin11:20:200
33999980,1cyclictest31427-21munin-run09:10:010
33999980,1cyclictest25011-21ssh10:27:530
33999980,1cyclictest24758-21perl07:50:150
33999980,1cyclictest24681-21munin-run11:50:000
33999980,1cyclictest15846-21ssh10:06:470
33999980,1cyclictest15675-21ls10:40:020
33999980,1cyclictest15242-21ssh11:28:390
33999980,1cyclictest0-21swapper/011:50:120
33999980,0cyclictest7769-21ssh09:46:180
33999980,0cyclictest5706-21ssh10:18:150
33999980,0cyclictest23589-21apt-get11:00:140
33999980,0cyclictest18036-21ssh10:56:590
33999980,0cyclictest0-21swapper/010:46:530
33999980,0cyclictest0-21swapper/007:25:200
33999971,5cyclictest9253-21ssh09:15:100
33999970,1cyclictest8979-21idleruntime-cro07:20:020
33999970,1cyclictest8742-21sh08:25:010
33999970,1cyclictest7754-21sed09:30:150
33999970,1cyclictest4765-21ntp_states07:10:190
33999970,1cyclictest4155-21ssh09:12:030
33999970,1cyclictest32311-21ssh12:10:080
33999970,1cyclictest29688-21perl08:00:150
33999970,1cyclictest29210-21grep10:30:110
33999970,1cyclictest28797-21awk08:00:000
33999970,1cyclictest27316-21grep09:00:120
33999970,1cyclictest25710-21cat08:55:200
33999970,1cyclictest23985-21sed07:50:010
33999970,1cyclictest23783-21apt08:55:010
33999970,1cyclictest19594-21expr09:20:140
33999970,1cyclictest19448-21ssh12:20:020
33999970,1cyclictest18655-21awk08:45:010
33999970,1cyclictest18278-21ssh10:40:220
33999970,1cyclictest15825-21taskset08:36:020
33999970,1cyclictest11464-21latency_hist07:25:020
33999970,1cyclictest11324-21diskstats11:10:120
33999970,0cyclictest9081-21apt-get10:20:140
33999970,0cyclictest9081-21apt-get10:20:140
33999970,0cyclictest29307-21apt-get09:25:120
33999970,0cyclictest19118-21apt-get07:40:120
33999970,0cyclictest18099-21ssh11:30:120
33999970,0cyclictest16628-21apt-get07:35:100
33999970,0cyclictest12750-21apt-get12:00:130
33999970,0cyclictest0-21swapper/012:30:120
33999970,0cyclictest0-21swapper/009:57:500
34139960,6cyclictest0-21swapper/310:16:473
33999960,1cyclictest8978-21apt-get08:25:120
33999960,1cyclictest4534-21df08:15:140
33999960,1cyclictest14663-21expr07:30:130
33999960,1cyclictest0-21swapper/008:45:010
33999960,0cyclictest1532-21apt-get08:10:110
33999960,0cyclictest11446-21apt-get08:30:110
34139955,0cyclictest30065-21ssh11:03:123
34139955,0cyclictest24155-21kworker/3:112:25:373
34139955,0cyclictest0-21swapper/312:06:123
34139954,1cyclictest18876-21kworker/3:208:30:293
34139950,5cyclictest0-21swapper/309:23:413
34139950,5cyclictest0-21swapper/309:16:593
34139950,4cyclictest28745-21apt-get09:05:013
34139950,0cyclictest0-21swapper/309:54:493
34089955,0cyclictest0-21swapper/211:27:392
34089950,5cyclictest0-21swapper/211:17:022
34089950,5cyclictest0-21swapper/209:13:302
34089950,0cyclictest0-21swapper/211:56:182
34039951,2cyclictest0-21swapper/111:10:111
34039950,5cyclictest0-21swapper/109:48:491
34039950,0cyclictest0-21swapper/110:33:301
26363250,0sleep10-21swapper/112:23:181
34139944,0cyclictest18876-21kworker/3:209:37:393
34139944,0cyclictest18876-21kworker/3:209:04:043
34139944,0cyclictest18876-21kworker/3:208:08:073
34139944,0cyclictest18876-21kworker/3:207:56:563
34139944,0cyclictest18876-21kworker/3:207:45:443
34139944,0cyclictest18876-21kworker/3:207:23:203
34139944,0cyclictest18876-21kworker/3:207:12:073
34139944,0cyclictest0-21swapper/312:31:053
34139944,0cyclictest0-21swapper/310:33:213
34139944,0cyclictest0-21swapper/308:40:003
34139943,1cyclictest16936-21diskstats08:40:143
34139942,2cyclictest31446-21ssh11:36:153
34139942,1cyclictest802-21snmpd07:35:173
34139942,1cyclictest2188-21ssh11:21:373
34139940,4cyclictest5530-21python08:15:203
34139940,4cyclictest3973-21ntp_states11:55:153
34139940,4cyclictest31419-21diskmemload12:13:103
34139940,4cyclictest0-21swapper/312:35:093
34139940,4cyclictest0-21swapper/312:16:253
34139940,4cyclictest0-21swapper/311:51:413
34139940,4cyclictest0-21swapper/311:45:113
34139940,4cyclictest0-21swapper/311:40:113
34139940,4cyclictest0-21swapper/311:27:103
34139940,4cyclictest0-21swapper/311:18:543
34139940,4cyclictest0-21swapper/311:05:123
34139940,4cyclictest0-21swapper/310:56:323
34139940,4cyclictest0-21swapper/310:35:553
34139940,4cyclictest0-21swapper/310:25:543
34139940,4cyclictest0-21swapper/309:45:133
34139940,4cyclictest0-21swapper/309:43:383
34139940,4cyclictest0-21swapper/309:33:593
34139940,4cyclictest0-21swapper/309:26:383
34139940,4cyclictest0-21swapper/309:10:113
34139940,4cyclictest0-21swapper/307:40:113
34139940,3cyclictest8743-21latency_hist08:25:013
34139940,3cyclictest6659-21grep07:15:023
34139940,3cyclictest32552-21sshd10:48:093
34139940,3cyclictest31409-21sed08:05:003
34139940,3cyclictest24310-21sh10:10:533
34139940,3cyclictest21314-21latency_hist08:50:013
34139940,3cyclictest17399-21latency_hist11:30:013
34139940,3cyclictest16943-21perl10:40:143
34139940,3cyclictest12887-21/usr/sbin/munin12:00:143
34139940,3cyclictest10477-21ssh11:10:003
34139940,3cyclictest10279-21memory10:20:203
34139940,3cyclictest10279-21memory10:20:193
34139940,3cyclictest0-21swapper/307:50:123
34139940,1cyclictest2626-21memory08:10:163
34139940,0cyclictest0-21swapper/310:54:453
34089944,0cyclictest0-21swapper/211:47:092
34089944,0cyclictest0-21swapper/210:30:542
34089944,0cyclictest0-21swapper/210:01:052
34089942,1cyclictest20764-21ntp_states09:20:182
34089941,3cyclictest24991-21awk08:55:162
34089941,3cyclictest22350-21sh09:54:142
34089940,4cyclictest57150irq/125-eth011:34:032
34089940,4cyclictest4244-21/usr/sbin/munin09:45:202
34089940,4cyclictest3464-21ssh12:28:052
34089940,4cyclictest25248-21wc09:55:172
34089940,4cyclictest17355-21df_inode09:35:142
34089940,4cyclictest0-21swapper/212:35:572
34089940,4cyclictest0-21swapper/212:30:112
34089940,4cyclictest0-21swapper/212:20:252
34089940,4cyclictest0-21swapper/212:15:122
34089940,4cyclictest0-21swapper/212:10:132
34089940,4cyclictest0-21swapper/212:05:412
34089940,4cyclictest0-21swapper/212:00:122
34089940,4cyclictest0-21swapper/211:50:562
34089940,4cyclictest0-21swapper/211:40:042
34089940,4cyclictest0-21swapper/211:05:112
34089940,4cyclictest0-21swapper/211:00:002
34089940,4cyclictest0-21swapper/210:59:502
34089940,4cyclictest0-21swapper/210:48:532
34089940,4cyclictest0-21swapper/210:40:122
34089940,4cyclictest0-21swapper/210:15:122
34089940,4cyclictest0-21swapper/210:10:102
34089940,4cyclictest0-21swapper/210:08:542
34089940,3cyclictest5005-21irqstats08:15:162
34089940,3cyclictest29719-21sensors_temp11:35:202
34089940,3cyclictest18642-21latency_hist08:45:002
34089940,3cyclictest17125-21sh09:18:582
34089940,3cyclictest14838-21if_eth008:35:142
34089940,3cyclictest13212-21sh09:33:052
34089940,3cyclictest10459-21sh10:20:212
34089940,3cyclictest10459-21sh10:20:212
34089940,3cyclictest0-21swapper/211:20:112
34089940,2cyclictest30731-21ssh09:25:182
34089940,1cyclictest26501-21/usr/sbin/munin09:00:182
34089940,1cyclictest21618-21cut07:45:122
34089940,1cyclictest21543-21/usr/sbin/munin08:50:132
34089940,1cyclictest10583-21head07:20:192
34039944,0cyclictest0-21swapper/111:26:451
34039941,2cyclictest0-21swapper/112:30:111
34039941,2cyclictest0-21swapper/111:35:121
34039941,2cyclictest0-21swapper/111:20:121
34039941,2cyclictest0-21swapper/111:15:121
34039941,2cyclictest0-21swapper/110:50:131
34039941,2cyclictest0-21swapper/110:15:121
34039941,2cyclictest0-21swapper/109:35:131
34039941,2cyclictest0-21swapper/109:25:111
34039941,2cyclictest0-21swapper/109:20:121
34039941,2cyclictest0-21swapper/109:15:111
34039941,2cyclictest0-21swapper/108:40:131
34039941,2cyclictest0-21swapper/108:20:131
34039941,2cyclictest0-21swapper/108:10:121
34039941,2cyclictest0-21swapper/107:35:111
34039941,1cyclictest0-21swapper/110:55:121
34039941,1cyclictest0-21swapper/110:45:121
34039940,4cyclictest0-21swapper/108:55:501
34039940,2cyclictest0-21swapper/112:35:101
34039940,0cyclictest0-21swapper/109:11:351
34039940,0cyclictest0-21swapper/109:05:371
34139932,1cyclictest11279-21ssh10:05:033
34139930,3cyclictest23843-21ssh09:55:013
34139930,3cyclictest0-21swapper/312:20:063
34139930,3cyclictest0-21swapper/310:00:063
34139930,3cyclictest0-21swapper/308:45:013
34139930,3cyclictest0-21swapper/308:25:123
34139930,3cyclictest0-21swapper/307:30:113
34139930,3cyclictest0-21swapper/307:25:133
34089933,0cyclictest0-21swapper/208:45:002
34089932,1cyclictest802-21snmpd07:55:032
34089931,2cyclictest57150irq/125-eth010:50:132
34089931,1cyclictest0-21swapper/210:25:132
34089931,1cyclictest0-21swapper/208:25:132
34089931,1cyclictest0-21swapper/208:05:122
34089931,1cyclictest0-21swapper/207:30:132
34089930,3cyclictest7708-21awk07:15:152
34089930,3cyclictest26555-21rm09:40:052
34089930,3cyclictest11690-21/usr/sbin/munin07:25:132
34089930,3cyclictest0-21swapper/211:10:092
34089930,3cyclictest0-21swapper/210:35:042
34089930,3cyclictest0-21swapper/209:05:012
34089930,3cyclictest0-21swapper/208:30:122
34089930,3cyclictest0-21swapper/208:20:132
34089930,3cyclictest0-21swapper/208:10:112
34089930,3cyclictest0-21swapper/208:00:132
34089930,3cyclictest0-21swapper/207:50:112
34089930,3cyclictest0-21swapper/207:40:112
34089930,3cyclictest0-21swapper/207:35:012
34089930,3cyclictest0-21swapper/207:10:112
34039933,0cyclictest0-21swapper/111:50:191
34039933,0cyclictest0-21swapper/111:06:131
34039932,1cyclictest0-21swapper/107:20:121
34039931,1cyclictest0-21swapper/112:25:101
34039931,1cyclictest0-21swapper/112:15:121
34039931,1cyclictest0-21swapper/112:10:121
34039931,1cyclictest0-21swapper/112:05:151
34039931,1cyclictest0-21swapper/112:00:121
34039931,1cyclictest0-21swapper/111:45:121
34039931,1cyclictest0-21swapper/111:40:111
34039931,1cyclictest0-21swapper/111:30:011
34039931,1cyclictest0-21swapper/111:00:001
34039931,1cyclictest0-21swapper/110:20:131
34039931,1cyclictest0-21swapper/110:20:131
34039931,1cyclictest0-21swapper/110:00:131
34039931,1cyclictest0-21swapper/109:55:111
34039931,1cyclictest0-21swapper/109:50:111
34039931,1cyclictest0-21swapper/109:30:131
34039931,1cyclictest0-21swapper/108:30:111
34039931,1cyclictest0-21swapper/108:25:121
34039931,1cyclictest0-21swapper/108:15:121
34039931,1cyclictest0-21swapper/108:05:131
34039931,1cyclictest0-21swapper/108:00:131
34039931,1cyclictest0-21swapper/107:55:091
34039931,1cyclictest0-21swapper/107:45:121
34039931,1cyclictest0-21swapper/107:35:011
34039931,1cyclictest0-21swapper/107:25:121
34039930,3cyclictest0-21swapper/107:13:071
34039930,2cyclictest16241-21chrt10:07:031
34039930,2cyclictest10550-21taskset10:36:441
34039930,2cyclictest0-21swapper/110:40:111
34039930,2cyclictest0-21swapper/110:10:111
34039930,2cyclictest0-21swapper/109:40:121
34039930,2cyclictest0-21swapper/108:35:121
34039930,2cyclictest0-21swapper/107:15:101
34039921,1cyclictest0-21swapper/111:55:091
34039921,1cyclictest0-21swapper/107:50:111
34039921,1cyclictest0-21swapper/107:40:111
34039920,2cyclictest0-21swapper/108:50:111
34039920,1cyclictest0-21swapper/110:25:141
34039920,1cyclictest0-21swapper/109:00:111
34039920,1cyclictest0-21swapper/108:45:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional