You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-17 - 23:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Wed Jun 17, 2026 12:44:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
282102198182,11sleep10-21swapper/107:09:361
282242191175,12sleep00-21swapper/007:09:470
278992191175,11sleep30-21swapper/307:05:373
260202182163,14sleep20-21swapper/207:05:072
4182820,0sleep20-21swapper/209:14:152
212832480,0sleep10-21swapper/109:40:081
81172430,0sleep30-21swapper/312:11:593
70932410,0sleep10-21swapper/111:55:191
30095290,0sleep30-21swapper/310:00:043
284059982,3cyclictest9029-21awk07:35:000
284059982,3cyclictest2899-21idleruntime-cro12:10:000
284129970,7cyclictest0-21swapper/212:15:102
284129960,6cyclictest0-21swapper/210:30:112
284089962,2cyclictest0-21swapper/110:25:111
284089961,3cyclictest0-21swapper/109:55:101
284179955,0cyclictest31211-21kworker/3:011:15:333
284179955,0cyclictest31211-21kworker/3:009:12:253
284179955,0cyclictest0-21swapper/310:57:313
284179955,0cyclictest0-21swapper/310:33:063
284179954,1cyclictest17353-21grep08:55:123
284179950,5cyclictest0-21swapper/312:36:193
284179950,4cyclictest20214-21hddtemp_smartct11:30:143
284179950,3cyclictest0-21swapper/312:06:093
284179950,0cyclictest0-21swapper/308:10:203
284129955,0cyclictest0-21swapper/212:20:142
284129951,3cyclictest802-21snmpd11:37:202
284129950,4cyclictest0-21swapper/212:30:092
284129950,4cyclictest0-21swapper/208:40:112
284129950,0cyclictest0-21swapper/210:13:222
284089952,2cyclictest0-21swapper/109:00:121
284089951,3cyclictest0-21swapper/110:05:121
284089951,3cyclictest0-21swapper/107:40:111
284089951,2cyclictest0-21swapper/111:15:111
284089951,2cyclictest0-21swapper/110:45:121
284059950,5cyclictest0-21swapper/012:27:270
284059950,5cyclictest0-21swapper/010:38:020
284059950,5cyclictest0-21swapper/009:41:170
284059950,2cyclictest81rcu_preempt09:55:110
284059950,1cyclictest0-21swapper/012:14:030
284059950,1cyclictest0-21swapper/011:06:060
284179944,0cyclictest40-21ksoftirqd/310:45:113
284179944,0cyclictest0-21swapper/311:07:343
284179944,0cyclictest0-21swapper/310:08:473
284179943,1cyclictest391ktimersoftd/309:31:013
284179942,2cyclictest40-21ksoftirqd/311:25:203
284179942,1cyclictest9703-21ssh10:21:073
284179942,1cyclictest802-21snmpd08:19:033
284179941,3cyclictest18389-21cat11:45:133
284179940,4cyclictest6122-21ssh11:23:273
284179940,4cyclictest25981-21diskmemload09:41:523
284179940,4cyclictest24100-21/usr/sbin/munin08:05:163
284179940,4cyclictest1278-21ssh12:25:113
284179940,4cyclictest0-21swapper/312:30:093
284179940,4cyclictest0-21swapper/312:24:113
284179940,4cyclictest0-21swapper/312:15:593
284179940,4cyclictest0-21swapper/311:55:023
284179940,4cyclictest0-21swapper/310:36:103
284179940,4cyclictest0-21swapper/309:55:403
284179940,4cyclictest0-21swapper/308:00:103
284179940,4cyclictest0-21swapper/307:47:303
284179940,3cyclictest7771-21df_inode11:40:123
284179940,3cyclictest6162-21sh09:16:203
284179940,3cyclictest5395-21memory08:30:163
284179940,3cyclictest4825-21df07:25:133
284179940,3cyclictest28392-21sh11:02:203
284179940,3cyclictest2567-21sh10:50:063
284179940,3cyclictest2400-21fschecks_count07:20:133
284179940,3cyclictest23718-21perl09:25:143
284179940,3cyclictest22620-21uname09:05:173
284179940,3cyclictest19699-21ntp_states10:10:153
284179940,3cyclictest18106-21awk07:50:173
284179940,3cyclictest17951-21sh12:00:323
284179940,3cyclictest17633-21irqstats10:25:163
284179940,3cyclictest16001-21sh09:37:063
284179940,3cyclictest15943-21wc10:40:143
284179940,3cyclictest13336-21/usr/sbin/munin09:20:143
284179940,3cyclictest11154-21users08:40:563
284179940,3cyclictest10437-21perl09:50:133
284179940,1cyclictest9242-21/usr/sbin/munin07:35:193
284179940,1cyclictest31764-21/usr/sbin/munin07:15:163
284179940,1cyclictest29976-21awk10:15:173
284179940,1cyclictest29487-21/usr/sbin/munin11:35:163
284179940,1cyclictest27504-21/usr/sbin/munin11:50:173
284179940,1cyclictest19138-21/usr/sbin/munin07:55:133
284179940,1cyclictest1837-21/usr/sbin/munin08:25:203
284179940,1cyclictest15477-21ntp_states08:50:163
284129944,0cyclictest0-21swapper/211:55:562
284129944,0cyclictest0-21swapper/211:21:092
284129944,0cyclictest0-21swapper/208:20:272
284129944,0cyclictest0-21swapper/208:13:352
284129940,4cyclictest68550irq/127-eth1-Tx09:40:102
284129940,4cyclictest25892-21ssh09:25:502
284129940,4cyclictest2458-21ps11:05:192
284129940,4cyclictest0-21swapper/212:35:472
284129940,4cyclictest0-21swapper/212:10:102
284129940,4cyclictest0-21swapper/211:50:132
284129940,4cyclictest0-21swapper/211:40:112
284129940,4cyclictest0-21swapper/211:30:122
284129940,4cyclictest0-21swapper/211:10:132
284129940,4cyclictest0-21swapper/210:55:092
284129940,4cyclictest0-21swapper/210:47:452
284129940,4cyclictest0-21swapper/210:35:142
284129940,4cyclictest0-21swapper/210:18:582
284129940,4cyclictest0-21swapper/210:05:132
284129940,4cyclictest0-21swapper/209:55:102
284129940,4cyclictest0-21swapper/209:38:252
284129940,4cyclictest0-21swapper/209:33:552
284129940,4cyclictest0-21swapper/209:20:122
284129940,4cyclictest0-21swapper/209:15:032
284129940,4cyclictest0-21swapper/208:45:142
284129940,3cyclictest9449-21ssh09:50:012
284129940,3cyclictest9145-21ssh11:25:102
284129940,3cyclictest7916-21cat08:35:152
284129940,3cyclictest6305-21rm09:48:222
284129940,3cyclictest5850-21ssh12:26:522
284129940,3cyclictest4307-21apt-get08:30:122
284129940,3cyclictest4156-21ntp_states10:50:182
284129940,3cyclictest3134-21ssh10:02:172
284129940,3cyclictest3044-21ls12:10:012
284129940,3cyclictest17108-21ssh11:45:002
284129940,3cyclictest1641-21cut07:20:002
284129940,3cyclictest15279-21ssh12:00:002
284129940,3cyclictest14205-21apt-get08:50:112
284129940,3cyclictest0-21swapper/208:55:092
284129940,1cyclictest4830-21df07:25:132
284129940,0cyclictest0-21swapper/210:25:522
284129940,0cyclictest0-21swapper/209:08:192
284089941,2cyclictest0-21swapper/112:35:111
284089941,2cyclictest0-21swapper/112:25:101
284089941,2cyclictest0-21swapper/112:10:101
284089941,2cyclictest0-21swapper/111:50:111
284089941,2cyclictest0-21swapper/111:45:101
284089941,2cyclictest0-21swapper/111:30:111
284089941,2cyclictest0-21swapper/111:20:091
284089941,2cyclictest0-21swapper/111:05:111
284089941,2cyclictest0-21swapper/110:20:121
284089941,2cyclictest0-21swapper/109:50:121
284089941,2cyclictest0-21swapper/109:25:121
284089941,2cyclictest0-21swapper/109:05:111
284089941,2cyclictest0-21swapper/108:50:111
284089941,2cyclictest0-21swapper/108:40:111
284089941,2cyclictest0-21swapper/108:00:111
284089941,2cyclictest0-21swapper/107:30:131
284089941,2cyclictest0-21swapper/107:25:121
284089941,2cyclictest0-21swapper/107:20:111
284089941,1cyclictest0-21swapper/110:35:131
284089940,4cyclictest0-21swapper/110:01:001
284089940,3cyclictest0-21swapper/109:35:121
284089940,2cyclictest0-21swapper/111:00:121
284089940,0cyclictest0-21swapper/112:16:111
284059944,0cyclictest3-21ksoftirqd/011:55:120
284059944,0cyclictest3-21ksoftirqd/010:40:090
284059944,0cyclictest3-21ksoftirqd/007:30:000
284059944,0cyclictest0-21swapper/012:16:140
284059944,0cyclictest0-21swapper/011:49:020
284059944,0cyclictest0-21swapper/011:14:420
284059944,0cyclictest0-21swapper/010:53:090
284059944,0cyclictest0-21swapper/010:28:350
284059943,1cyclictest3-21ksoftirqd/009:25:120
284059943,1cyclictest3-21ksoftirqd/007:40:120
284059943,1cyclictest23419-21unixbench_multi08:00:190
284059941,2cyclictest0-21swapper/008:35:110
284059940,4cyclictest31366-21perf08:20:000
284059940,4cyclictest11112-21ssh09:35:120
284059940,4cyclictest0-21swapper/011:40:100
284059940,4cyclictest0-21swapper/011:25:110
284059940,3cyclictest9405-21find09:50:010
284059940,3cyclictest922-21date12:25:010
284059940,3cyclictest31189-21sed07:15:000
284059940,3cyclictest22941-21ntp_states12:35:170
284059940,3cyclictest20682-21smartctl09:00:200
284059940,3cyclictest19298-21apt11:30:110
284059940,3cyclictest18273-21ssh10:10:090
284059940,2cyclictest81rcu_preempt11:55:010
284059940,0cyclictest0-21swapper/012:03:440
284059940,0cyclictest0-21swapper/010:18:580
2183240,0sleep30-21swapper/309:45:513
284179931,1cyclictest802-21snmpd07:10:103
284179930,3cyclictest10826-21sh11:10:033
284179930,3cyclictest0-21swapper/309:00:133
284179930,3cyclictest0-21swapper/308:45:133
284179930,3cyclictest0-21swapper/308:35:123
284179930,3cyclictest0-21swapper/308:20:023
284179930,3cyclictest0-21swapper/307:40:113
284179930,3cyclictest0-21swapper/307:30:083
284129931,1cyclictest802-21snmpd07:35:032
284129930,3cyclictest29045-21apt-get08:15:122
284129930,3cyclictest24103-21apt-get08:05:132
284129930,3cyclictest14617-21ssh10:40:062
284129930,3cyclictest0-21swapper/211:15:022
284129930,3cyclictest0-21swapper/211:00:102
284129930,3cyclictest0-21swapper/209:00:112
284129930,3cyclictest0-21swapper/208:25:002
284129930,3cyclictest0-21swapper/208:00:102
284129930,3cyclictest0-21swapper/207:55:102
284129930,3cyclictest0-21swapper/207:50:112
284129930,3cyclictest0-21swapper/207:45:112
284129930,3cyclictest0-21swapper/207:40:102
284129930,3cyclictest0-21swapper/207:30:122
284129930,3cyclictest0-21swapper/207:20:122
284129930,3cyclictest0-21swapper/207:10:032
284129930,2cyclictest6289-21ssh10:20:092
284089931,2cyclictest0-21swapper/112:20:121
284089931,2cyclictest0-21swapper/110:30:111
284089931,1cyclictest0-21swapper/112:00:111
284089931,1cyclictest0-21swapper/111:40:101
284089931,1cyclictest0-21swapper/111:25:091
284089931,1cyclictest0-21swapper/111:10:111
284089931,1cyclictest0-21swapper/110:40:091
284089931,1cyclictest0-21swapper/109:10:111
284089931,1cyclictest0-21swapper/108:55:101
284089931,1cyclictest0-21swapper/108:35:101
284089931,1cyclictest0-21swapper/108:15:111
284089931,1cyclictest0-21swapper/107:55:111
284089931,1cyclictest0-21swapper/107:50:131
284089931,1cyclictest0-21swapper/107:10:121
284089930,3cyclictest0-21swapper/108:05:091
284089930,3cyclictest0-21swapper/107:19:461
284089930,2cyclictest16845-21chrt09:21:351
284089930,2cyclictest0-21swapper/112:05:111
284089930,2cyclictest0-21swapper/111:35:111
284089930,2cyclictest0-21swapper/110:55:091
284089930,2cyclictest0-21swapper/110:50:121
284089930,2cyclictest0-21swapper/110:15:121
284089930,2cyclictest0-21swapper/109:30:131
284089930,2cyclictest0-21swapper/108:25:131
284089930,2cyclictest0-21swapper/107:45:111
284059932,1cyclictest32727-21cat09:45:150
284059932,1cyclictest3-21ksoftirqd/008:25:190
284059932,1cyclictest26701-21ssh10:30:100
284059932,1cyclictest21847-21tune2fs11:15:130
284059931,2cyclictest3-21ksoftirqd/011:35:120
284059931,1cyclictest31509-21aten2_r5power_v11:20:110
284059931,1cyclictest29076-21fschecks_count07:10:140
284059931,1cyclictest0-21swapper/009:20:120
284059931,1cyclictest0-21swapper/008:50:110
284059931,1cyclictest0-21swapper/008:10:120
284059930,3cyclictest7569-21ssh10:20:160
284059930,3cyclictest5396-21memory08:30:170
284059930,3cyclictest2669-21hddtemp_smartct07:20:140
284059930,3cyclictest25700-21perl10:45:130
284059930,3cyclictest22102-21expr09:05:140
284059930,3cyclictest17197-21df_inode07:50:120
284059930,3cyclictest13258-21smartctl08:45:210
284059930,3cyclictest0-21swapper/011:00:070
284059930,3cyclictest0-21swapper/010:55:090
284059930,3cyclictest0-21swapper/010:05:010
284059930,3cyclictest0-21swapper/010:00:070
284059930,3cyclictest0-21swapper/009:15:090
284059930,3cyclictest0-21swapper/009:10:110
284059930,3cyclictest0-21swapper/008:55:090
284059930,3cyclictest0-21swapper/008:40:050
284059930,3cyclictest0-21swapper/008:05:020
284059930,3cyclictest0-21swapper/007:55:100
284059930,3cyclictest0-21swapper/007:45:110
284059930,3cyclictest0-21swapper/007:35:140
284059930,2cyclictest11326-21ssh12:30:090
284059930,2cyclictest0-21swapper/009:30:150
284059930,0cyclictest0-21swapper/008:23:170
284089921,1cyclictest0-21swapper/108:10:121
284089920,1cyclictest4296-21taskset08:30:051
284089920,1cyclictest0-21swapper/112:30:081
284089920,1cyclictest0-21swapper/110:10:011
284089920,1cyclictest0-21swapper/109:45:101
284089920,1cyclictest0-21swapper/109:15:021
284089920,1cyclictest0-21swapper/108:45:141
284089920,1cyclictest0-21swapper/108:20:121
284089920,1cyclictest0-21swapper/107:35:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional