You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-05 - 07:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Fri Jun 05, 2026 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
241052207193,10sleep10-21swapper/119:09:201
219302186170,11sleep30-21swapper/319:05:063
240642182167,11sleep00-21swapper/019:08:470
238522170153,12sleep20-21swapper/219:06:042
324432480,0sleep20-21swapper/223:38:192
308742430,0sleep10-21swapper/100:09:531
87922380,0sleep10-21swapper/121:51:011
17352140,0sleep31715-21awk19:25:183
58682100,0sleep20-21swapper/222:37:262
2432799103,3cyclictest29205-21munin-run00:25:000
243279993,3cyclictest2753-21sendmail-msp23:40:010
243429982,1cyclictest8458-21idleruntime-cro22:55:003
243429982,1cyclictest774-21readlink00:10:183
243429982,1cyclictest13384-21grep19:50:143
243429972,1cyclictest28592-21tune2fs21:45:163
243429972,1cyclictest17100-21ssh22:10:523
243429972,0cyclictest23239-21grep20:10:113
243429971,1cyclictest32192-21ssh00:25:353
243429971,1cyclictest24385-21ssh22:30:203
243429971,1cyclictest10899-21cat22:55:213
243429971,1cyclictest0-21swapper/322:25:123
243379970,6cyclictest0-21swapper/222:20:122
243279971,3cyclictest17312-21munin-run20:00:010
243429962,0cyclictest24197-21rm22:15:043
243429962,0cyclictest20675-21rm23:00:183
243429961,1cyclictest22499-21ssh00:20:513
243429961,1cyclictest12670-21ssh00:16:093
243429960,2cyclictest0-21swapper/322:45:163
243429955,0cyclictest0-21swapper/300:30:253
243429955,0cyclictest0-21swapper/300:30:243
243429950,5cyclictest0-21swapper/323:49:483
243429950,5cyclictest0-21swapper/322:43:203
243429950,5cyclictest0-21swapper/321:23:533
243429950,0cyclictest0-21swapper/323:50:323
243379950,5cyclictest15675-21ssh23:45:282
243379950,4cyclictest7590-21munin-run20:45:012
243379950,0cyclictest0-21swapper/220:45:192
243329951,3cyclictest0-21swapper/123:40:111
243329951,3cyclictest0-21swapper/120:30:111
243329951,2cyclictest0-21swapper/122:25:121
243329951,2cyclictest0-21swapper/122:15:111
243329951,2cyclictest0-21swapper/121:30:121
243329950,5cyclictest0-21swapper/123:49:591
243329950,5cyclictest0-21swapper/123:00:491
243329950,5cyclictest0-21swapper/122:41:361
243329950,5cyclictest0-21swapper/121:20:071
243329950,5cyclictest0-21swapper/100:03:491
243279953,1cyclictest3422-21munin-run22:05:000
243279951,4cyclictest25048-21munin-run23:35:000
243279950,5cyclictest5073-21munin-run21:50:010
243279950,5cyclictest0-21swapper/021:40:210
243279950,5cyclictest0-21swapper/021:30:120
243279950,5cyclictest0-21swapper/000:32:470
243279950,5cyclictest0-21swapper/000:32:470
243279950,4cyclictest19192-21ssh23:00:120
243279950,4cyclictest0-21swapper/020:55:100
243429944,0cyclictest0-21swapper/323:25:043
243429944,0cyclictest0-21swapper/321:13:243
243429943,1cyclictest10647-21grep20:50:113
243429942,1cyclictest2826-21latency_hist20:35:013
243429941,3cyclictest1176-21fschecks_time22:35:143
243429941,2cyclictest0-21swapper/321:05:023
243429940,4cyclictest7659-21apt-get19:40:113
243429940,4cyclictest0-21swapper/323:37:213
243429940,4cyclictest0-21swapper/323:30:113
243429940,4cyclictest0-21swapper/323:20:113
243429940,4cyclictest0-21swapper/323:16:213
243429940,4cyclictest0-21swapper/323:05:113
243429940,4cyclictest0-21swapper/322:05:123
243429940,4cyclictest0-21swapper/322:00:293
243429940,4cyclictest0-21swapper/321:52:153
243429940,4cyclictest0-21swapper/321:32:593
243429940,4cyclictest0-21swapper/321:25:143
243429940,4cyclictest0-21swapper/321:15:123
243429940,4cyclictest0-21swapper/320:40:103
243429940,4cyclictest0-21swapper/320:19:153
243429940,4cyclictest0-21swapper/300:35:303
243429940,4cyclictest0-21swapper/300:05:363
243429940,4cyclictest0-21swapper/300:01:513
243429940,3cyclictest9661-21users20:45:193
243429940,3cyclictest6876-21ssh23:57:333
243429940,3cyclictest17627-21sed21:05:013
243429940,3cyclictest17530-21/usr/sbin/munin21:40:183
243429940,3cyclictest16923-21ssh23:15:003
243429940,0cyclictest0-21swapper/319:39:593
243379944,0cyclictest0-21swapper/222:28:222
243379944,0cyclictest0-21swapper/221:27:142
243379943,1cyclictest2854-21/usr/sbin/munin20:35:182
243379943,1cyclictest13332-21grep00:00:202
243379942,2cyclictest30462-21irqstats23:05:152
243379942,2cyclictest0-21swapper/223:15:122
243379942,1cyclictest802-21snmpd00:37:482
243379942,1cyclictest802-21snmpd00:32:062
243379942,1cyclictest802-21snmpd00:32:062
243379941,3cyclictest802-21snmpd00:20:092
243379941,3cyclictest57150irq/125-eth023:41:502
243379941,2cyclictest0-21swapper/221:00:112
243379941,2cyclictest0-21swapper/219:10:122
243379941,1cyclictest20280-21awk23:00:162
243379940,4cyclictest16388-21sh23:14:472
243379940,4cyclictest0-21swapper/223:50:152
243379940,4cyclictest0-21swapper/223:33:202
243379940,4cyclictest0-21swapper/222:54:022
243379940,4cyclictest0-21swapper/222:45:132
243379940,4cyclictest0-21swapper/221:22:002
243379940,4cyclictest0-21swapper/221:19:302
243379940,4cyclictest0-21swapper/200:15:132
243379940,4cyclictest0-21swapper/200:10:102
243379940,3cyclictest31831-21users00:25:222
243379940,3cyclictest31271-21cat00:10:002
243379940,3cyclictest30636-21date21:15:012
243379940,3cyclictest28385-21diskstats21:45:142
243379940,3cyclictest26944-21grep19:15:012
243379940,3cyclictest26723-21rm22:31:342
243379940,3cyclictest2452-21memory23:55:172
243379940,3cyclictest22466-21wc20:10:002
243379940,2cyclictest0-21swapper/221:40:352
243379940,1cyclictest7268-21/usr/sbin/munin21:35:182
243379940,1cyclictest5163-21/usr/sbin/munin19:35:172
243379940,1cyclictest3963-21/usr/sbin/munin22:05:162
243379940,1cyclictest2694-21/usr/sbin/munin19:30:112
243379940,1cyclictest24398-21/usr/sbin/munin22:15:112
243379940,1cyclictest17302-21ntp_states21:55:202
243379940,1cyclictest10402-21ntp_states22:55:192
243379940,0cyclictest0-21swapper/222:12:472
243329944,0cyclictest0-21swapper/123:25:061
243329944,0cyclictest0-21swapper/122:34:121
243329944,0cyclictest0-21swapper/122:21:311
243329944,0cyclictest0-21swapper/121:42:411
243329944,0cyclictest0-21swapper/100:38:091
243329942,1cyclictest0-21swapper/123:05:121
243329941,2cyclictest0-21swapper/123:10:101
243329941,2cyclictest0-21swapper/122:55:131
243329941,2cyclictest0-21swapper/122:50:011
243329941,2cyclictest0-21swapper/121:55:131
243329941,2cyclictest0-21swapper/121:05:121
243329941,2cyclictest0-21swapper/120:55:091
243329941,2cyclictest0-21swapper/120:35:111
243329941,2cyclictest0-21swapper/120:15:101
243329941,2cyclictest0-21swapper/120:10:091
243329941,2cyclictest0-21swapper/120:05:111
243329941,2cyclictest0-21swapper/119:45:101
243329941,2cyclictest0-21swapper/119:20:121
243329941,1cyclictest0-21swapper/119:40:111
243329940,4cyclictest0-21swapper/122:49:451
243329940,4cyclictest0-21swapper/121:11:501
243329940,0cyclictest0-21swapper/123:50:431
243329940,0cyclictest0-21swapper/121:29:081
243279944,0cyclictest3-21ksoftirqd/019:35:010
243279944,0cyclictest0-21swapper/022:37:310
243279944,0cyclictest0-21swapper/022:18:020
243279942,1cyclictest29914-21ssh00:09:180
243279941,3cyclictest802-21snmpd21:35:380
243279941,2cyclictest802-21snmpd22:55:270
243279941,2cyclictest0-21swapper/019:20:120
243279941,1cyclictest0-21swapper/021:25:130
243279940,4cyclictest89012sleep023:26:200
243279940,4cyclictest6667-21ssh22:21:480
243279940,4cyclictest27855-21apt-get20:20:010
243279940,4cyclictest22678-21apt-get20:10:010
243279940,4cyclictest16765-21ssh21:23:550
243279940,4cyclictest0-21swapper/023:55:120
243279940,4cyclictest0-21swapper/023:50:120
243279940,4cyclictest0-21swapper/023:08:150
243279940,4cyclictest0-21swapper/022:45:120
243279940,4cyclictest0-21swapper/022:30:120
243279940,4cyclictest0-21swapper/022:10:130
243279940,4cyclictest0-21swapper/021:10:120
243279940,4cyclictest0-21swapper/020:35:110
243279940,4cyclictest0-21swapper/019:25:110
243279940,4cyclictest0-21swapper/000:25:210
243279940,4cyclictest0-21swapper/000:03:510
243279940,3cyclictest6403-21ssh21:18:510
243279940,3cyclictest6029-21ssh23:40:470
243279940,3cyclictest5657-21rm22:05:200
243279940,3cyclictest525-21ntp_states00:10:160
243279940,3cyclictest25167-21/usr/sbin/munin20:15:150
243279940,3cyclictest21959-21ssh22:29:550
243279940,3cyclictest21861-21/usr/sbin/munin20:05:200
243279940,3cyclictest21273-21ssh23:16:320
243279940,3cyclictest18891-21ssh22:44:110
243279940,3cyclictest17915-21/usr/sbin/munin21:05:160
243279940,3cyclictest15894-21ssh21:55:120
243279940,3cyclictest12277-21ssh23:12:160
243279940,3cyclictest0-21swapper/000:35:120
243279940,0cyclictest0-21swapper/000:19:310
30796230,0sleep10-21swapper/123:37:181
243429932,1cyclictest802-21snmpd20:25:043
243429932,1cyclictest2309-21rm22:20:113
243429931,1cyclictest0-21swapper/319:30:103
243429930,3cyclictest30181-21/usr/sbin/munin19:20:123
243429930,3cyclictest0-21swapper/323:40:123
243429930,3cyclictest0-21swapper/321:55:023
243429930,3cyclictest0-21swapper/321:35:033
243429930,3cyclictest0-21swapper/320:55:083
243429930,3cyclictest0-21swapper/320:35:113
243429930,3cyclictest0-21swapper/320:20:113
243429930,3cyclictest0-21swapper/320:05:123
243429930,3cyclictest0-21swapper/320:00:113
243429930,3cyclictest0-21swapper/319:55:103
243429930,3cyclictest0-21swapper/319:45:103
243429930,3cyclictest0-21swapper/319:10:113
243429930,2cyclictest0-21swapper/319:15:003
243379932,1cyclictest802-21snmpd20:30:012
243379931,2cyclictest0-21swapper/219:20:122
243379931,1cyclictest0-21swapper/221:05:132
243379930,3cyclictest32652-21apt-get19:25:112
243379930,3cyclictest27849-21gpgv20:20:002
243379930,3cyclictest15594-21diskstats19:55:122
243379930,3cyclictest10959-21hddtemp_smartct19:45:142
243379930,3cyclictest0-21swapper/222:40:112
243379930,3cyclictest0-21swapper/222:00:142
243379930,3cyclictest0-21swapper/221:50:122
243379930,3cyclictest0-21swapper/220:55:092
243379930,3cyclictest0-21swapper/220:50:002
243379930,3cyclictest0-21swapper/220:25:102
243379930,3cyclictest0-21swapper/220:15:112
243379930,3cyclictest0-21swapper/220:10:022
243379930,3cyclictest0-21swapper/220:00:102
243379930,3cyclictest0-21swapper/219:50:112
243379930,3cyclictest0-21swapper/219:40:112
243379930,2cyclictest0-21swapper/223:25:092
243379930,2cyclictest0-21swapper/221:30:122
243379930,1cyclictest0-21swapper/223:20:042
243329931,2cyclictest0-21swapper/100:15:121
243329931,1cyclictest0-21swapper/123:20:111
243329931,1cyclictest0-21swapper/122:35:121
243329931,1cyclictest0-21swapper/122:10:111
243329931,1cyclictest0-21swapper/121:45:121
243329931,1cyclictest0-21swapper/120:00:101
243329931,1cyclictest0-21swapper/119:55:101
243329931,1cyclictest0-21swapper/119:50:121
243329931,1cyclictest0-21swapper/119:30:101
243329931,1cyclictest0-21swapper/119:25:121
243329931,1cyclictest0-21swapper/100:25:131
243329931,1cyclictest0-21swapper/100:10:101
243329930,2cyclictest0-21swapper/123:30:121
243329930,2cyclictest0-21swapper/123:15:111
243329930,2cyclictest0-21swapper/121:35:121
243329930,2cyclictest0-21swapper/121:15:121
243329930,2cyclictest0-21swapper/120:20:121
243329930,2cyclictest0-21swapper/119:35:101
243329930,2cyclictest0-21swapper/119:10:111
243279933,0cyclictest3-21ksoftirqd/019:45:000
243279932,1cyclictest802-21snmpd20:45:100
243279932,1cyclictest13469-21tr23:45:120
243279931,1cyclictest5166-21apt-get19:35:110
243279931,1cyclictest1324-21if_eth120:30:150
243279930,3cyclictest5931-21tune2fs20:40:120
243279930,3cyclictest5551-21ssh21:50:100
243279930,3cyclictest30810-21ssh22:50:000
243279930,3cyclictest28210-21diskstats19:15:120
243279930,3cyclictest27206-21ssh23:20:020
243279930,3cyclictest18248-21tune2fs20:00:140
243279930,3cyclictest0-21swapper/021:00:100
243279930,3cyclictest0-21swapper/020:50:110
243279930,3cyclictest0-21swapper/020:25:110
243279930,3cyclictest0-21swapper/019:50:110
243279930,3cyclictest0-21swapper/019:40:110
243279930,3cyclictest0-21swapper/019:10:110
243329921,1cyclictest0-21swapper/123:55:131
243329921,1cyclictest0-21swapper/121:00:101
243329921,1cyclictest0-21swapper/120:40:101
243329921,1cyclictest0-21swapper/120:25:101
243329921,1cyclictest0-21swapper/100:30:091
243329921,1cyclictest0-21swapper/100:30:091
243329921,1cyclictest0-21swapper/100:20:001
243329920,1cyclictest0-21swapper/122:05:131
243329920,1cyclictest0-21swapper/122:00:131
243329920,1cyclictest0-21swapper/120:50:101
243329920,1cyclictest0-21swapper/120:45:111
243329920,0cyclictest0-21swapper/119:15:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional