You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 02:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Fri Apr 24, 2026 00:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
116982193175,13sleep10-21swapper/119:07:351
116012193176,12sleep00-21swapper/019:06:220
117002187171,11sleep30-21swapper/319:07:373
115462171154,13sleep20-21swapper/219:05:402
29972450,0sleep10-21swapper/121:39:121
34682440,0sleep00-21swapper/021:00:150
26252440,0sleep20-21swapper/200:16:582
254362410,0sleep10-21swapper/122:05:181
1205099102,4cyclictest32274-21awk20:55:000
120509970,3cyclictest22622-21perf19:30:010
27649260,0sleep30-21swapper/300:29:553
23787260,0sleep00-21swapper/022:52:040
120609964,2cyclictest0-21swapper/300:20:373
120609960,6cyclictest0-21swapper/321:05:113
120509962,4cyclictest7529-21awk20:05:010
14534250,4sleep014564-21ssh22:15:390
120609955,0cyclictest14621-21kworker/3:121:10:193
120609950,5cyclictest21669-21sh21:16:083
120609950,5cyclictest0-21swapper/323:52:323
120609950,5cyclictest0-21swapper/323:24:103
120609950,5cyclictest0-21swapper/323:04:063
120609950,4cyclictest31684-21perl22:40:143
120609950,4cyclictest30262-21/usr/sbin/munin19:45:153
120609950,4cyclictest1580-21ssh23:45:093
120549955,0cyclictest31-21ksoftirqd/223:20:102
120549955,0cyclictest31-21ksoftirqd/223:00:022
120549953,2cyclictest26421-21kworker/2:221:01:012
120549952,1cyclictest16097-21cat21:45:152
120549951,3cyclictest23872-21/usr/sbin/munin23:40:172
120549950,5cyclictest0-21swapper/223:30:112
120549950,5cyclictest0-21swapper/223:29:192
120549950,5cyclictest0-21swapper/222:50:372
120549950,5cyclictest0-21swapper/222:28:132
120549950,5cyclictest0-21swapper/221:22:442
120549950,5cyclictest0-21swapper/221:18:482
120549950,4cyclictest20173-21munin-run22:35:012
120549950,4cyclictest15204-21cut19:15:012
120519954,1cyclictest0-21swapper/123:45:181
120519951,3cyclictest0-21swapper/123:15:101
120519951,2cyclictest0-21swapper/119:25:111
120519950,5cyclictest0-21swapper/123:22:101
120519950,5cyclictest0-21swapper/121:47:271
120519950,5cyclictest0-21swapper/100:17:191
120519950,5cyclictest0-21swapper/100:01:191
120509955,0cyclictest3-21ksoftirqd/022:20:120
120509955,0cyclictest0-21swapper/000:11:100
120509954,1cyclictest3-21ksoftirqd/023:10:010
120509950,5cyclictest0-21swapper/020:21:240
120509950,4cyclictest32734-21apt-get19:50:110
120509950,4cyclictest0-21swapper/023:00:020
5057240,3sleep05086-21ssh00:34:470
120609944,0cyclictest14621-21kworker/3:123:35:523
120609944,0cyclictest14621-21kworker/3:123:13:293
120609944,0cyclictest0-21swapper/322:37:023
120609944,0cyclictest0-21swapper/321:30:593
120609942,2cyclictest3430-21rm00:01:213
120609942,1cyclictest7855-21ssh22:12:503
120609940,4cyclictest0-21swapper/323:55:193
120609940,4cyclictest0-21swapper/323:30:123
120609940,4cyclictest0-21swapper/323:05:493
120609940,4cyclictest0-21swapper/322:59:413
120609940,4cyclictest0-21swapper/322:31:513
120609940,4cyclictest0-21swapper/322:25:443
120609940,4cyclictest0-21swapper/322:21:363
120609940,4cyclictest0-21swapper/322:05:113
120609940,4cyclictest0-21swapper/321:41:383
120609940,4cyclictest0-21swapper/319:35:123
120609940,4cyclictest0-21swapper/300:35:323
120609940,4cyclictest0-21swapper/300:33:433
120609940,4cyclictest0-21swapper/300:16:003
120609940,4cyclictest0-21swapper/300:14:403
120609940,3cyclictest7838-21hostname20:05:113
120609940,3cyclictest7485-21users23:15:203
120609940,3cyclictest29197-21df_inode21:20:133
120609940,3cyclictest26262-21sh23:40:313
120609940,3cyclictest25081-21apt-get20:40:093
120609940,3cyclictest1752-21ssh23:29:123
120609940,3cyclictest14827-21fschecks_count19:15:013
120609940,3cyclictest13600-21ssh22:00:103
120609940,3cyclictest13131-21irqstats22:15:183
120609940,3cyclictest0-21swapper/320:20:123
120609940,1cyclictest26064-21diskstats21:50:153
120549944,0cyclictest31-21ksoftirqd/223:45:092
120549944,0cyclictest31-21ksoftirqd/221:40:012
120549944,0cyclictest31-21ksoftirqd/221:10:122
120549944,0cyclictest0-21swapper/222:45:582
120549943,1cyclictest6663-21grep20:00:172
120549943,1cyclictest10477-21tr20:10:142
120549942,1cyclictest0-21swapper/219:30:112
120549941,2cyclictest0-21swapper/223:05:012
120549941,2cyclictest0-21swapper/221:55:152
120549941,2cyclictest0-21swapper/220:05:112
120549941,2cyclictest0-21swapper/219:55:112
120549941,2cyclictest0-21swapper/200:35:142
120549941,2cyclictest0-21swapper/200:05:112
120549940,4cyclictest29817-21perl22:55:152
120549940,4cyclictest2450-21perl22:10:142
120549940,4cyclictest13260-21memory19:10:162
120549940,4cyclictest0-21swapper/223:35:122
120549940,4cyclictest0-21swapper/223:16:572
120549940,4cyclictest0-21swapper/223:13:192
120549940,4cyclictest0-21swapper/222:21:532
120549940,4cyclictest0-21swapper/220:55:112
120549940,4cyclictest0-21swapper/200:30:112
120549940,4cyclictest0-21swapper/200:20:122
120549940,4cyclictest0-21swapper/200:01:202
120549940,3cyclictest30190-21cat19:45:012
120549940,3cyclictest25607-21diskstats20:40:122
120549940,3cyclictest22617-21idleruntime-cro19:30:012
120549940,3cyclictest21629-21ntp_states00:10:172
120549940,3cyclictest20715-21sh00:25:362
120549940,3cyclictest19758-21sh22:02:492
120549940,3cyclictest12533-21perl23:50:142
120549940,1cyclictest32731-21/usr/sbin/munin19:50:172
120549940,1cyclictest27659-21cut20:45:122
120549940,1cyclictest17894-21/usr/sbin/munin19:20:122
120519944,0cyclictest0-21swapper/123:58:151
120519944,0cyclictest0-21swapper/122:39:321
120519944,0cyclictest0-21swapper/121:56:021
120519944,0cyclictest0-21swapper/121:27:041
120519941,2cyclictest0-21swapper/123:25:121
120519941,2cyclictest0-21swapper/122:55:121
120519941,2cyclictest0-21swapper/122:00:121
120519941,2cyclictest0-21swapper/121:50:131
120519941,2cyclictest0-21swapper/121:40:131
120519941,2cyclictest0-21swapper/121:15:141
120519941,2cyclictest0-21swapper/120:15:111
120519941,1cyclictest0-21swapper/121:10:121
120519940,4cyclictest0-21swapper/121:00:181
120519940,4cyclictest0-21swapper/120:05:261
120519940,0cyclictest0-21swapper/123:00:301
120509944,0cyclictest0-21swapper/023:40:450
120509942,2cyclictest3499-21kworker/0:323:15:010
120509942,2cyclictest3499-21kworker/0:320:47:090
120509942,1cyclictest802-21snmpd22:34:000
120509942,1cyclictest3-21ksoftirqd/019:15:010
120509940,4cyclictest6108-21ssh00:19:080
120509940,4cyclictest5783-21ssh21:24:540
120509940,4cyclictest25477-21apt-get21:50:140
120509940,4cyclictest11423-21ssh21:11:110
120509940,4cyclictest0-21swapper/023:45:090
120509940,4cyclictest0-21swapper/023:35:120
120509940,4cyclictest0-21swapper/022:45:130
120509940,4cyclictest0-21swapper/022:25:110
120509940,4cyclictest0-21swapper/022:07:560
120509940,4cyclictest0-21swapper/022:00:110
120509940,4cyclictest0-21swapper/021:47:510
120509940,4cyclictest0-21swapper/021:25:130
120509940,4cyclictest0-21swapper/020:32:100
120509940,4cyclictest0-21swapper/020:10:120
120509940,4cyclictest0-21swapper/019:46:030
120509940,4cyclictest0-21swapper/019:10:100
120509940,4cyclictest0-21swapper/000:20:110
120509940,3cyclictest4918-21grep21:55:200
120509940,3cyclictest4022-21ssh22:58:360
120509940,3cyclictest29180-21users21:35:230
120509940,3cyclictest27775-21latency_hist00:30:000
120509940,3cyclictest25509-21grep19:35:120
120509940,3cyclictest2078-21ssh22:41:170
120509940,3cyclictest20550-21ssh21:31:220
120509940,3cyclictest19758-21ssh23:21:360
120509940,3cyclictest176452sleep020:25:080
120509940,3cyclictest12958-21memory23:50:150
120509940,3cyclictest12630-21ssh21:43:470
120509940,3cyclictest0-21swapper/019:55:120
120509940,1cyclictest0-21swapper/000:36:210
120509940,0cyclictest0-21swapper/022:36:350
120509940,0cyclictest0-21swapper/022:14:550
1036240,0sleep20-21swapper/221:53:592
30279230,2sleep20-21swapper/219:45:122
24105230,0sleep10-21swapper/119:30:171
16964230,0sleep10-21swapper/100:24:341
120609933,0cyclictest14621-21kworker/3:121:55:083
120609932,1cyclictest15016-21ssh21:45:063
120609931,1cyclictest0-21swapper/319:40:113
120609930,3cyclictest7472-21diskmemload22:45:013
120609930,3cyclictest1578-21ntp_states19:50:173
120609930,3cyclictest0-21swapper/322:50:103
120609930,3cyclictest0-21swapper/321:25:133
120609930,3cyclictest0-21swapper/321:00:113
120609930,3cyclictest0-21swapper/320:55:113
120609930,3cyclictest0-21swapper/320:50:053
120609930,3cyclictest0-21swapper/320:45:003
120609930,3cyclictest0-21swapper/320:30:113
120609930,3cyclictest0-21swapper/320:25:093
120609930,3cyclictest0-21swapper/320:15:103
120609930,3cyclictest0-21swapper/320:10:123
120609930,3cyclictest0-21swapper/320:00:113
120609930,3cyclictest0-21swapper/319:55:123
120609930,3cyclictest0-21swapper/319:30:053
120609930,3cyclictest0-21swapper/319:25:133
120609930,3cyclictest0-21swapper/319:20:093
120609930,3cyclictest0-21swapper/319:10:103
120609930,3cyclictest0-21swapper/300:05:053
120609930,2cyclictest27058-21/usr/sbin/munin21:35:143
120609930,1cyclictest22588-21apt20:35:113
120549933,0cyclictest3904-21kworker/2:022:15:022
120549932,1cyclictest31-21ksoftirqd/222:40:122
120549931,1cyclictest0-21swapper/222:35:122
120549931,1cyclictest0-21swapper/220:50:102
120549931,1cyclictest0-21swapper/219:35:122
120549930,3cyclictest23119-21diskstats20:35:132
120549930,3cyclictest20330-21expr20:30:122
120549930,3cyclictest18122-21expr20:25:132
120549930,3cyclictest16818-21apt-get21:30:142
120549930,3cyclictest13386-21/usr/sbin/munin20:15:142
120549930,3cyclictest0-21swapper/223:55:022
120549930,3cyclictest0-21swapper/221:40:022
120549930,3cyclictest0-21swapper/221:05:012
120549930,1cyclictest6276-21ssh21:25:032
120549930,1cyclictest23723-21ssh22:05:052
120549930,1cyclictest0-21swapper/220:20:172
120519931,1cyclictest0-21swapper/123:35:121
120519931,1cyclictest0-21swapper/123:10:121
120519931,1cyclictest0-21swapper/122:50:161
120519931,1cyclictest0-21swapper/122:45:121
120519931,1cyclictest0-21swapper/122:40:121
120519931,1cyclictest0-21swapper/122:25:121
120519931,1cyclictest0-21swapper/122:20:121
120519931,1cyclictest0-21swapper/122:10:131
120519931,1cyclictest0-21swapper/121:30:141
120519931,1cyclictest0-21swapper/121:20:111
120519931,1cyclictest0-21swapper/121:05:131
120519931,1cyclictest0-21swapper/120:50:111
120519931,1cyclictest0-21swapper/120:35:111
120519931,1cyclictest0-21swapper/120:25:121
120519931,1cyclictest0-21swapper/119:40:121
120519931,1cyclictest0-21swapper/119:35:121
120519931,1cyclictest0-21swapper/119:15:121
120519931,1cyclictest0-21swapper/100:25:121
120519930,2cyclictest12367-21chrt23:34:301
120519930,2cyclictest0-21swapper/122:30:111
120519930,2cyclictest0-21swapper/122:19:391
120519930,2cyclictest0-21swapper/120:40:111
120519930,2cyclictest0-21swapper/119:50:111
120519930,2cyclictest0-21swapper/119:45:111
120509933,0cyclictest3499-21kworker/0:319:40:040
120509933,0cyclictest3-21ksoftirqd/020:15:110
120509930,3cyclictest3916-21tr23:30:130
120509930,3cyclictest31872-21ssh00:00:020
120509930,3cyclictest27647-21rm23:10:120
120509930,3cyclictest0-21swapper/023:55:110
120509930,3cyclictest0-21swapper/023:25:110
120509930,3cyclictest0-21swapper/021:15:140
120509930,3cyclictest0-21swapper/021:05:000
120509930,3cyclictest0-21swapper/020:55:110
120509930,3cyclictest0-21swapper/020:40:100
120509930,3cyclictest0-21swapper/020:35:100
120509930,3cyclictest0-21swapper/020:05:050
120509930,3cyclictest0-21swapper/019:30:110
120509930,3cyclictest0-21swapper/019:20:080
120509930,3cyclictest0-21swapper/000:05:010
120519921,1cyclictest199172chrt19:22:241
120519921,1cyclictest0-21swapper/123:50:111
120519921,1cyclictest0-21swapper/120:20:121
120519921,1cyclictest0-21swapper/120:10:131
120519921,1cyclictest0-21swapper/119:55:121
120519921,1cyclictest0-21swapper/100:10:101
120519920,1cyclictest8097-21taskset00:35:231
120519920,1cyclictest0-21swapper/123:40:101
120519920,1cyclictest0-21swapper/123:05:021
120519920,1cyclictest0-21swapper/120:54:591
120519920,1cyclictest0-21swapper/120:45:121
120519920,1cyclictest0-21swapper/120:30:101
120519920,1cyclictest0-21swapper/120:00:101
120519920,1cyclictest0-21swapper/119:10:111
120519920,1cyclictest0-21swapper/100:30:121
120519920,1cyclictest0-21swapper/100:05:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional