You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-15 - 18:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack1slot1.osadl.org (updated Sat Nov 15, 2025 12:45:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
116062215149,21sleep00-21swapper/007:08:450
116412205172,21sleep30-21swapper/307:09:123
115882202164,24sleep20-21swapper/207:08:312
113762198160,26sleep10-21swapper/107:05:441
190222610,0sleep10-21swapper/110:55:221
71172580,0sleep10-21swapper/110:40:161
116382460,1sleep211641-21sort12:15:222
1180499140,13cyclictest24631-21/usr/sbin/munin11:05:162
11796991414,0cyclictest21-21ksoftirqd/112:02:571
11809991313,0cyclictest4502-21diskmemload12:10:083
11804991311,1cyclictest28-21ksoftirqd/210:44:592
11787991312,1cyclictest9-21ksoftirqd/008:40:010
11787991311,1cyclictest9-21ksoftirqd/008:20:000
1180999120,9cyclictest14154-21munin-node11:02:593
1179699120,0cyclictest0-21swapper/109:15:151
11787991211,1cyclictest9-21ksoftirqd/012:35:190
11787991211,1cyclictest9-21ksoftirqd/011:35:200
11787991211,1cyclictest7089-21sshd11:25:160
11787991210,1cyclictest9-21ksoftirqd/010:05:160
11804991111,0cyclictest0-21swapper/211:55:312
1179699118,2cyclictest0-21swapper/111:30:271
1178799119,1cyclictest9-21ksoftirqd/010:15:000
11787991110,1cyclictest9-21ksoftirqd/010:30:000
11787991110,1cyclictest9-21ksoftirqd/010:20:190
270942100,0sleep00-21swapper/011:07:280
15762100,0sleep00-21swapper/012:01:320
1180999109,1cyclictest35-21ksoftirqd/312:10:003
1180999109,1cyclictest35-21ksoftirqd/309:55:003
1180999108,1cyclictest35-21ksoftirqd/308:25:003
11809991010,0cyclictest35-21ksoftirqd/309:30:013
1180999100,7cyclictest21426-21memory08:35:173
1180499100,9cyclictest546-21irqbalance09:33:352
1180499100,10cyclictest0-21swapper/208:20:302
1180499100,0cyclictest0-21swapper/208:10:142
1179699109,1cyclictest0-21swapper/112:35:161
1179699109,1cyclictest0-21swapper/111:20:111
1179699109,1cyclictest0-21swapper/109:25:031
1179699109,1cyclictest0-21swapper/107:25:121
1179699108,2cyclictest0-21swapper/109:05:001
1179699108,2cyclictest0-21swapper/107:30:131
1179699105,4cyclictest201rcuc/112:30:171
1178799109,1cyclictest9-21ksoftirqd/012:25:150
1178799109,1cyclictest9-21ksoftirqd/010:00:160
1178799109,1cyclictest9-21ksoftirqd/009:45:220
1178799108,1cyclictest9-21ksoftirqd/009:15:000
1178799108,1cyclictest9-21ksoftirqd/007:50:000
118099998,1cyclictest35-21ksoftirqd/311:15:003
118099998,1cyclictest35-21ksoftirqd/309:05:003
118099998,1cyclictest35-21ksoftirqd/308:15:003
118049990,8cyclictest19110-21snmpd11:28:222
117969999,0cyclictest21-21ksoftirqd/112:15:471
117969999,0cyclictest21-21ksoftirqd/112:14:311
117969999,0cyclictest21-21ksoftirqd/112:05:331
117969999,0cyclictest21-21ksoftirqd/111:51:231
117969999,0cyclictest21-21ksoftirqd/111:16:021
117969999,0cyclictest21-21ksoftirqd/111:05:191
117969999,0cyclictest21-21ksoftirqd/111:00:331
117969999,0cyclictest21-21ksoftirqd/110:50:131
117969999,0cyclictest21-21ksoftirqd/110:48:431
117969999,0cyclictest21-21ksoftirqd/110:30:011
117969999,0cyclictest21-21ksoftirqd/110:28:331
117969999,0cyclictest21-21ksoftirqd/110:20:291
117969999,0cyclictest21-21ksoftirqd/110:14:051
117969999,0cyclictest21-21ksoftirqd/110:06:111
117969999,0cyclictest21-21ksoftirqd/110:00:061
117969999,0cyclictest21-21ksoftirqd/109:54:181
117969999,0cyclictest21-21ksoftirqd/109:45:151
117969999,0cyclictest21-21ksoftirqd/109:40:131
117969999,0cyclictest21-21ksoftirqd/109:30:331
117969999,0cyclictest21-21ksoftirqd/109:10:451
117969999,0cyclictest21-21ksoftirqd/109:05:171
117969999,0cyclictest21-21ksoftirqd/108:45:171
117969999,0cyclictest21-21ksoftirqd/108:30:231
117969999,0cyclictest21-21ksoftirqd/108:05:221
117969999,0cyclictest21-21ksoftirqd/107:41:191
117969998,1cyclictest0-21swapper/108:20:141
117969997,2cyclictest0-21swapper/111:44:091
117969993,6cyclictest0-21swapper/110:16:071
117969993,6cyclictest0-21swapper/109:22:081
117969993,5cyclictest21-21ksoftirqd/111:35:281
117969993,2cyclictest21-21ksoftirqd/111:25:101
117969992,7cyclictest21-21ksoftirqd/109:36:041
117969991,7cyclictest21-21ksoftirqd/112:23:021
117969991,1cyclictest21-21ksoftirqd/108:50:001
117969990,9cyclictest0-21swapper/107:15:011
117969990,8cyclictest21-21ksoftirqd/111:10:081
117969990,4cyclictest21-21ksoftirqd/111:59:381
117969990,1cyclictest21-21ksoftirqd/109:57:041
117879999,0cyclictest9-21ksoftirqd/012:20:120
117879999,0cyclictest9-21ksoftirqd/011:14:080
117879999,0cyclictest10213-21kworker/u8:111:59:490
117879998,1cyclictest9-21ksoftirqd/012:10:170
117879998,1cyclictest9-21ksoftirqd/011:54:460
117879998,1cyclictest9-21ksoftirqd/011:45:150
117879998,1cyclictest9-21ksoftirqd/010:50:150
117879990,5cyclictest0-21swapper/012:05:170
10869290,0sleep30-21swapper/309:16:573
16361286,1sleep228-21ksoftirqd/210:52:362
118099988,0cyclictest35-21ksoftirqd/310:16:503
118099987,1cyclictest35-21ksoftirqd/311:58:133
118099987,1cyclictest35-21ksoftirqd/311:25:153
118099987,1cyclictest35-21ksoftirqd/309:25:003
118099987,1cyclictest35-21ksoftirqd/307:50:003
118099986,1cyclictest19110-21snmpd09:12:153
118099980,8cyclictest0-21swapper/312:29:083
118049986,1cyclictest60950irq/123-eno112:04:352
118049986,1cyclictest60950irq/123-eno111:38:082
118049986,1cyclictest29125-21cat11:10:172
118049986,1cyclictest28-21ksoftirqd/209:53:052
118049986,1cyclictest23957-21ntpq08:40:202
118049986,1cyclictest19110-21snmpd10:45:482
118049986,1cyclictest19110-21snmpd10:24:352
118049985,2cyclictest60950irq/123-eno111:32:462
118049983,2cyclictest254-21systemd-journal11:45:002
118049983,2cyclictest254-21systemd-journal08:05:002
118049982,3cyclictest4502-21diskmemload12:25:162
118049981,5cyclictest28924-21/usr/sbin/munin09:40:202
118049980,4cyclictest31333-21apt10:30:002
118049980,2cyclictest0-21swapper/208:15:132
118049980,0cyclictest0-21swapper/210:13:442
117969988,0cyclictest21-21ksoftirqd/112:25:011
117969988,0cyclictest21-21ksoftirqd/111:45:121
117969988,0cyclictest21-21ksoftirqd/110:35:031
117969988,0cyclictest21-21ksoftirqd/108:55:011
117969988,0cyclictest21-21ksoftirqd/108:40:031
117969988,0cyclictest21-21ksoftirqd/108:35:011
117969988,0cyclictest21-21ksoftirqd/108:25:011
117969988,0cyclictest21-21ksoftirqd/108:15:021
117969988,0cyclictest21-21ksoftirqd/108:10:011
117969988,0cyclictest21-21ksoftirqd/108:00:011
117969988,0cyclictest21-21ksoftirqd/107:55:031
117969988,0cyclictest21-21ksoftirqd/107:50:011
117969988,0cyclictest21-21ksoftirqd/107:45:011
117969988,0cyclictest21-21ksoftirqd/107:35:021
117969988,0cyclictest21-21ksoftirqd/107:20:011
117969988,0cyclictest21-21ksoftirqd/107:10:051
117879988,0cyclictest9-21ksoftirqd/012:15:180
117879988,0cyclictest9-21ksoftirqd/009:25:180
117879987,1cyclictest9-21ksoftirqd/008:40:140
117879987,1cyclictest9-21ksoftirqd/007:20:180
117879987,1cyclictest557-21nscd09:15:040
117879987,1cyclictest16085-1kworker/u9:211:40:120
117879986,1cyclictest9-21ksoftirqd/010:45:170
117879986,1cyclictest19110-21snmpd08:55:150
117879983,5cyclictest29349-21chrt09:40:230
117879980,7cyclictest5453-21ssh10:37:260
118099977,0cyclictest35-21ksoftirqd/311:35:303
118099976,1cyclictest35-21ksoftirqd/309:30:013
118099976,1cyclictest19110-21snmpd08:29:203
118099976,1cyclictest19110-21snmpd07:58:553
118099976,1cyclictest11206-21ntpq10:00:203
118099975,1cyclictest25528-21ssh11:05:163
118099975,1cyclictest19110-21snmpd08:15:053
118099975,1cyclictest17204-21apt-get10:10:133
118099972,2cyclictest29658-21timerwakeupswit10:25:233
118099971,5cyclictest20723-21/usr/sbin/munin12:30:193
118099970,6cyclictest0-21swapper/310:30:143
118099970,5cyclictest0-21swapper/311:49:183
118049976,1cyclictest60950irq/123-eno112:30:402
118049976,1cyclictest60950irq/123-eno110:33:432
118049976,1cyclictest60950irq/123-eno109:15:272
118049976,1cyclictest60950irq/123-eno109:10:112
118049975,1cyclictest60950irq/123-eno111:20:122
118049975,1cyclictest60950irq/123-eno109:35:222
118049975,1cyclictest60950irq/123-eno107:25:172
118049975,1cyclictest4158-21ssh10:35:202
118049975,1cyclictest28-21ksoftirqd/210:00:242
118049975,1cyclictest22190-21ntpq11:00:212
118049975,1cyclictest19110-21snmpd09:24:332
118049972,2cyclictest236332sleep211:47:592
118049970,7cyclictest0-21swapper/208:36:412
118049970,6cyclictest4502-21diskmemload09:25:122
118049970,6cyclictest0-21swapper/209:49:232
117879977,0cyclictest9-21ksoftirqd/009:35:010
117879976,1cyclictest9-21ksoftirqd/011:20:530
117879976,1cyclictest9-21ksoftirqd/008:05:000
117879976,1cyclictest9-21ksoftirqd/007:30:000
117879976,1cyclictest9-21ksoftirqd/007:15:010
117879976,1cyclictest19110-21snmpd08:32:470
117879975,1cyclictest9-21ksoftirqd/010:55:160
117879975,1cyclictest15463-21cron08:25:000
117879973,2cyclictest254-21systemd-journal07:45:010
117879970,7cyclictest23415-21ssh12:33:190
117879970,6cyclictest8769-21ssh10:41:320
117879970,6cyclictest540-21ntp_states11:15:190
117879970,6cyclictest20997-21ssh11:00:090
117879970,6cyclictest20161-21ssh09:30:130
117879970,6cyclictest13000-21cut09:20:160
117879970,6cyclictest12791-21ssh11:32:590
117879970,6cyclictest0-21swapper/010:15:120
117879970,6cyclictest0-21swapper/009:00:170
117879970,6cyclictest0-21swapper/007:30:230
117879970,1cyclictest8386-21ssh09:55:530
117879970,1cyclictest31077-1kworker/u9:010:31:140
117879970,1cyclictest29119-21python08:50:200
117879970,1cyclictest2804-21ssh09:50:010
118099966,0cyclictest35-21ksoftirqd/309:40:003
118099966,0cyclictest35-21ksoftirqd/308:40:143
118099965,1cyclictest6573-21ssh10:40:073
118099965,1cyclictest35-21ksoftirqd/309:45:143
118099965,1cyclictest35-21ksoftirqd/309:00:003
118099965,1cyclictest35-21ksoftirqd/308:00:123
118099965,1cyclictest35-21ksoftirqd/307:10:133
118099965,1cyclictest26844-21ssh10:22:213
118099965,1cyclictest26062-21ssh12:35:313
118099965,1cyclictest25511-21cat11:50:203
118099965,1cyclictest19182-21ssh11:40:273
118099965,1cyclictest19110-21snmpd09:08:573
118099965,1cyclictest1419-21ssh12:01:043
118099964,1cyclictest15034-21open_files10:50:213
118099962,2cyclictest4502-21diskmemload10:46:033
118099960,4cyclictest22144-21apt-get07:30:133
118099960,4cyclictest1449-21ntpd07:40:043
118099960,4cyclictest0-21swapper/312:15:423
118099960,4cyclictest0-21swapper/309:35:073
118099960,3cyclictest0-21swapper/311:17:553
118099960,3cyclictest0-21swapper/309:59:043
118099960,2cyclictest0-21swapper/312:20:393
118099960,2cyclictest0-21swapper/311:30:303
118099960,2cyclictest0-21swapper/310:05:313
118099960,1cyclictest0-21swapper/310:38:543
118049966,0cyclictest60950irq/123-eno112:20:122
118049966,0cyclictest60950irq/123-eno112:10:082
118049966,0cyclictest60950irq/123-eno111:50:142
118049966,0cyclictest60950irq/123-eno111:15:462
118049966,0cyclictest60950irq/123-eno110:55:192
118049966,0cyclictest60950irq/123-eno110:15:162
118049966,0cyclictest60950irq/123-eno109:05:132
118049966,0cyclictest60950irq/123-eno108:33:592
118049966,0cyclictest60950irq/123-eno107:50:512
118049966,0cyclictest60950irq/123-eno107:35:182
118049966,0cyclictest60950irq/123-eno107:30:182
118049966,0cyclictest60950irq/123-eno107:21:492
118049965,1cyclictest6436-21apt-get09:55:142
118049965,1cyclictest60950irq/123-eno108:55:152
118049965,1cyclictest60950irq/123-eno108:52:182
118049965,1cyclictest16850-21ntpq08:25:172
118049964,1cyclictest60950irq/123-eno110:05:162
118049964,1cyclictest60950irq/123-eno108:45:212
118049963,1cyclictest11778-21cyclictest12:35:022
118049960,4cyclictest0-21swapper/212:05:072
118049960,3cyclictest0-21swapper/209:00:142
118049960,2cyclictest1519-21apt07:55:122
117879965,1cyclictest9-21ksoftirqd/007:55:140
117879964,1cyclictest19110-21snmpd08:07:370
117879964,1cyclictest12027-21telnet07:10:110
117879960,6cyclictest0-21swapper/009:06:570
117879960,0cyclictest0-21swapper/008:48:170
117879960,0cyclictest0-21swapper/008:25:120
117879960,0cyclictest0-21swapper/007:50:000
117879960,0cyclictest0-21swapper/007:37:340
118099954,1cyclictest35-21ksoftirqd/307:30:003
118099954,1cyclictest35-21ksoftirqd/307:24:553
118099954,1cyclictest19110-21snmpd08:33:353
118099954,1cyclictest19110-21snmpd07:50:383
118099954,1cyclictest18020-21ssh10:55:163
118099952,2cyclictest27711-21/usr/sbin/munin08:50:163
118099951,3cyclictest24499-21apt-get07:35:123
118099950,3cyclictest19110-21snmpd07:15:453
118099950,2cyclictest0-21swapper/311:23:483
118099950,1cyclictest26162-21memory08:45:193
118049955,0cyclictest60950irq/123-eno108:05:052
118049955,0cyclictest60950irq/123-eno107:40:142
118049955,0cyclictest60950irq/123-eno107:15:092
118049954,1cyclictest60950irq/123-eno107:10:122
118049953,1cyclictest60950irq/123-eno107:45:152
117879950,0cyclictest0-21swapper/008:14:560
118099942,1cyclictest557-21nscd08:05:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional