You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-09 - 01:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack1slot1.osadl.org (updated Tue Jun 09, 2026 00:45:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
194882216150,22sleep20-21swapper/219:08:472
195682207169,24sleep00-21swapper/019:09:500
193482203164,25sleep30-21swapper/319:06:593
193802196157,26sleep10-21swapper/119:07:211
22522720,0sleep10-21swapper/122:22:011
305202700,0sleep00-21swapper/022:15:350
208712530,0sleep30-21swapper/323:31:083
191772150,0sleep10-21swapper/122:45:151
1967099130,1cyclictest23239-21/usr/sbin/munin00:20:162
1967099130,1cyclictest0-21swapper/222:10:172
19677991211,1cyclictest35-21ksoftirqd/322:05:013
19677991110,1cyclictest35-21ksoftirqd/322:15:003
19677991110,1cyclictest35-21ksoftirqd/321:20:003
1967099110,0cyclictest0-21swapper/221:49:572
1965799112,4cyclictest25964-21cat23:40:010
1965799110,5cyclictest27458-21latency_hist21:30:000
1967799109,1cyclictest35-21ksoftirqd/323:45:013
1967799100,6cyclictest0-21swapper/322:20:133
1965799109,1cyclictest9-21ksoftirqd/023:55:000
1965799103,6cyclictest14326-21latency_hist22:40:000
1965799100,9cyclictest0-21swapper/019:50:120
1965799100,6cyclictest240-21systemd-journal21:39:550
196779991,5cyclictest7801-21apt-get23:15:093
196709990,1cyclictest0-21swapper/220:00:112
196579998,1cyclictest9-21ksoftirqd/022:09:270
196579998,1cyclictest9-21ksoftirqd/020:40:110
196779987,1cyclictest35-21ksoftirqd/323:25:133
196779986,1cyclictest35-21ksoftirqd/321:03:163
196779986,1cyclictest35-21ksoftirqd/300:35:133
196779986,1cyclictest1029-21snmpd23:00:373
196779986,1cyclictest1029-21snmpd22:09:003
196779986,1cyclictest1029-21snmpd21:24:283
196779986,1cyclictest1029-21snmpd20:16:513
196779986,1cyclictest1029-21snmpd00:07:023
196779981,5cyclictest17400-1kworker/u9:122:45:283
196779980,7cyclictest5531-21kworker/u8:221:56:383
196779980,7cyclictest5531-21kworker/u8:221:56:383
196779980,4cyclictest2839-21apt-get21:40:123
196779980,4cyclictest0-21swapper/321:35:113
196709986,2cyclictest19654-21cyclictest22:41:462
196709986,1cyclictest61650irq/122-eno123:35:132
196709986,1cyclictest61650irq/122-eno122:45:172
196709986,1cyclictest61650irq/122-eno121:25:132
196709980,1cyclictest0-21swapper/222:52:212
196679980,5cyclictest0-21swapper/123:30:111
196579987,1cyclictest1029-21snmpd22:29:560
196579986,1cyclictest1029-21snmpd19:58:050
196579986,1cyclictest1029-21snmpd00:17:480
196579981,6cyclictest10662-21ssh21:50:150
196579980,7cyclictest4707-21ssh23:10:140
196579980,7cyclictest324472sleep023:47:440
196579980,7cyclictest18969-21sed22:00:200
196579980,7cyclictest13921-21ssh23:22:160
196579980,6cyclictest28025-1kworker/u9:123:40:360
196579980,4cyclictest0-21swapper/022:10:130
196579980,1cyclictest14814-21diskstats20:05:170
26040270,1sleep10-21swapper/100:23:181
196779976,1cyclictest35-21ksoftirqd/321:25:153
196779976,1cyclictest35-21ksoftirqd/319:25:153
196779976,1cyclictest12571-21apt-get21:10:113
196779976,1cyclictest1029-21snmpd20:35:213
196779976,1cyclictest1029-21snmpd20:13:413
196779976,1cyclictest1029-21snmpd19:35:043
196779975,1cyclictest3741-21ssh23:52:563
196779975,1cyclictest12663-21ssh21:52:323
196779975,1cyclictest1029-21snmpd23:56:423
196779975,1cyclictest1029-21snmpd20:52:363
196779975,1cyclictest1029-21snmpd20:30:243
196779975,1cyclictest1029-21snmpd19:55:313
196779975,1cyclictest1029-21snmpd19:40:343
196779975,1cyclictest1029-21snmpd19:34:253
196779975,1cyclictest1029-21snmpd19:21:193
196779973,2cyclictest32295-21timerandwakeup00:30:193
196779972,2cyclictest12318-21diskmemload00:11:593
196779971,4cyclictest12318-21diskmemload22:16:043
196779971,4cyclictest1029-21snmpd19:53:323
196779970,6cyclictest0-21swapper/322:34:593
196779970,4cyclictest0-21swapper/321:33:573
196709976,1cyclictest61650irq/122-eno123:24:022
196709976,1cyclictest61650irq/122-eno121:20:102
196709976,1cyclictest61650irq/122-eno121:10:142
196709976,1cyclictest61650irq/122-eno119:50:102
196709976,1cyclictest61650irq/122-eno100:25:162
196709976,1cyclictest61650irq/122-eno100:14:162
196709976,1cyclictest61650irq/122-eno100:01:142
196709976,1cyclictest28525-21cat19:25:162
196709976,1cyclictest1029-21snmpd19:10:402
196709976,0cyclictest61650irq/122-eno123:25:122
196709975,1cyclictest61650irq/122-eno121:35:202
196709975,1cyclictest61650irq/122-eno121:15:122
196709975,1cyclictest61650irq/122-eno100:05:192
196709975,1cyclictest1029-21snmpd22:05:032
196709975,1cyclictest1029-21snmpd20:33:452
196709975,1cyclictest1029-21snmpd00:30:052
196709974,2cyclictest1-21systemd22:57:082
196709974,1cyclictest61650irq/122-eno122:01:512
196709972,3cyclictest28635-21apt-get22:15:092
196709971,0cyclictest0-21swapper/221:31:282
196709970,3cyclictest240-21systemd-journal22:00:012
196709970,3cyclictest240-21systemd-journal22:00:012
196709970,3cyclictest0-21swapper/219:35:112
196709970,1cyclictest0-21swapper/223:03:472
196709970,1cyclictest0-21swapper/221:04:432
196679971,6cyclictest0-21swapper/119:33:031
196679970,6cyclictest0-21swapper/122:30:521
196679970,4cyclictest0-21swapper/122:40:111
196679970,4cyclictest0-21swapper/119:45:121
196679970,1cyclictest0-21swapper/119:53:231
196679970,1cyclictest0-21swapper/119:20:551
196579977,0cyclictest12318-21diskmemload23:07:560
196579976,1cyclictest1029-21snmpd19:18:400
196579976,1cyclictest1029-21snmpd00:32:360
196579975,1cyclictest7389-21cat21:45:150
196579975,1cyclictest4634-21ssh00:37:490
196579975,1cyclictest390-21ssh22:20:160
196579975,1cyclictest25276-21idleruntime-cro22:55:010
196579975,1cyclictest1029-21snmpd23:25:410
196579975,1cyclictest1029-21snmpd20:50:570
196579974,1cyclictest9-21ksoftirqd/020:56:390
196579972,2cyclictest240-21systemd-journal19:45:000
196579972,1cyclictest26097-21/usr/sbin/munin20:30:200
196579971,5cyclictest15730-21ssh22:40:170
196579971,5cyclictest0-21swapper/021:16:010
196579970,6cyclictest9146-21ssh23:15:160
196579970,6cyclictest4034-21ssh21:40:180
196579970,6cyclictest28852-21taskset00:25:490
196579970,6cyclictest21659-21latency_hist22:50:010
196579970,6cyclictest17046-21expr20:10:140
196579970,6cyclictest1681-21fschecks_count23:50:130
196579970,6cyclictest0-21swapper/000:10:140
196579970,2cyclictest240-21systemd-journal23:00:000
196579970,2cyclictest240-21systemd-journal22:35:000
196579970,1cyclictest22018-21ssh21:20:370
196579970,1cyclictest19317-21ssh23:30:130
196579970,1cyclictest15156-21sendmail_mailqu21:55:170
196579970,1cyclictest15156-21sendmail_mailqu21:55:160
196579970,1cyclictest14362-21ssh21:10:260
196579970,1cyclictest12318-21diskmemload23:00:340
196579970,1cyclictest10512-21runrttasks00:00:410
196579970,1cyclictest1029-21snmpd00:20:150
196579970,1cyclictest0-21swapper/021:30:120
196579970,1cyclictest0-21swapper/000:06:220
196779966,0cyclictest35-21ksoftirqd/300:00:133
196779965,1cyclictest5880-21ssh22:26:533
196779965,1cyclictest35-21ksoftirqd/320:25:003
196779965,1cyclictest22526-21ssh00:18:473
196779965,1cyclictest13471-21ssh22:37:443
196779965,1cyclictest1029-21snmpd00:20:243
196779964,1cyclictest35-21ksoftirqd/319:45:153
196779964,1cyclictest32419-21ssh23:47:393
196779964,1cyclictest2304-21ssh23:05:233
196779964,1cyclictest1029-21snmpd21:09:223
196779964,1cyclictest1029-21snmpd20:09:313
196779964,0cyclictest0-21swapper/323:21:183
196779961,3cyclictest12318-21diskmemload22:55:163
196779961,3cyclictest12318-21diskmemload22:43:403
196779960,4cyclictest0-21swapper/322:50:113
196779960,4cyclictest0-21swapper/321:00:013
196779960,4cyclictest0-21swapper/300:26:543
196779960,3cyclictest0-21swapper/323:35:053
196779960,3cyclictest0-21swapper/320:45:123
196779960,2cyclictest0-21swapper/323:13:283
196709966,0cyclictest61650irq/122-eno123:55:012
196709966,0cyclictest61650irq/122-eno123:50:102
196709966,0cyclictest61650irq/122-eno123:45:042
196709966,0cyclictest61650irq/122-eno123:30:442
196709966,0cyclictest61650irq/122-eno122:30:122
196709966,0cyclictest61650irq/122-eno122:25:242
196709966,0cyclictest61650irq/122-eno122:20:122
196709966,0cyclictest61650irq/122-eno121:41:272
196709966,0cyclictest61650irq/122-eno120:59:002
196709966,0cyclictest61650irq/122-eno120:45:322
196709966,0cyclictest61650irq/122-eno120:25:192
196709966,0cyclictest61650irq/122-eno120:20:112
196709966,0cyclictest61650irq/122-eno120:15:112
196709966,0cyclictest61650irq/122-eno119:57:582
196709966,0cyclictest61650irq/122-eno119:43:042
196709966,0cyclictest61650irq/122-eno119:30:192
196709966,0cyclictest61650irq/122-eno119:15:142
196709966,0cyclictest61650irq/122-eno100:35:162
196709966,0cyclictest61650irq/122-eno100:16:482
196709965,1cyclictest61650irq/122-eno123:10:122
196709965,1cyclictest26159-21ssh23:40:102
196709965,1cyclictest12057-21ntpq22:35:162
196709965,1cyclictest10141-21ssh21:50:122
196709965,0cyclictest61650irq/122-eno123:05:132
196709964,1cyclictest61650irq/122-eno121:05:152
196709960,3cyclictest0-21swapper/223:15:092
196709960,1cyclictest0-21swapper/220:50:162
196679966,0cyclictest0-21swapper/121:48:451
196679966,0cyclictest0-21swapper/121:30:191
196679965,1cyclictest0-21swapper/120:18:301
196679961,4cyclictest0-21swapper/122:15:091
196679961,4cyclictest0-21swapper/100:19:131
196679960,6cyclictest0-21swapper/123:57:201
196679960,6cyclictest0-21swapper/123:40:341
196679960,6cyclictest0-21swapper/123:06:581
196679960,6cyclictest0-21swapper/122:10:591
196679960,6cyclictest0-21swapper/119:42:201
196679960,6cyclictest0-21swapper/100:36:071
196679960,5cyclictest0-21swapper/122:55:151
196679960,5cyclictest0-21swapper/122:00:141
196679960,5cyclictest0-21swapper/121:55:081
196679960,5cyclictest0-21swapper/121:55:081
196679960,5cyclictest0-21swapper/121:11:581
196679960,4cyclictest0-21swapper/122:35:101
196679960,4cyclictest0-21swapper/100:07:221
196679960,3cyclictest0-21swapper/123:45:151
196679960,1cyclictest0-21swapper/123:52:551
196679960,1cyclictest0-21swapper/120:20:101
196679960,1cyclictest0-21swapper/119:25:191
196679960,0cyclictest0-21swapper/121:21:071
196579965,1cyclictest9-21ksoftirqd/019:49:010
196579965,1cyclictest21000-21ntpq19:10:160
196579964,1cyclictest9-21ksoftirqd/020:46:280
196579964,1cyclictest1029-21snmpd21:06:100
196579964,1cyclictest1029-21snmpd19:27:240
196579963,2cyclictest1029-21snmpd19:35:050
196579960,6cyclictest0-21swapper/020:16:030
196579960,6cyclictest0-21swapper/020:01:430
196579960,6cyclictest0-21swapper/019:22:120
196579960,1cyclictest0-21swapper/020:20:090
196579960,0cyclictest0-21swapper/020:25:110
196779954,1cyclictest35-21ksoftirqd/319:15:003
196779954,0cyclictest35-21ksoftirqd/320:00:013
196779953,1cyclictest1029-21snmpd19:12:073
196779952,2cyclictest24529-21gltestperf20:25:143
196779952,1cyclictest240-21systemd-journal20:40:003
196779951,2cyclictest0-21swapper/321:46:173
196709955,0cyclictest61650irq/122-eno120:10:132
196709955,0cyclictest61650irq/122-eno120:05:132
196709955,0cyclictest61650irq/122-eno119:47:172
196709953,1cyclictest61650irq/122-eno120:39:592
196709950,4cyclictest30826-21/usr/sbin/munin20:40:162
196709950,4cyclictest0-21swapper/219:20:112
196679955,0cyclictest0-21swapper/122:08:591
196679952,3cyclictest0-21swapper/100:25:161
196679952,2cyclictest0-21swapper/123:17:171
196679952,1cyclictest0-21swapper/121:35:131
196679951,4cyclictest0-21swapper/119:56:381
196679951,4cyclictest0-21swapper/100:14:081
196679951,3cyclictest0-21swapper/122:25:131
196679951,2cyclictest0-21swapper/121:25:111
196679950,5cyclictest0-21swapper/123:10:471
196679950,5cyclictest0-21swapper/121:41:141
196679950,5cyclictest0-21swapper/120:30:131
196679950,5cyclictest0-21swapper/120:08:371
196679950,3cyclictest0-21swapper/123:00:101
196679950,3cyclictest0-21swapper/121:51:171
196679950,3cyclictest0-21swapper/120:10:131
196679950,2cyclictest0-21swapper/123:37:471
196679950,2cyclictest0-21swapper/120:55:161
196679950,2cyclictest0-21swapper/100:33:261
196679950,1cyclictest0-21swapper/120:50:111
196679950,1cyclictest0-21swapper/120:45:131
196679950,1cyclictest0-21swapper/100:00:131
196579953,1cyclictest29794-21wc20:35:180
196579950,4cyclictest30508-21diskstats19:30:140
196579950,1cyclictest0-21swapper/021:00:110
196679944,0cyclictest0-21swapper/121:07:461
196679942,1cyclictest0-21swapper/119:10:121
196679941,2cyclictest0-21swapper/119:35:121
196679940,4cyclictest0-21swapper/120:35:201
196679940,4cyclictest0-21swapper/120:03:551
196679940,4cyclictest0-21swapper/119:15:191
196679940,2cyclictest0-21swapper/122:50:131
196679940,1cyclictest0-21swapper/123:25:161
196679940,1cyclictest0-21swapper/121:15:101
196679940,1cyclictest0-21swapper/120:40:231
196679940,0cyclictest0-21swapper/123:20:191
196679940,0cyclictest0-21swapper/121:04:411
196679940,0cyclictest0-21swapper/120:28:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional