You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-17 - 22:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Wed Sep 17, 2025 12:45:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
232512216153,23sleep30-21swapper/307:09:373
230622207157,24sleep00-21swapper/007:07:100
231212201161,26sleep20-21swapper/207:07:562
229442198160,25sleep10-21swapper/107:05:381
274762600,0sleep30-21swapper/310:05:423
23357992221,1cyclictest9-21ksoftirqd/010:25:000
250332170,0sleep20-21swapper/212:15:152
23372991514,1cyclictest35-21ksoftirqd/308:55:003
23372991514,1cyclictest35-21ksoftirqd/308:50:003
23372991414,0cyclictest35-21ksoftirqd/310:50:133
23372991414,0cyclictest35-21ksoftirqd/309:00:213
23372991414,0cyclictest35-21ksoftirqd/308:10:173
23372991414,0cyclictest35-21ksoftirqd/308:00:143
23372991413,1cyclictest35-21ksoftirqd/309:22:113
23357991412,1cyclictest9-21ksoftirqd/011:25:000
23372991313,0cyclictest35-21ksoftirqd/311:00:243
23372991313,0cyclictest35-21ksoftirqd/309:05:213
23372991312,1cyclictest35-21ksoftirqd/311:50:223
23372991312,1cyclictest35-21ksoftirqd/310:19:593
23372991311,1cyclictest35-21ksoftirqd/312:40:003
23372991212,0cyclictest35-21ksoftirqd/311:35:073
23372991212,0cyclictest35-21ksoftirqd/310:23:063
23372991212,0cyclictest35-21ksoftirqd/309:44:013
23372991212,0cyclictest35-21ksoftirqd/309:38:273
23372991212,0cyclictest35-21ksoftirqd/308:40:233
23372991211,1cyclictest35-21ksoftirqd/312:34:593
23372991211,1cyclictest35-21ksoftirqd/311:55:133
23372991211,1cyclictest35-21ksoftirqd/311:35:013
23372991211,1cyclictest35-21ksoftirqd/311:00:013
23372991211,1cyclictest35-21ksoftirqd/308:55:193
23372991211,0cyclictest35-21ksoftirqd/312:01:113
23372991210,1cyclictest35-21ksoftirqd/312:15:183
23372991210,1cyclictest35-21ksoftirqd/311:45:183
23372991210,1cyclictest35-21ksoftirqd/311:15:003
2336299120,12cyclictest0-21swapper/110:50:111
296272110,0sleep016042-21diskmemload09:25:390
2337299119,1cyclictest35-21ksoftirqd/312:10:153
2337299119,1cyclictest35-21ksoftirqd/310:45:153
2337299119,1cyclictest35-21ksoftirqd/310:35:183
2337299119,1cyclictest35-21ksoftirqd/309:50:133
2337299119,1cyclictest35-21ksoftirqd/309:20:003
23372991111,0cyclictest35-21ksoftirqd/311:09:273
23372991111,0cyclictest35-21ksoftirqd/309:14:393
23372991111,0cyclictest35-21ksoftirqd/308:20:193
23372991111,0cyclictest35-21ksoftirqd/307:55:173
23372991110,1cyclictest35-21ksoftirqd/312:20:163
23372991110,1cyclictest35-21ksoftirqd/312:05:163
23372991110,1cyclictest35-21ksoftirqd/311:40:163
23372991110,1cyclictest35-21ksoftirqd/310:30:243
23372991110,1cyclictest35-21ksoftirqd/310:00:213
23372991110,1cyclictest35-21ksoftirqd/309:55:203
23372991110,1cyclictest35-21ksoftirqd/309:45:193
23372991110,1cyclictest35-21ksoftirqd/309:30:123
23372991110,1cyclictest35-21ksoftirqd/309:25:163
23372991110,1cyclictest35-21ksoftirqd/307:19:593
23372991110,0cyclictest35-21ksoftirqd/308:40:003
23372991110,0cyclictest35-21ksoftirqd/307:25:003
2335799119,1cyclictest9-21ksoftirqd/011:00:140
2335799119,1cyclictest9-21ksoftirqd/009:50:000
2335799112,4cyclictest12536-21perf11:15:000
23357991110,0cyclictest10540-21ssh09:44:480
48692100,0sleep20-21swapper/212:30:502
2337299109,1cyclictest35-21ksoftirqd/311:25:243
2337299109,1cyclictest35-21ksoftirqd/310:40:123
2337299109,1cyclictest35-21ksoftirqd/310:15:013
2337299109,1cyclictest35-21ksoftirqd/308:30:153
2337299108,1cyclictest35-21ksoftirqd/312:25:123
2337299108,1cyclictest35-21ksoftirqd/311:20:163
2337299108,1cyclictest35-21ksoftirqd/308:20:003
23372991010,0cyclictest35-21ksoftirqd/311:15:563
2336399106,1cyclictest60950irq/123-eno110:17:222
2336299100,5cyclictest0-21swapper/109:15:121
2335799109,1cyclictest9-21ksoftirqd/012:05:000
2335799109,1cyclictest9-21ksoftirqd/011:15:130
2335799109,1cyclictest9-21ksoftirqd/010:35:190
2335799108,1cyclictest9-21ksoftirqd/012:35:150
2335799108,1cyclictest9-21ksoftirqd/010:55:150
2335799108,1cyclictest9-21ksoftirqd/010:25:150
2335799108,1cyclictest9-21ksoftirqd/009:00:170
2335799108,1cyclictest13950-21ssh10:31:230
233729998,1cyclictest35-21ksoftirqd/310:25:003
233729998,1cyclictest35-21ksoftirqd/307:54:593
233729998,1cyclictest35-21ksoftirqd/307:15:003
233729997,1cyclictest35-21ksoftirqd/307:45:163
233729997,1cyclictest35-21ksoftirqd/307:40:163
233729997,1cyclictest35-21ksoftirqd/307:40:013
233729997,1cyclictest35-21ksoftirqd/307:30:133
233729992,6cyclictest31350-21apt-get07:25:143
233639997,1cyclictest28-21ksoftirqd/208:14:592
233639990,5cyclictest31765-21fw_packets11:40:162
233639990,3cyclictest254-21systemd-journal11:04:592
233579999,0cyclictest9-21ksoftirqd/011:40:190
233579999,0cyclictest9-21ksoftirqd/010:50:170
233579999,0cyclictest9-21ksoftirqd/010:05:140
233579999,0cyclictest9-21ksoftirqd/009:10:150
233579998,1cyclictest32206-21ssh10:13:550
233579997,1cyclictest9-21ksoftirqd/009:30:160
233579997,1cyclictest1358-21interrupts10:15:170
233579996,2cyclictest16121-21fschecks_time08:00:150
233579993,5cyclictest24141-21perf12:15:000
233579993,1cyclictest27397-21/usr/sbin/munin11:35:220
233729987,1cyclictest35-21ksoftirqd/308:05:143
233729986,1cyclictest35-21ksoftirqd/308:25:163
233639986,1cyclictest60950irq/123-eno111:25:222
233639986,1cyclictest60950irq/123-eno109:40:182
233639983,2cyclictest254-21systemd-journal10:04:372
233639982,5cyclictest29527-21vmstat09:25:222
233639980,6cyclictest0-21swapper/209:32:572
233639980,5cyclictest3064-21head11:45:142
233639980,5cyclictest254-21systemd-journal09:14:552
233629981,2cyclictest0-21swapper/112:15:021
233579988,0cyclictest9-21ksoftirqd/012:05:170
233579988,0cyclictest9-21ksoftirqd/007:30:170
233579987,1cyclictest9-21ksoftirqd/012:15:130
233579987,1cyclictest9-21ksoftirqd/011:30:150
233579987,1cyclictest9-21ksoftirqd/009:55:170
233579987,1cyclictest9-21ksoftirqd/009:50:160
233579987,1cyclictest9-21ksoftirqd/009:20:180
233579987,1cyclictest9-21ksoftirqd/008:59:590
233579987,1cyclictest9-21ksoftirqd/007:10:180
233579980,8cyclictest0-21swapper/012:20:170
233579980,7cyclictest8053-21ssh11:51:180
233639976,1cyclictest60950irq/123-eno112:27:062
233639976,1cyclictest60950irq/123-eno112:07:322
233639976,1cyclictest60950irq/123-eno111:59:552
233639976,1cyclictest60950irq/123-eno111:38:052
233639976,1cyclictest60950irq/123-eno111:33:042
233639976,1cyclictest60950irq/123-eno111:16:542
233639976,1cyclictest60950irq/123-eno110:51:342
233639976,1cyclictest60950irq/123-eno110:34:062
233639976,1cyclictest60950irq/123-eno110:20:292
233639976,1cyclictest60950irq/123-eno109:51:062
233639976,1cyclictest60950irq/123-eno109:35:222
233639976,1cyclictest60950irq/123-eno107:50:142
233639975,1cyclictest60950irq/123-eno112:35:142
233639975,1cyclictest60950irq/123-eno111:10:172
233639975,1cyclictest60950irq/123-eno110:40:592
233639975,1cyclictest60950irq/123-eno110:05:162
233639975,1cyclictest26545-21ssh09:22:452
233639970,6cyclictest28725-21cron07:24:542
233639970,6cyclictest22821-21ssh12:11:142
233639970,4cyclictest18753-21sh10:39:412
233639970,1cyclictest5970-21apt-get11:50:142
233639970,1cyclictest0-21swapper/209:45:122
233629970,5cyclictest0-21swapper/107:35:111
233629970,2cyclictest0-21swapper/111:35:141
233579977,0cyclictest9-21ksoftirqd/009:35:120
233579976,1cyclictest9-21ksoftirqd/012:25:110
233579976,1cyclictest9-21ksoftirqd/011:59:230
233579976,1cyclictest9-21ksoftirqd/007:29:120
233579976,1cyclictest9-21ksoftirqd/007:20:130
233579975,1cyclictest9-21ksoftirqd/008:35:010
233579975,1cyclictest9-21ksoftirqd/007:35:180
233579975,1cyclictest15644-21users09:05:240
233579973,4cyclictest29385-21awk08:30:000
233579971,1cyclictest8333-21sed07:45:010
233579970,7cyclictest0-21swapper/011:25:150
233579970,6cyclictest25265-21ssh10:46:330
233579970,6cyclictest2266-21ssh11:45:110
233579970,6cyclictest21739-21users09:15:250
233579970,6cyclictest16042-21diskmemload12:31:060
233579970,6cyclictest0-21swapper/011:07:130
233579970,6cyclictest0-21swapper/010:00:160
233579970,2cyclictest0-21swapper/008:35:130
233579970,1cyclictest20156-21/usr/sbin/munin08:10:160
233579970,1cyclictest19155-21ssh10:40:070
233639966,0cyclictest60950irq/123-eno112:20:092
233639966,0cyclictest60950irq/123-eno112:00:132
233639966,0cyclictest60950irq/123-eno111:20:032
233639966,0cyclictest60950irq/123-eno110:55:252
233639966,0cyclictest60950irq/123-eno110:25:172
233639966,0cyclictest60950irq/123-eno110:10:312
233639966,0cyclictest60950irq/123-eno109:55:012
233639966,0cyclictest60950irq/123-eno109:00:012
233639966,0cyclictest60950irq/123-eno108:36:222
233639966,0cyclictest60950irq/123-eno108:26:182
233639966,0cyclictest60950irq/123-eno107:45:392
233639966,0cyclictest60950irq/123-eno107:15:402
233639966,0cyclictest60950irq/123-eno107:10:112
233639965,1cyclictest60950irq/123-eno111:05:162
233639965,1cyclictest60950irq/123-eno109:15:082
233639965,1cyclictest60950irq/123-eno107:25:142
233639964,1cyclictest60950irq/123-eno108:00:162
233639964,1cyclictest60950irq/123-eno107:35:122
233639964,1cyclictest28-21ksoftirqd/207:30:142
233639964,1cyclictest24248-21ntpq10:45:182
233639963,2cyclictest1919-21apt-get08:40:162
233639963,2cyclictest18093-21tr08:05:142
233639962,2cyclictest570-21systemd-logind09:05:232
233639962,2cyclictest0-21swapper/208:15:132
233639961,4cyclictest5502-21awk08:45:192
233639961,3cyclictest0-21swapper/207:40:122
233639960,5cyclictest0-21swapper/208:20:162
233639960,2cyclictest0-21swapper/207:55:132
233629962,3cyclictest0-21swapper/112:10:501
233629961,1cyclictest0-21swapper/109:44:421
233629960,6cyclictest0-21swapper/111:11:261
233629960,6cyclictest0-21swapper/110:12:371
233629960,6cyclictest0-21swapper/109:11:541
233629960,5cyclictest0-21swapper/111:20:111
233629960,4cyclictest0-21swapper/111:53:581
233629960,4cyclictest0-21swapper/110:55:161
233629960,4cyclictest0-21swapper/110:01:251
233629960,4cyclictest0-21swapper/109:23:481
233629960,3cyclictest0-21swapper/111:59:321
233629960,3cyclictest0-21swapper/110:35:201
233629960,3cyclictest0-21swapper/110:22:141
233629960,3cyclictest0-21swapper/108:00:131
233629960,2cyclictest0-21swapper/112:05:141
233629960,2cyclictest0-21swapper/111:00:461
233629960,2cyclictest0-21swapper/109:49:201
233629960,1cyclictest0-21swapper/111:40:121
233629960,1cyclictest0-21swapper/110:40:251
233579965,1cyclictest9-21ksoftirqd/008:55:000
233579965,1cyclictest9-21ksoftirqd/007:15:010
233579965,1cyclictest5402-21ntpq08:45:170
233579964,1cyclictest24896-21/usr/sbin/munin08:20:210
233579963,2cyclictest10477-21cron07:50:010
233579962,2cyclictest22515-21apt-get08:15:130
233579961,1cyclictest0-21swapper/008:05:160
233579960,0cyclictest0-21swapper/007:55:220
16370260,0sleep10-21swapper/109:50:231
233639955,0cyclictest60950irq/123-eno108:30:152
233639953,1cyclictest74842sleep208:50:172
233639951,3cyclictest0-21swapper/208:55:112
233629952,2cyclictest0-21swapper/109:05:151
233629951,2cyclictest0-21swapper/112:30:171
233629951,2cyclictest0-21swapper/110:09:211
233629950,5cyclictest0-21swapper/111:30:211
233629950,5cyclictest0-21swapper/109:29:341
233629950,5cyclictest0-21swapper/108:40:201
233629950,5cyclictest0-21swapper/108:25:541
233629950,5cyclictest0-21swapper/108:14:031
233629950,5cyclictest0-21swapper/107:29:051
233629950,4cyclictest0-21swapper/112:35:211
233629950,4cyclictest0-21swapper/112:20:161
233629950,4cyclictest0-21swapper/112:01:121
233629950,4cyclictest0-21swapper/111:08:251
233629950,4cyclictest0-21swapper/110:15:511
233629950,4cyclictest0-21swapper/108:05:161
233629950,3cyclictest0-21swapper/111:45:011
233629950,3cyclictest0-21swapper/111:25:211
233629950,3cyclictest0-21swapper/110:30:021
233629950,2cyclictest0-21swapper/112:25:231
233629950,2cyclictest0-21swapper/111:15:191
233629950,2cyclictest0-21swapper/110:45:181
233629950,2cyclictest0-21swapper/109:55:121
233629950,2cyclictest0-21swapper/109:33:031
233629950,2cyclictest0-21swapper/107:55:131
233629950,1cyclictest0-21swapper/107:15:001
233579954,1cyclictest9-21ksoftirqd/008:40:170
233579953,1cyclictest12829-21cron07:55:000
10597250,0sleep10-21swapper/110:27:171
233629944,0cyclictest0-21swapper/107:41:031
233629943,1cyclictest24299-21chrt08:15:461
233629941,2cyclictest0-21swapper/107:30:131
233629941,1cyclictest0-21swapper/109:35:191
233629941,1cyclictest0-21swapper/108:52:201
233629941,1cyclictest0-21swapper/108:35:131
233629940,3cyclictest0-21swapper/109:00:181
233629940,3cyclictest0-21swapper/108:55:161
233629940,3cyclictest0-21swapper/107:20:121
233629940,1cyclictest0-21swapper/108:45:161
233629932,1cyclictest255682sleep107:13:401
233629931,1cyclictest0-21swapper/108:30:101
233629931,1cyclictest0-21swapper/108:20:131
233629931,1cyclictest0-21swapper/107:45:121
233629930,0cyclictest0-21swapper/107:50:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional