You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-27 - 20:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Mon Oct 27, 2025 12:45:09)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
52452217151,22sleep00-21swapper/007:07:530
51552211160,24sleep20-21swapper/207:06:422
52682207158,24sleep30-21swapper/307:08:123
50872197158,26sleep10-21swapper/107:05:491
309242780,0sleep00-21swapper/011:20:210
139122670,0sleep00-21swapper/009:30:140
63242200,0sleep10-21swapper/107:10:141
551199158,0cyclictest0-21swapper/108:00:151
5519991414,0cyclictest28-21ksoftirqd/210:18:512
5519991413,1cyclictest28-21ksoftirqd/212:00:122
551999130,1cyclictest30573-21diskmemload10:50:132
553399121,8cyclictest12352-21fschecks_time11:40:193
551999127,4cyclictest28-21ksoftirqd/210:55:152
5519991212,0cyclictest28-21ksoftirqd/209:35:552
5519991211,1cyclictest28-21ksoftirqd/211:35:002
5519991211,1cyclictest28-21ksoftirqd/210:05:002
5519991210,1cyclictest28-21ksoftirqd/209:45:212
5533991110,1cyclictest35-21ksoftirqd/307:35:013
551999119,1cyclictest28-21ksoftirqd/212:10:002
551999119,1cyclictest28-21ksoftirqd/211:35:202
551999119,1cyclictest28-21ksoftirqd/211:00:172
551999119,1cyclictest28-21ksoftirqd/209:50:202
5519991110,1cyclictest28-21ksoftirqd/212:10:202
5519991110,1cyclictest28-21ksoftirqd/212:10:192
5519991110,1cyclictest28-21ksoftirqd/211:59:542
5519991110,1cyclictest28-21ksoftirqd/211:54:342
5519991110,1cyclictest28-21ksoftirqd/211:40:572
5519991110,1cyclictest28-21ksoftirqd/211:27:542
5519991110,1cyclictest28-21ksoftirqd/211:15:142
5519991110,1cyclictest28-21ksoftirqd/211:08:572
551999110,5cyclictest254-21systemd-journal09:23:002
550399112,4cyclictest2850-21perf09:59:590
5503991110,1cyclictest9-21ksoftirqd/011:50:000
553399108,1cyclictest35-21ksoftirqd/307:25:133
5533991010,0cyclictest35-21ksoftirqd/311:05:413
551999109,1cyclictest28-21ksoftirqd/212:15:172
551999109,1cyclictest28-21ksoftirqd/210:35:152
551999109,1cyclictest28-21ksoftirqd/210:05:182
551999109,1cyclictest28-21ksoftirqd/209:15:152
551999109,1cyclictest28-21ksoftirqd/209:10:132
551999109,1cyclictest28-21ksoftirqd/209:10:002
551999109,1cyclictest28-21ksoftirqd/208:35:002
551999109,1cyclictest28-21ksoftirqd/208:35:002
551999109,1cyclictest28-21ksoftirqd/207:50:002
551999108,1cyclictest28-21ksoftirqd/211:10:152
551999108,1cyclictest28-21ksoftirqd/209:30:532
551999106,3cyclictest28-21ksoftirqd/209:25:182
5519991010,0cyclictest28-21ksoftirqd/212:36:052
550399109,1cyclictest9-21ksoftirqd/007:30:000
55339999,0cyclictest35-21ksoftirqd/310:46:383
55339998,1cyclictest7392-21switchtime09:20:213
55199999,0cyclictest4919-21sensors10:45:192
55199999,0cyclictest28-21ksoftirqd/212:30:202
55199999,0cyclictest28-21ksoftirqd/212:20:142
55199999,0cyclictest28-21ksoftirqd/210:40:182
55199999,0cyclictest0-21swapper/209:41:252
55199998,1cyclictest60950irq/123-eno109:55:152
55199998,1cyclictest28-21ksoftirqd/211:45:122
55199998,1cyclictest28-21ksoftirqd/211:24:012
55199998,1cyclictest28-21ksoftirqd/210:30:412
55199998,1cyclictest28-21ksoftirqd/210:20:152
55199998,1cyclictest28-21ksoftirqd/210:11:292
55199997,1cyclictest819-21lldpd10:26:162
55199997,1cyclictest28-21ksoftirqd/207:54:592
55199990,6cyclictest0-21swapper/208:05:132
55039998,1cyclictest9-21ksoftirqd/009:20:000
55039998,1cyclictest9-21ksoftirqd/009:05:390
55039992,3cyclictest11419-21perf11:40:000
55339983,3cyclictest30573-21diskmemload11:10:163
55339982,5cyclictest7848-21munin-node10:11:493
55339982,3cyclictest30573-21diskmemload10:30:263
55339981,5cyclictest4638-21apt-get08:15:123
55339981,4cyclictest35-21ksoftirqd/311:20:493
55339980,4cyclictest0-21swapper/310:40:283
55199987,1cyclictest28-21ksoftirqd/212:29:512
55199987,1cyclictest28-21ksoftirqd/209:00:152
55199987,1cyclictest28-21ksoftirqd/208:49:592
55199986,1cyclictest28-21ksoftirqd/208:20:002
55119982,3cyclictest0-21swapper/110:55:361
55039987,1cyclictest9-21ksoftirqd/010:30:150
55039987,1cyclictest557-21nscd09:27:110
55039984,3cyclictest557-21nscd10:13:100
55039981,6cyclictest3489-21ssh10:45:120
55039981,3cyclictest20745-21perf09:40:000
55039980,7cyclictest746-21ssh09:12:180
55039980,7cyclictest19100-21ssh12:34:420
55039980,7cyclictest14675-21ssh11:44:010
55039980,7cyclictest12994-21ssh10:56:060
55039980,6cyclictest254-21systemd-journal11:53:030
55039980,3cyclictest0-21swapper/009:40:130
7761270,0sleep10-21swapper/111:35:011
55339975,1cyclictest403-21ssh12:09:003
55339975,1cyclictest35-21ksoftirqd/307:15:013
55339975,1cyclictest25996-21cron11:59:593
55339975,1cyclictest12995-21ssh09:29:343
55339973,3cyclictest21503-21df_inode09:40:153
55339971,4cyclictest35-21ksoftirqd/310:39:473
55339971,4cyclictest254-21systemd-journal08:50:303
55339971,4cyclictest0-21swapper/309:18:543
55339971,2cyclictest30573-21diskmemload11:47:013
55339970,6cyclictest0-21swapper/312:18:103
55339970,5cyclictest30573-21diskmemload12:32:583
55339970,5cyclictest0-21swapper/312:37:183
55339970,5cyclictest0-21swapper/312:21:063
55199976,1cyclictest28-21ksoftirqd/208:00:202
55199976,1cyclictest28-21ksoftirqd/207:30:162
55199973,2cyclictest60950irq/123-eno108:40:142
55199970,4cyclictest0-21swapper/207:45:002
55199970,1cyclictest0-21swapper/207:35:152
55199970,1cyclictest0-21swapper/207:35:152
55119970,5cyclictest0-21swapper/111:40:121
55119970,4cyclictest0-21swapper/109:36:201
55039977,0cyclictest9-21ksoftirqd/010:35:140
55039976,1cyclictest9-21ksoftirqd/009:00:000
55039976,1cyclictest26154-21cat07:50:130
55039975,1cyclictest9-21ksoftirqd/008:25:010
55039975,1cyclictest29903-21ssh12:05:130
55039974,1cyclictest13650irq/124-ahci[0008:54:540
55039973,2cyclictest254-21systemd-journal07:35:000
55039971,6cyclictest10189-21ssh12:20:230
55039971,5cyclictest28303-21/usr/sbin/munin09:50:200
55039970,6cyclictest17089-21ssh11:02:210
55039970,6cyclictest12476-21ssh12:25:140
55039970,6cyclictest0-21swapper/011:55:250
55039970,5cyclictest1386-21ssh10:40:220
55039970,4cyclictest6625-1kworker/u9:211:34:450
55039970,1cyclictest9445-21ssh10:51:140
55039970,1cyclictest7226-21ssh12:16:590
55039970,1cyclictest30573-21diskmemload09:23:340
55039970,1cyclictest28156-21ssh11:16:590
55039970,1cyclictest23795-21ssh10:27:560
55039970,1cyclictest20859-21latency_hist10:25:010
55039970,1cyclictest20576-21wc12:35:200
55039970,1cyclictest20513-21ssh11:06:040
55039970,1cyclictest1322-21cpuspeed_turbos12:10:150
55039970,1cyclictest1322-21cpuspeed_turbos12:10:150
55039970,1cyclictest0-21swapper/007:49:250
21919270,1sleep121-21ksoftirqd/111:10:001
17754270,1sleep10-21swapper/111:04:211
15301270,2sleep10-21swapper/112:29:241
55339965,1cyclictest6563-21ssh11:31:333
55339965,1cyclictest525-21ssh09:11:453
55339965,1cyclictest3454-21ntpq08:10:223
55339965,1cyclictest2931-21ssh11:26:373
55339965,1cyclictest2022-21ssh09:57:403
55339965,1cyclictest18452-21ntpq09:35:223
55339965,1cyclictest13987-21ssh09:30:153
55339965,1cyclictest13893-21ssh10:15:113
55339964,1cyclictest30573-21diskmemload11:16:093
55339964,1cyclictest22671-21cron07:45:003
55339964,1cyclictest18448-21cat10:20:173
55339964,1cyclictest18193-21basename07:35:123
55339964,1cyclictest18193-21basename07:35:123
55339964,1cyclictest10408-21ssh11:37:133
55339963,2cyclictest30573-21diskmemload11:51:033
55339963,1cyclictest254-21systemd-journal10:00:013
55339963,1cyclictest254-21systemd-journal08:59:293
55339962,2cyclictest30573-21diskmemload10:50:043
55339961,4cyclictest16851-21diskmemload11:01:373
55339961,3cyclictest24708-21apt-get09:45:133
55339961,3cyclictest0-21swapper/308:20:173
55339961,2cyclictest10977-21apt-get10:55:133
55339960,3cyclictest0-21swapper/310:25:133
55339960,3cyclictest0-21swapper/309:52:183
55339960,2cyclictest0-21swapper/312:29:353
55339960,2cyclictest0-21swapper/312:00:443
55339960,2cyclictest0-21swapper/310:05:133
55339960,2cyclictest0-21swapper/307:20:123
55339960,1cyclictest0-21swapper/312:10:143
55339960,1cyclictest0-21swapper/312:10:133
55199966,0cyclictest60950irq/123-eno107:59:262
55199966,0cyclictest60950irq/123-eno107:10:082
55199965,1cyclictest28-21ksoftirqd/208:10:182
55199965,1cyclictest28-21ksoftirqd/207:25:262
55199964,1cyclictest28-21ksoftirqd/208:50:112
55199964,1cyclictest28-21ksoftirqd/208:25:202
55199964,1cyclictest28-21ksoftirqd/208:20:132
55199964,1cyclictest11117-21apt-get07:20:112
55199960,3cyclictest0-21swapper/208:35:132
55199960,1cyclictest0-21swapper/207:15:102
55119960,5cyclictest0-21swapper/109:40:171
55119960,4cyclictest0-21swapper/112:36:071
55119960,4cyclictest0-21swapper/110:05:141
55119960,3cyclictest0-21swapper/111:20:131
55119960,3cyclictest0-21swapper/110:44:491
55119960,3cyclictest0-21swapper/109:31:271
55119960,2cyclictest0-21swapper/112:13:041
55119960,2cyclictest0-21swapper/112:13:041
55039965,1cyclictest9-21ksoftirqd/007:38:260
55039965,1cyclictest9-21ksoftirqd/007:38:250
55039965,1cyclictest6469-21sshd08:16:250
55039965,1cyclictest25319-1kworker/u9:012:00:200
55039965,1cyclictest0-21swapper/008:35:170
55039963,2cyclictest20656-21grep08:45:210
55039963,1cyclictest254-21systemd-journal07:20:010
55039961,5cyclictest715-21/usr/sbin/munin11:25:240
55039960,6cyclictest0-21swapper/008:33:560
55039960,6cyclictest0-21swapper/008:33:550
55039960,6cyclictest0-21swapper/008:11:260
55039960,6cyclictest0-21swapper/007:55:130
55039960,6cyclictest0-21swapper/007:43:350
55039960,5cyclictest30573-21diskmemload10:00:150
55039960,5cyclictest22133-21ssh11:10:100
55039960,5cyclictest17330-21fschecks_time08:40:160
55039960,5cyclictest0-21swapper/008:05:150
55039960,4cyclictest8761-21ssh10:06:100
55039960,1cyclictest24710-21ssh09:45:130
55039960,0cyclictest0-21swapper/010:15:130
55039960,0cyclictest0-21swapper/008:26:250
55039960,0cyclictest0-21swapper/008:00:010
55039960,0cyclictest0-21swapper/007:11:190
19250260,0sleep10-21swapper/112:35:011
55339955,0cyclictest0-21swapper/309:03:233
55339954,1cyclictest35-21ksoftirqd/308:05:553
55339953,1cyclictest32101-21cron08:05:013
55339953,1cyclictest28701-21grep09:05:173
55339952,1cyclictest254-21systemd-journal08:45:013
55339951,1cyclictest25264-21apt-get07:50:103
55339950,3cyclictest27620-21/usr/sbin/munin07:55:223
55339950,2cyclictest8739-21apt-get07:15:093
55339950,1cyclictest254-21systemd-journal07:50:003
55339950,0cyclictest0-21swapper/308:45:123
55199955,0cyclictest60950irq/123-eno108:56:072
55119952,1cyclictest0-21swapper/110:20:191
55119952,1cyclictest0-21swapper/109:20:121
55119952,1cyclictest0-21swapper/107:20:131
55119951,3cyclictest0-21swapper/112:15:101
55119951,2cyclictest0-21swapper/109:45:081
55119951,2cyclictest0-21swapper/108:45:121
55119950,5cyclictest0-21swapper/110:53:161
55119950,5cyclictest0-21swapper/110:25:221
55119950,5cyclictest0-21swapper/108:05:211
55119950,4cyclictest0-21swapper/109:58:001
55119950,3cyclictest0-21swapper/112:00:001
55119950,3cyclictest0-21swapper/111:35:541
55119950,3cyclictest0-21swapper/111:26:311
55119950,3cyclictest0-21swapper/111:17:001
55119950,3cyclictest0-21swapper/111:11:371
55119950,3cyclictest0-21swapper/110:04:451
55119950,3cyclictest0-21swapper/109:10:011
55119950,2cyclictest0-21swapper/111:49:351
55119950,2cyclictest0-21swapper/110:47:311
55119950,2cyclictest0-21swapper/110:31:301
55119950,2cyclictest0-21swapper/109:51:061
55119950,1cyclictest0-21swapper/111:50:151
55039953,1cyclictest8980-21tr07:15:110
55339943,1cyclictest10509-21ntpq08:25:193
55339942,1cyclictest14294-21aten_r1power_cu08:35:133
55339940,1cyclictest254-21systemd-journal08:30:133
55339940,1cyclictest254-21systemd-journal08:30:133
55119942,1cyclictest0-21swapper/108:15:191
55119940,4cyclictest0-21swapper/108:30:221
55119940,4cyclictest0-21swapper/108:30:221
55119940,3cyclictest0-21swapper/112:20:431
55119940,3cyclictest0-21swapper/110:16:281
55119940,2cyclictest0-21swapper/112:05:141
55119940,2cyclictest0-21swapper/110:35:181
55119940,2cyclictest0-21swapper/109:25:231
55119940,2cyclictest0-21swapper/108:20:131
55119940,1cyclictest0-21swapper/112:00:301
55119940,1cyclictest0-21swapper/109:15:161
55119940,1cyclictest0-21swapper/109:10:171
55119940,1cyclictest0-21swapper/107:25:161
55119940,0cyclictest0-21swapper/110:10:181
55039940,4cyclictest0-21swapper/009:00:030
27599240,0sleep121-21ksoftirqd/107:55:011
21368240,1sleep10-21swapper/108:50:111
55119931,2cyclictest0-21swapper/108:10:141
55119931,1cyclictest0-21swapper/109:00:101
55119931,1cyclictest0-21swapper/108:55:151
55119931,1cyclictest0-21swapper/108:35:131
55119931,1cyclictest0-21swapper/108:25:141
55119931,1cyclictest0-21swapper/107:40:141
55119931,1cyclictest0-21swapper/107:35:121
55119931,1cyclictest0-21swapper/107:35:121
55119930,3cyclictest0-21swapper/108:40:211
55119930,2cyclictest24920-21taskset07:48:431
55119930,2cyclictest0-21swapper/107:30:131
55119930,2cyclictest0-21swapper/107:15:091
55119930,0cyclictest0-21swapper/107:55:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional