You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 23:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Thu Dec 04, 2025 12:45:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1638223810,7sleep335-21ksoftirqd/307:05:143
178242234157,62sleep20-21swapper/207:05:342
178572213149,22sleep00-21swapper/007:06:010
179562211173,25sleep10-21swapper/107:07:181
213542160,1sleep228-21ksoftirqd/211:38:222
1826099140,14cyclictest0-21swapper/309:42:433
18254991312,1cyclictest20220-21ntpq10:50:182
18254991311,1cyclictest28-21ksoftirqd/210:30:122
1824299132,5cyclictest29263-21perf08:40:010
18242991312,1cyclictest9-21ksoftirqd/008:24:550
1825499129,3cyclictest28-21ksoftirqd/212:30:212
18254991211,1cyclictest28-21ksoftirqd/209:46:412
18254991211,1cyclictest28-21ksoftirqd/209:25:132
18254991211,1cyclictest22030-21latency_hist09:25:002
18254991210,1cyclictest28-21ksoftirqd/209:15:172
18254991210,1cyclictest28-21ksoftirqd/208:55:002
1825499119,1cyclictest28-21ksoftirqd/212:02:062
1825499119,1cyclictest28-21ksoftirqd/211:15:232
1825499119,1cyclictest28-21ksoftirqd/211:10:162
18254991110,1cyclictest28-21ksoftirqd/212:26:522
18254991110,1cyclictest28-21ksoftirqd/211:25:192
18254991110,1cyclictest28-21ksoftirqd/211:09:462
18254991110,1cyclictest28-21ksoftirqd/210:35:182
18254991110,1cyclictest28-21ksoftirqd/210:04:092
18254991110,1cyclictest28-21ksoftirqd/209:50:012
18242991111,0cyclictest9-21ksoftirqd/012:40:000
18242991111,0cyclictest9-21ksoftirqd/011:05:220
18242991110,1cyclictest9-21ksoftirqd/012:30:000
18242991110,1cyclictest9-21ksoftirqd/012:16:380
18242991110,1cyclictest9-21ksoftirqd/010:00:150
18242991110,1cyclictest9-21ksoftirqd/009:10:000
1826099100,7cyclictest14667-21apt-get12:15:123
1825499109,1cyclictest28-21ksoftirqd/212:07:232
1825499109,1cyclictest28-21ksoftirqd/211:45:172
1825499109,1cyclictest28-21ksoftirqd/211:25:002
1825499109,1cyclictest28-21ksoftirqd/210:46:472
1825499109,1cyclictest28-21ksoftirqd/210:40:152
1825499109,1cyclictest28-21ksoftirqd/210:20:232
1825499109,1cyclictest28-21ksoftirqd/210:10:202
1825499109,1cyclictest28-21ksoftirqd/209:56:452
1825499109,1cyclictest28-21ksoftirqd/209:10:132
1825499109,0cyclictest28-21ksoftirqd/209:35:152
1825499109,0cyclictest28-21ksoftirqd/209:35:152
18254991010,0cyclictest28-21ksoftirqd/212:35:562
1824299109,1cyclictest9-21ksoftirqd/012:30:170
1824299109,1cyclictest9-21ksoftirqd/010:00:000
1824299105,1cyclictest23245-21fschecks_time10:55:170
18242991010,0cyclictest9-21ksoftirqd/010:50:140
1824299101,4cyclictest17428-21perf08:15:000
182609999,0cyclictest35-21ksoftirqd/312:20:213
182609997,1cyclictest5377-21latency_hist07:50:003
182609991,5cyclictest564-21nscd09:25:183
182549999,0cyclictest28-21ksoftirqd/211:55:202
182549999,0cyclictest28-21ksoftirqd/211:30:202
182549999,0cyclictest28-21ksoftirqd/210:16:542
182549998,1cyclictest28-21ksoftirqd/212:20:192
182549998,1cyclictest28-21ksoftirqd/212:15:202
182549998,1cyclictest28-21ksoftirqd/211:00:162
182549998,1cyclictest28-21ksoftirqd/210:25:152
182549998,1cyclictest28-21ksoftirqd/209:43:192
182549997,1cyclictest28-21ksoftirqd/209:10:002
182549997,1cyclictest28-21ksoftirqd/208:35:122
182549997,1cyclictest28-21ksoftirqd/207:30:142
182549997,1cyclictest28-21ksoftirqd/207:15:002
182549996,3cyclictest28-21ksoftirqd/211:40:212
182479997,1cyclictest119292sleep110:40:061
182429998,1cyclictest9-21ksoftirqd/012:20:130
182429998,1cyclictest9-21ksoftirqd/012:10:000
182429998,1cyclictest9-21ksoftirqd/011:10:210
182429998,1cyclictest9-21ksoftirqd/010:40:000
182429998,1cyclictest9-21ksoftirqd/010:20:150
182429998,1cyclictest9-21ksoftirqd/009:30:150
182429997,1cyclictest9-21ksoftirqd/009:35:170
182429997,1cyclictest9-21ksoftirqd/009:35:160
182429997,1cyclictest9-21ksoftirqd/008:20:000
182429997,1cyclictest9-21ksoftirqd/007:15:160
182429995,1cyclictest9-21ksoftirqd/008:50:000
182609986,1cyclictest30197-21cat11:50:163
182609983,2cyclictest570-21systemd-logind10:45:203
182609980,6cyclictest20608-21munin-node07:22:343
182609980,5cyclictest22364-21apt-get08:25:113
182609980,3cyclictest0-21swapper/307:15:133
182549987,1cyclictest28-21ksoftirqd/211:50:422
182549987,1cyclictest28-21ksoftirqd/210:55:412
182549987,1cyclictest28-21ksoftirqd/210:09:502
182549986,1cyclictest60950irq/123-eno112:10:142
182549984,3cyclictest24719-21apt-get08:30:122
182429987,1cyclictest9-21ksoftirqd/011:25:140
182429987,1cyclictest9-21ksoftirqd/011:20:170
182429987,1cyclictest9-21ksoftirqd/008:50:160
182429987,1cyclictest554-21in:imuxsock08:31:320
182429987,0cyclictest18957-21df_inode07:10:130
182429986,1cyclictest9-21ksoftirqd/010:20:000
182429982,5cyclictest1927-21perl10:25:160
182429982,5cyclictest11145-21/usr/sbin/munin12:10:220
182429980,7cyclictest28622-21ssh11:48:490
182429980,7cyclictest2809-21ssh11:57:070
182429980,7cyclictest26218-21gpgv10:15:000
182429980,7cyclictest26162-21/usr/sbin/munin11:00:180
182429980,7cyclictest19122-21ssh10:05:020
182429980,7cyclictest10803-21ssh09:52:190
182429980,4cyclictest12510-21sed08:05:000
182609976,1cyclictest20081-21cat10:05:173
182609975,1cyclictest31949-21ssh11:06:483
182609975,1cyclictest10948-21sh09:10:003
182609974,1cyclictest19940-21latency_hist08:20:003
182609972,2cyclictest5617-21apt-get07:50:123
182609971,4cyclictest31835-21aten_r1power_cu08:45:123
182609971,4cyclictest16801-21ntp_states10:00:173
182609970,6cyclictest6811-21ssh09:45:533
182609970,4cyclictest0-21swapper/312:30:143
182609970,4cyclictest0-21swapper/312:25:023
182609970,4cyclictest0-21swapper/312:01:263
182609970,3cyclictest0-21swapper/311:48:053
182609970,3cyclictest0-21swapper/310:25:173
182609970,3cyclictest0-21swapper/310:24:033
182609970,2cyclictest0-21swapper/311:04:493
182609970,1cyclictest13737-21/usr/sbin/munin10:40:213
182549976,1cyclictest28-21ksoftirqd/208:10:142
182549976,1cyclictest28-21ksoftirqd/207:20:152
182549976,1cyclictest1059-21kworker/2:008:25:192
182549976,1cyclictest1059-21kworker/2:007:35:112
182549975,1cyclictest28-21ksoftirqd/208:50:002
182549975,1cyclictest1059-21kworker/2:007:10:132
182549974,3cyclictest28-21ksoftirqd/209:30:192
182549970,3cyclictest0-21swapper/207:50:122
182479971,4cyclictest200-21jbd2/sda2-807:12:361
182479970,0cyclictest0-21swapper/107:55:181
182429977,0cyclictest9-21ksoftirqd/009:10:230
182429976,1cyclictest9-21ksoftirqd/011:35:160
182429976,1cyclictest30845-21sed07:35:000
182429976,1cyclictest1161-21/usr/sbin/munin09:40:160
182429975,1cyclictest9-21ksoftirqd/008:40:150
182429975,1cyclictest9-21ksoftirqd/008:05:120
182429973,2cyclictest6777-21ntp_states07:50:180
182429971,6cyclictest4848-21ssh09:45:100
182429970,6cyclictest4139-21chrt08:55:150
182429970,6cyclictest15189-21ssh11:30:140
182429970,6cyclictest0-21swapper/011:15:170
182429970,6cyclictest0-21swapper/008:25:130
182429970,3cyclictest0-21swapper/011:50:200
182429970,1cyclictest6240-21ssh12:01:400
182429970,1cyclictest24407-21ssh11:41:450
182429970,1cyclictest22308-21apt-get09:25:130
182429970,1cyclictest20469-21ssh09:20:460
182429970,1cyclictest15824-21ssh09:15:170
182429970,1cyclictest0-21swapper/010:47:060
182429970,1cyclictest0-21swapper/010:40:080
182609966,0cyclictest13429-21sensors09:55:203
182609965,1cyclictest9985-21ssh12:07:173
182609965,1cyclictest7048-21ssh10:31:463
182609965,1cyclictest6363-21ssh11:15:533
182609965,1cyclictest35-21ksoftirqd/308:57:003
182609965,1cyclictest32207-21ssh09:37:023
182609965,1cyclictest32207-21ssh09:37:023
182609965,1cyclictest31426-21ssh12:37:033
182609965,1cyclictest26051-21ssh09:30:063
182609965,1cyclictest21610-21ssh09:23:533
182609965,1cyclictest21175-21ntpq08:20:183
182609965,1cyclictest17243-21sshd08:13:223
182609965,1cyclictest16912-21ssh11:30:293
182609965,1cyclictest13471-21ssh12:12:063
182609965,1cyclictest13068-21ssh09:10:423
182609965,1cyclictest11406-21ssh09:54:053
182609965,1cyclictest10390-21ssh11:22:193
182609964,1cyclictest35-21ksoftirqd/308:40:013
182609964,1cyclictest15384-21fschecks_count09:15:153
182609963,2cyclictest26535-21apt-get10:15:123
182609963,2cyclictest19728-21/usr/sbin/munin11:35:183
182609963,1cyclictest254-21systemd-journal08:33:473
182609963,1cyclictest254-21systemd-journal08:05:003
182609963,1cyclictest10965-21diskmemload11:40:133
182609963,0cyclictest10965-21diskmemload10:13:173
182609962,3cyclictest897-21apt-get07:40:143
182609962,2cyclictest254-21systemd-journal07:39:163
182609960,6cyclictest10965-21diskmemload11:59:353
182609960,4cyclictest0-21swapper/311:27:003
182609960,3cyclictest0-21swapper/310:39:233
182609960,2cyclictest10965-21diskmemload11:10:163
182609960,2cyclictest0-21swapper/308:40:153
182609960,1cyclictest10965-21diskmemload10:59:193
182549966,0cyclictest60950irq/123-eno108:05:122
182549966,0cyclictest60950irq/123-eno107:49:222
182549966,0cyclictest60950irq/123-eno107:40:222
182549965,1cyclictest28-21ksoftirqd/208:55:182
182549965,1cyclictest1059-21kworker/2:008:22:412
182549964,1cyclictest60950irq/123-eno107:25:152
182549964,1cyclictest28-21ksoftirqd/209:00:142
182549964,1cyclictest28-21ksoftirqd/208:40:172
182549964,1cyclictest28-21ksoftirqd/208:15:142
182479966,0cyclictest0-21swapper/112:22:001
182479966,0cyclictest0-21swapper/112:12:051
182479962,2cyclictest0-21swapper/111:07:551
182479960,6cyclictest0-21swapper/110:08:221
182479960,6cyclictest0-21swapper/109:25:271
182479960,4cyclictest0-21swapper/111:55:181
182479960,4cyclictest0-21swapper/110:55:181
182479960,3cyclictest0-21swapper/110:14:541
182479960,3cyclictest0-21swapper/109:30:131
182479960,1cyclictest0-21swapper/111:50:111
182479960,1cyclictest0-21swapper/108:20:121
182429965,1cyclictest4829-21ssh10:30:120
182429965,1cyclictest4423-21ntp_states07:45:160
182429960,6cyclictest0-21swapper/009:00:070
182429960,6cyclictest0-21swapper/007:55:120
182429960,6cyclictest0-21swapper/007:21:540
182429960,2cyclictest0-21swapper/007:40:210
182429960,0cyclictest0-21swapper/007:37:110
182429960,0cyclictest0-21swapper/007:28:440
182609952,2cyclictest3626-21taskset08:52:053
182609951,2cyclictest10098-21perf08:00:003
182609951,1cyclictest19398-21cat10:50:133
182609950,5cyclictest0-21swapper/307:25:213
182609950,2cyclictest6477-21apt-get09:00:123
182549955,0cyclictest60950irq/123-eno107:55:102
182549952,2cyclictest10601-21cpuspeed_turbos08:00:122
182479955,0cyclictest0-21swapper/109:21:581
182479955,0cyclictest0-21swapper/107:27:321
182479951,3cyclictest0-21swapper/111:35:161
182479950,5cyclictest0-21swapper/111:00:561
182479950,5cyclictest0-21swapper/109:00:161
182479950,5cyclictest0-21swapper/108:15:591
182479950,5cyclictest0-21swapper/107:15:171
182479950,4cyclictest0-21swapper/112:00:181
182479950,4cyclictest0-21swapper/111:45:171
182479950,4cyclictest0-21swapper/109:15:411
182479950,3cyclictest0-21swapper/112:19:401
182479950,3cyclictest0-21swapper/111:40:161
182479950,3cyclictest0-21swapper/110:50:151
182479950,3cyclictest0-21swapper/110:38:041
182479950,3cyclictest0-21swapper/109:40:021
182479950,2cyclictest0-21swapper/110:26:351
182479950,2cyclictest0-21swapper/110:00:061
182479950,2cyclictest0-21swapper/109:59:511
182479950,2cyclictest0-21swapper/109:54:111
182479950,2cyclictest0-21swapper/109:10:131
182479950,2cyclictest0-21swapper/107:35:201
182479950,1cyclictest0-21swapper/112:36:431
182479950,1cyclictest0-21swapper/112:31:461
182479950,1cyclictest0-21swapper/112:09:521
182479950,1cyclictest0-21swapper/110:45:121
182479950,1cyclictest0-21swapper/110:22:001
182479950,1cyclictest0-21swapper/108:45:201
182479950,0cyclictest0-21swapper/111:17:341
182609941,2cyclictest12704-21apt-get08:05:123
182609940,1cyclictest28590-21apt-get07:30:113
182609940,1cyclictest18452-21apt-get07:10:113
182479944,0cyclictest0-21swapper/112:29:361
182479944,0cyclictest0-21swapper/108:38:321
182479944,0cyclictest0-21swapper/108:07:441
182479944,0cyclictest0-21swapper/107:47:381
182479943,1cyclictest30518-21chrt07:32:421
182479941,2cyclictest0-21swapper/111:30:221
182479941,2cyclictest0-21swapper/110:15:121
182479941,2cyclictest0-21swapper/109:45:131
182479941,1cyclictest200-21jbd2/sda2-811:10:061
182479941,1cyclictest0-21swapper/108:40:131
182479940,3cyclictest200-21jbd2/sda2-808:10:371
182479940,3cyclictest0-21swapper/110:30:321
182479940,2cyclictest0-21swapper/111:25:121
182479940,2cyclictest0-21swapper/109:10:001
182479940,1cyclictest0-21swapper/111:21:321
182479940,1cyclictest0-21swapper/109:35:281
182479940,1cyclictest0-21swapper/109:35:281
182479932,1cyclictest200-21jbd2/sda2-808:30:181
182479931,1cyclictest0-21swapper/108:55:141
182479931,1cyclictest0-21swapper/107:50:121
182479931,1cyclictest0-21swapper/107:40:131
182479930,3cyclictest0-21swapper/107:20:211
182479930,2cyclictest0-21swapper/108:50:121
182479930,1cyclictest0-21swapper/108:25:181
182479920,1cyclictest10343-21chrt08:00:091
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional