You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-21 - 22:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack1slot1.osadl.org (updated Thu Aug 21, 2025 12:45:10)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31112220157,24sleep10-21swapper/107:09:391
31082213154,48sleep30-21swapper/307:09:373
29762208158,25sleep00-21swapper/007:07:530
28342204161,30sleep20-21swapper/207:06:022
36762610,0sleep10-21swapper/108:15:181
77892180,0sleep10-21swapper/112:15:171
323199140,1cyclictest0-21swapper/112:10:111
151392140,0sleep10-21swapper/112:25:191
10912140,0sleep30-21swapper/308:10:163
3238991110,1cyclictest28-21ksoftirqd/209:40:012
323899111,10cyclictest0-21swapper/210:16:232
323899110,8cyclictest28211-21apt-get12:00:152
322699118,1cyclictest9-21ksoftirqd/008:10:000
322699112,4cyclictest26223-21ls09:05:000
322699108,1cyclictest9-21ksoftirqd/007:15:120
322699101,4cyclictest4754-21perf08:20:000
322699100,5cyclictest24807-21sed12:40:000
32449991,7cyclictest5617-21munin-node09:54:073
32389999,0cyclictest28-21ksoftirqd/211:40:202
32389997,1cyclictest9368-21apt-get11:35:102
32389991,5cyclictest570-21systemd-logind08:35:192
32269997,1cyclictest9-21ksoftirqd/008:35:000
32269992,6cyclictest21407-21ssh11:06:250
32269992,6cyclictest13230-21nscd08:25:220
32269992,4cyclictest19759-21perf09:40:010
32269992,1cyclictest0-21swapper/010:35:150
10336290,1sleep30-21swapper/310:52:133
32449980,4cyclictest0-21swapper/309:36:413
32449980,2cyclictest553-21diskstats09:15:153
32389987,1cyclictest28-21ksoftirqd/212:15:002
32389986,1cyclictest60950irq/123-eno112:35:182
32389986,1cyclictest60950irq/123-eno110:30:002
32389986,1cyclictest60950irq/123-eno110:13:042
32389986,1cyclictest60950irq/123-eno109:50:162
32389986,1cyclictest60950irq/123-eno109:42:042
32389986,1cyclictest60950irq/123-eno109:15:212
32389986,1cyclictest28-21ksoftirqd/211:45:142
32389986,1cyclictest28-21ksoftirqd/211:45:142
32389983,2cyclictest254-21systemd-journal11:00:432
32389980,1cyclictest742-21runrttasks10:08:052
32319980,4cyclictest0-21swapper/108:25:221
32269986,1cyclictest9-21ksoftirqd/008:55:130
32269982,1cyclictest22737-21ssh09:42:350
32269980,7cyclictest7940-21ssh09:25:110
32269980,7cyclictest5068-21ssh10:01:550
32269980,7cyclictest28552-21diskmemload12:08:400
32269980,7cyclictest19856-21ssh10:21:040
32269980,7cyclictest1798-21ssh09:58:180
32269980,7cyclictest15100-21missed_timers12:25:180
32269980,7cyclictest0-21swapper/009:10:180
32269980,5cyclictest23948-21ssh09:45:120
32269980,3cyclictest27674-21ssh09:50:150
20048280,1sleep30-21swapper/310:21:373
19600280,1sleep20-21swapper/212:30:412
12276280,0sleep20-21swapper/209:30:132
32449977,0cyclictest35-21ksoftirqd/312:01:123
32449976,1cyclictest30247-21sensors09:10:223
32449975,1cyclictest16294-21ssh12:26:433
32449973,3cyclictest16431-21nscd12:19:473
32449972,4cyclictest6491-21memory11:30:163
32449972,3cyclictest28552-21diskmemload09:55:143
32449972,3cyclictest14927-21ntp_states07:30:193
32449972,2cyclictest254-21systemd-journal10:17:573
32449970,7cyclictest0-21swapper/312:23:033
32449970,6cyclictest10340-21ssh10:10:133
32449970,3cyclictest0-21swapper/310:06:163
32389976,1cyclictest60950irq/123-eno112:26:342
32389976,1cyclictest60950irq/123-eno111:55:122
32389976,1cyclictest60950irq/123-eno111:25:502
32389976,1cyclictest60950irq/123-eno111:15:122
32389976,1cyclictest60950irq/123-eno110:45:052
32389976,1cyclictest60950irq/123-eno110:33:292
32389976,1cyclictest60950irq/123-eno110:33:292
32389976,1cyclictest60950irq/123-eno108:05:162
32389976,0cyclictest60950irq/123-eno112:20:152
32389975,1cyclictest60950irq/123-eno111:05:222
32389975,1cyclictest60950irq/123-eno110:40:152
32389975,1cyclictest22979-21perf07:50:002
32389975,1cyclictest20235-21cat08:50:162
32389975,1cyclictest0-21swapper/209:12:032
32389975,1cyclictest0-21swapper/208:26:202
32389974,2cyclictest32159-21cstates12:05:102
32389973,3cyclictest3968-21apt-get09:20:122
32389973,2cyclictest570-21systemd-logind07:10:202
32389971,5cyclictest28420-21kworker/2:210:37:322
32389970,6cyclictest0-21swapper/210:00:202
32389970,4cyclictest24036-21perf11:55:002
32389970,3cyclictest0-21swapper/211:21:202
32319971,3cyclictest0-21swapper/109:20:191
32319970,7cyclictest0-21swapper/111:58:201
32319970,7cyclictest0-21swapper/109:15:341
32319970,4cyclictest0-21swapper/111:45:181
32319970,4cyclictest0-21swapper/111:45:181
32319970,4cyclictest0-21swapper/110:02:371
32319970,2cyclictest0-21swapper/110:35:211
32319970,1cyclictest0-21swapper/109:44:241
32269976,1cyclictest20845-21/usr/sbin/munin07:45:130
32269975,2cyclictest15429-21ssh11:00:000
32269974,1cyclictest254-21systemd-journal08:45:000
32269974,1cyclictest254-21systemd-journal08:45:000
32269973,2cyclictest254-21systemd-journal08:00:000
32269971,6cyclictest25583-21ssh11:12:430
32269971,6cyclictest12133-21ssh09:30:080
32269971,4cyclictest0-21swapper/012:00:450
32269970,7cyclictest6066-21ssh10:45:380
32269970,7cyclictest0-21swapper/007:39:350
32269970,6cyclictest6423-21ssh09:22:030
32269970,6cyclictest5310-1kworker/u9:110:05:080
32269970,6cyclictest28552-21diskmemload12:11:060
32269970,6cyclictest28552-21diskmemload11:30:210
32269970,6cyclictest28552-21diskmemload10:55:020
32269970,6cyclictest28552-21diskmemload10:10:130
32269970,6cyclictest2372-21ssh10:40:510
32269970,6cyclictest15829-21ssh11:43:070
32269970,6cyclictest14041-21apt-get10:15:120
32269970,6cyclictest12965-21tune2fs08:35:140
32269970,6cyclictest0-21swapper/012:30:170
32269970,6cyclictest0-21swapper/011:45:120
32269970,6cyclictest0-21swapper/011:45:120
32269970,6cyclictest0-21swapper/011:35:240
32269970,6cyclictest0-21swapper/011:20:140
32269970,5cyclictest0-21swapper/007:25:050
32269970,2cyclictest0-21swapper/008:10:140
32269970,1cyclictest28552-21diskmemload11:56:120
32269970,1cyclictest26651-21processes10:30:210
32269970,1cyclictest26651-21processes10:30:210
32269970,1cyclictest0-21swapper/012:15:110
32269970,1cyclictest0-21swapper/009:15:380
32269970,1cyclictest0-21swapper/007:50:160
31614270,1sleep30-21swapper/310:37:313
19886270,0sleep10-21swapper/109:40:011
32449966,0cyclictest28552-21diskmemload11:07:143
32449966,0cyclictest28552-21diskmemload09:26:503
32449965,1cyclictest6218-21ssh10:46:043
32449965,1cyclictest4603-21ssh10:00:353
32449965,1cyclictest3945-21ssh09:20:093
32449965,1cyclictest3608-21ssh11:25:393
32449965,1cyclictest30349-21ssh11:20:013
32449965,1cyclictest23067-21ssh09:43:273
32449965,1cyclictest21556-21ssh10:25:113
32449965,1cyclictest1748-21ssh12:06:573
32449965,1cyclictest11747-21ssh11:37:043
32449964,1cyclictest5483-21ssh12:12:113
32449964,1cyclictest27405-21ssh10:31:173
32449964,1cyclictest27405-21ssh10:31:173
32449963,2cyclictest554-21in:imuxsock08:35:003
32449963,1cyclictest254-21systemd-journal09:50:003
32449963,1cyclictest254-21systemd-journal07:44:093
32449962,1cyclictest28552-21diskmemload11:18:323
32449961,4cyclictest0-21swapper/307:25:163
32449960,4cyclictest0-21swapper/311:40:363
32449960,3cyclictest0-21swapper/311:54:443
32449960,3cyclictest0-21swapper/309:33:213
32449960,2cyclictest0-21swapper/312:35:593
32449960,2cyclictest0-21swapper/311:58:363
32449960,2cyclictest0-21swapper/311:47:503
32449960,2cyclictest0-21swapper/311:47:503
32449960,2cyclictest0-21swapper/310:55:133
32449960,2cyclictest0-21swapper/307:45:143
32449960,0cyclictest28552-21diskmemload10:40:083
32449960,0cyclictest0-21swapper/307:55:123
32389966,0cyclictest60950irq/123-eno112:15:222
32389966,0cyclictest60950irq/123-eno111:30:162
32389966,0cyclictest60950irq/123-eno110:55:122
32389966,0cyclictest60950irq/123-eno109:45:262
32389966,0cyclictest60950irq/123-eno109:25:442
32389966,0cyclictest60950irq/123-eno109:09:112
32389966,0cyclictest60950irq/123-eno108:49:132
32389966,0cyclictest60950irq/123-eno108:40:122
32389966,0cyclictest60950irq/123-eno108:40:122
32389966,0cyclictest60950irq/123-eno108:00:392
32389966,0cyclictest60950irq/123-eno107:57:212
32389966,0cyclictest0-21swapper/209:58:052
32389965,1cyclictest60950irq/123-eno111:10:072
32389965,1cyclictest60950irq/123-eno110:20:132
32389964,1cyclictest8940-21ssh10:50:182
32389964,1cyclictest60950irq/123-eno108:30:202
32389964,1cyclictest28-21ksoftirqd/208:25:002
32389964,1cyclictest28-21ksoftirqd/208:15:152
32389964,1cyclictest28-21ksoftirqd/207:30:132
32389963,1cyclictest28-21ksoftirqd/207:20:002
32319963,0cyclictest0-21swapper/108:00:221
32319960,6cyclictest0-21swapper/107:55:161
32319960,5cyclictest0-21swapper/112:32:371
32319960,1cyclictest0-21swapper/111:51:581
32319960,1cyclictest0-21swapper/111:25:211
32319960,1cyclictest0-21swapper/110:30:211
32319960,1cyclictest0-21swapper/110:30:211
32319960,1cyclictest0-21swapper/109:51:421
32319960,1cyclictest0-21swapper/109:14:031
32319960,0cyclictest0-21swapper/111:15:301
32319960,0cyclictest0-21swapper/111:14:311
32319960,0cyclictest0-21swapper/110:52:021
32319960,0cyclictest0-21swapper/108:05:301
32269965,1cyclictest10370-21ssh12:20:050
32269964,1cyclictest0-21swapper/007:30:200
32269960,6cyclictest2557-21ssh11:25:190
32269960,6cyclictest0-21swapper/010:50:320
32269960,6cyclictest0-21swapper/008:23:280
32269960,6cyclictest0-21swapper/008:00:230
32269960,6cyclictest0-21swapper/007:10:050
32269960,5cyclictest26426-21/usr/sbin/munin09:05:180
32269960,5cyclictest22713-21ssh11:51:120
32269960,0cyclictest0-21swapper/011:15:160
32269960,0cyclictest0-21swapper/010:25:020
32269960,0cyclictest0-21swapper/008:50:020
32269960,0cyclictest0-21swapper/008:48:200
32269960,0cyclictest0-21swapper/007:40:130
32269960,0cyclictest0-21swapper/007:20:120
32449954,1cyclictest742-21runrttasks07:11:093
32449954,1cyclictest25198-21ssh11:11:383
32449954,1cyclictest17797-21hddtemp_smartct08:45:163
32449954,1cyclictest15460-21ssh11:00:063
32449953,1cyclictest5880-21ntp_states07:15:003
32449953,1cyclictest3608-21missed_timers08:15:183
32449953,1cyclictest31423-21ntpq08:05:193
32449952,1cyclictest254-21systemd-journal08:55:553
32449952,1cyclictest254-21systemd-journal08:45:003
32449952,1cyclictest254-21systemd-journal08:45:003
32449951,3cyclictest6682-21users08:20:213
32449950,3cyclictest24007-21hddtemp_smartct07:50:163
32449950,3cyclictest0-21swapper/308:35:123
32449950,3cyclictest0-21swapper/308:25:143
32449950,1cyclictest0-21swapper/312:31:043
32389955,0cyclictest60950irq/123-eno108:10:132
32389955,0cyclictest60950irq/123-eno107:35:142
32389955,0cyclictest60950irq/123-eno107:20:162
32389953,1cyclictest23505-21cpuspeed_turbos07:50:142
32389951,2cyclictest0-21swapper/207:25:132
32389950,5cyclictest0-21swapper/209:00:482
32389950,5cyclictest0-21swapper/207:40:482
32389950,4cyclictest21838-21cut08:55:142
32319953,1cyclictest104222sleep107:20:201
32319951,3cyclictest0-21swapper/110:07:061
32319951,1cyclictest0-21swapper/110:40:121
32319950,5cyclictest0-21swapper/110:23:211
32319950,5cyclictest0-21swapper/109:56:021
32319950,4cyclictest9334-21chrt11:35:041
32319950,4cyclictest0-21swapper/111:40:141
32319950,4cyclictest0-21swapper/109:30:011
32319950,3cyclictest0-21swapper/111:21:401
32319950,3cyclictest0-21swapper/110:16:141
32319950,3cyclictest0-21swapper/107:35:141
32319950,2cyclictest0-21swapper/112:20:181
32319950,2cyclictest0-21swapper/111:05:131
32319950,2cyclictest0-21swapper/111:00:161
32319950,2cyclictest0-21swapper/110:55:201
32319950,2cyclictest0-21swapper/110:25:201
32319950,2cyclictest0-21swapper/110:10:131
32319950,1cyclictest0-21swapper/112:35:211
32319950,0cyclictest0-21swapper/112:00:151
32319950,0cyclictest0-21swapper/110:47:211
32449942,1cyclictest27699-21wc09:05:193
32449942,1cyclictest19934-21grep08:50:153
32449940,4cyclictest0-21swapper/307:37:243
32449940,3cyclictest0-21swapper/308:00:173
32449940,2cyclictest0-21swapper/307:20:013
32449940,0cyclictest0-21swapper/309:00:153
32319944,0cyclictest0-21swapper/111:31:091
32319941,2cyclictest0-21swapper/107:25:131
32319940,4cyclictest22940-21chrt07:49:511
32319940,4cyclictest0-21swapper/112:05:081
32319940,4cyclictest0-21swapper/108:55:211
32319940,4cyclictest0-21swapper/108:44:151
32319940,4cyclictest0-21swapper/108:44:151
32319940,4cyclictest0-21swapper/108:39:531
32319940,4cyclictest0-21swapper/108:24:401
32319940,4cyclictest0-21swapper/107:43:411
32319940,3cyclictest0-21swapper/107:10:121
32319940,1cyclictest0-21swapper/109:45:121
32319940,1cyclictest0-21swapper/109:05:121
32319940,1cyclictest0-21swapper/108:50:211
32319940,1cyclictest0-21swapper/108:45:121
32319940,1cyclictest0-21swapper/107:50:211
32319940,0cyclictest0-21swapper/109:25:111
32319940,0cyclictest0-21swapper/109:00:201
32319931,1cyclictest0-21swapper/108:10:191
32319931,1cyclictest0-21swapper/107:30:131
32319930,1cyclictest0-21swapper/108:30:011
32319930,1cyclictest0-21swapper/107:15:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional