You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 16:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Thu Nov 27, 2025 12:45:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
285852205171,22sleep00-21swapper/007:08:010
286092203163,26sleep20-21swapper/207:08:192
285282202164,24sleep30-21swapper/307:07:143
287252198161,24sleep10-21swapper/107:09:501
95632560,0sleep30-21swapper/312:36:253
33552180,0sleep10-21swapper/107:20:181
28839991311,1cyclictest1257-21hddtemp_smartct12:25:133
28812991311,1cyclictest9-21ksoftirqd/011:20:000
28839991211,1cyclictest35-21ksoftirqd/307:55:003
2881299120,11cyclictest0-21swapper/011:30:150
2882999110,11cyclictest0-21swapper/211:08:252
2881299119,1cyclictest9-21ksoftirqd/011:05:130
2881299119,1cyclictest9-21ksoftirqd/007:50:000
28812991110,1cyclictest9-21ksoftirqd/011:55:160
28812991110,1cyclictest9-21ksoftirqd/010:55:010
28812991110,1cyclictest9-21ksoftirqd/009:30:150
28812991110,1cyclictest22471-21cat10:40:000
2882999109,1cyclictest28-21ksoftirqd/211:00:562
28829991010,0cyclictest0-21swapper/211:28:002
2882999100,5cyclictest60950irq/123-eno111:51:182
2881299109,1cyclictest9-21ksoftirqd/011:45:200
2881299109,1cyclictest9-21ksoftirqd/010:20:010
2881299109,1cyclictest9-21ksoftirqd/008:40:000
2881299108,1cyclictest9-21ksoftirqd/011:00:000
2881299108,0cyclictest14288-21ssh09:42:290
2881299100,6cyclictest30969-21wc11:35:210
288399990,4cyclictest0-21swapper/309:20:123
288299998,1cyclictest28-21ksoftirqd/207:45:012
288299997,1cyclictest28-21ksoftirqd/209:09:592
288129999,0cyclictest9-21ksoftirqd/009:55:170
288129999,0cyclictest9-21ksoftirqd/009:30:000
288129999,0cyclictest21582-21diskmemload12:14:080
288129998,1cyclictest9-21ksoftirqd/011:25:180
288129998,1cyclictest9-21ksoftirqd/010:05:230
288129998,1cyclictest9-21ksoftirqd/009:15:120
288129998,1cyclictest9-21ksoftirqd/007:30:140
288129997,1cyclictest9-21ksoftirqd/012:20:150
288129997,1cyclictest9-21ksoftirqd/008:30:000
288129997,1cyclictest9-21ksoftirqd/008:05:000
288129997,1cyclictest9-21ksoftirqd/007:35:120
288129991,4cyclictest21582-21diskmemload11:44:320
288399987,1cyclictest35-21ksoftirqd/311:27:443
288399985,1cyclictest254-21systemd-journal09:44:283
288399984,3cyclictest16838-21users12:00:183
288399981,3cyclictest23366-21hwlatdetect09:55:163
288399980,6cyclictest0-21swapper/310:28:363
288399980,5cyclictest0-21swapper/308:30:123
288399980,4cyclictest6163-21runrttasks11:45:233
288399980,4cyclictest0-21swapper/312:10:123
288299986,1cyclictest8618-21ntpq12:35:172
288299986,1cyclictest60950irq/123-eno112:25:102
288299986,1cyclictest60950irq/123-eno112:20:192
288299986,1cyclictest60950irq/123-eno110:50:142
288299986,1cyclictest60950irq/123-eno110:05:552
288299986,1cyclictest60950irq/123-eno108:55:122
288299986,1cyclictest60950irq/123-eno108:15:142
288299986,1cyclictest60950irq/123-eno107:55:182
288299986,1cyclictest28-21ksoftirqd/208:45:002
288299986,1cyclictest28-21ksoftirqd/208:40:002
288299986,1cyclictest18707-21perf10:35:002
288299985,2cyclictest31423-21munin-node12:02:502
288299984,3cyclictest31423-21munin-node10:44:512
288299982,5cyclictest20959-21sh10:36:002
288299981,4cyclictest28-21ksoftirqd/209:38:142
288129988,0cyclictest9-21ksoftirqd/012:15:190
288129988,0cyclictest9-21ksoftirqd/008:30:190
288129987,1cyclictest9-21ksoftirqd/008:45:160
288129987,1cyclictest9-21ksoftirqd/008:45:000
288129986,1cyclictest9-21ksoftirqd/011:55:010
288129986,1cyclictest9-21ksoftirqd/010:03:180
288129985,1cyclictest9-21ksoftirqd/011:05:000
288129984,2cyclictest254-21systemd-journal12:05:010
288129983,3cyclictest15391-21apt-get10:30:110
288129981,4cyclictest8269-21apt-get10:20:110
288129981,4cyclictest21582-21diskmemload12:29:410
288129980,7cyclictest18757-21grep12:05:120
288129980,7cyclictest0-21swapper/010:40:140
288129980,5cyclictest0-21swapper/008:55:110
288129980,1cyclictest14360-21ssh10:27:430
288399976,1cyclictest8785-21ntpq08:40:173
288399976,1cyclictest35-21ksoftirqd/308:05:003
288399975,1cyclictest3177-21ssh09:27:353
288399975,1cyclictest19441-21idleruntime12:05:143
288399974,1cyclictest27730-21ssh09:16:423
288399973,3cyclictest568-21nscd11:04:193
288399972,3cyclictest35-21ksoftirqd/308:55:143
288399972,1cyclictest788-21lldpd09:32:133
288399971,5cyclictest22563-21ssh10:40:123
288399970,5cyclictest0-21swapper/311:31:363
288399970,4cyclictest0-21swapper/310:32:363
288399970,3cyclictest0-21swapper/310:19:523
288399970,3cyclictest0-21swapper/310:10:133
288399970,3cyclictest0-21swapper/309:50:113
288399970,2cyclictest21582-21diskmemload10:53:213
288399970,2cyclictest0-21swapper/309:10:513
288299976,1cyclictest60950irq/123-eno112:11:512
288299976,1cyclictest60950irq/123-eno111:55:222
288299976,1cyclictest60950irq/123-eno111:34:272
288299976,1cyclictest60950irq/123-eno110:23:092
288299976,1cyclictest60950irq/123-eno110:16:412
288299976,1cyclictest60950irq/123-eno109:42:172
288299976,1cyclictest60950irq/123-eno109:28:402
288299976,1cyclictest60950irq/123-eno108:25:112
288299976,1cyclictest28-21ksoftirqd/209:45:002
288299975,1cyclictest60950irq/123-eno109:50:152
288299975,1cyclictest60950irq/123-eno109:20:162
288299975,1cyclictest32294-21ssh11:38:472
288299975,1cyclictest2076-21ssh11:40:192
288299975,1cyclictest16107-21cat11:15:172
288299974,2cyclictest4235-21sendmail-msp11:00:002
288299974,2cyclictest23559-21missed_timers09:55:162
288299974,1cyclictest254-21systemd-journal12:10:002
288299973,2cyclictest254-21systemd-journal07:35:002
288299972,1cyclictest21582-21diskmemload09:30:192
288299971,5cyclictest25451-21apt-get09:15:112
288299971,3cyclictest27143-21cat10:45:182
288299970,5cyclictest68892sleep211:47:422
288299970,4cyclictest0-21swapper/212:30:072
288299970,3cyclictest0-21swapper/210:10:172
288299970,3cyclictest0-21swapper/210:00:152
288299970,2cyclictest0-21swapper/210:25:072
288209971,3cyclictest0-21swapper/109:15:141
288209970,7cyclictest0-21swapper/108:05:581
288209970,4cyclictest0-21swapper/111:26:401
288209970,3cyclictest0-21swapper/109:55:001
288209970,2cyclictest0-21swapper/110:40:111
288209970,1cyclictest0-21swapper/111:40:201
288209970,1cyclictest0-21swapper/111:15:121
288129977,0cyclictest9-21ksoftirqd/011:20:130
288129977,0cyclictest9-21ksoftirqd/007:15:000
288129976,1cyclictest9-21ksoftirqd/012:30:170
288129976,1cyclictest9-21ksoftirqd/008:20:130
288129976,1cyclictest29126-21cat08:15:150
288129975,1cyclictest9-21ksoftirqd/009:35:100
288129975,1cyclictest2887-21ssh10:10:290
288129970,6cyclictest32758-1kworker/u9:111:12:380
288129970,6cyclictest23645-21ssh09:10:280
288129970,6cyclictest0-21swapper/007:40:150
288129970,5cyclictest254-21systemd-journal09:47:140
288129970,2cyclictest254-21systemd-journal07:17:000
288399965,1cyclictest3557-21ssh10:58:083
288399965,1cyclictest31446-21ssh12:21:193
288399965,1cyclictest26878-21ssh10:45:163
288399965,1cyclictest19752-21ntpq07:55:173
288399964,1cyclictest8842-21cat11:50:153
288399964,1cyclictest2522-21grep11:40:213
288399964,1cyclictest24659-21ntpq08:05:163
288399964,1cyclictest21582-21diskmemload11:12:543
288399964,1cyclictest15597-21cpu09:45:133
288399964,1cyclictest1420-21/usr/sbin/munin07:15:213
288399963,2cyclictest29414-21apt-get11:35:113
288399963,1cyclictest254-21systemd-journal08:14:593
288399962,3cyclictest9146-21apt-get07:35:113
288399962,2cyclictest21582-21diskmemload11:17:183
288399961,0cyclictest18972-21apt-get10:35:113
288399960,6cyclictest0-21swapper/310:05:033
288399960,5cyclictest0-21swapper/312:15:203
288399960,2cyclictest21582-21diskmemload10:20:473
288399960,2cyclictest0-21swapper/312:31:073
288399960,2cyclictest0-21swapper/311:22:283
288399960,2cyclictest0-21swapper/310:00:583
288299966,0cyclictest60950irq/123-eno111:10:032
288299966,0cyclictest60950irq/123-eno109:10:132
288299966,0cyclictest60950irq/123-eno108:45:062
288299966,0cyclictest60950irq/123-eno108:34:082
288299966,0cyclictest60950irq/123-eno107:50:152
288299966,0cyclictest60950irq/123-eno107:45:122
288299966,0cyclictest60950irq/123-eno107:24:102
288299966,0cyclictest60950irq/123-eno107:10:112
288299965,1cyclictest60950irq/123-eno111:21:222
288299964,1cyclictest60950irq/123-eno108:50:202
288299964,1cyclictest31712-21strings08:20:142
288299963,1cyclictest28-21ksoftirqd/208:00:102
288299960,1cyclictest0-21swapper/212:15:162
288299960,0cyclictest0-21swapper/207:15:192
288209961,3cyclictest0-21swapper/111:00:301
288209961,3cyclictest0-21swapper/110:02:271
288209961,2cyclictest0-21swapper/109:25:181
288209960,5cyclictest0-21swapper/111:45:211
288209960,5cyclictest0-21swapper/107:40:171
288209960,4cyclictest0-21swapper/112:19:171
288209960,4cyclictest0-21swapper/111:55:181
288209960,4cyclictest0-21swapper/110:22:211
288209960,4cyclictest0-21swapper/107:15:001
288209960,3cyclictest0-21swapper/110:25:091
288209960,3cyclictest0-21swapper/109:10:041
288209960,2cyclictest0-21swapper/111:50:081
288209960,2cyclictest0-21swapper/111:20:111
288209960,2cyclictest0-21swapper/110:45:141
288209960,2cyclictest0-21swapper/110:33:471
288209960,2cyclictest0-21swapper/110:10:141
288209960,2cyclictest0-21swapper/109:58:171
288209960,1cyclictest0-21swapper/112:10:121
288209960,1cyclictest0-21swapper/112:01:471
288209960,1cyclictest0-21swapper/111:13:011
288129966,0cyclictest9-21ksoftirqd/010:45:170
288129965,1cyclictest9-21ksoftirqd/009:00:140
288129965,1cyclictest7409-21ssh12:35:010
288129964,1cyclictest9-21ksoftirqd/007:25:110
288129963,1cyclictest254-21systemd-journal08:06:110
288129962,0cyclictest20380-21ssh09:50:200
288129960,6cyclictest0-21swapper/007:52:030
288129960,5cyclictest25880-21/usr/sbin/munin08:10:150
288129960,0cyclictest21582-21diskmemload09:20:130
288399954,1cyclictest8066-21ssh11:05:073
288399954,1cyclictest5580-21cpuspeed_turbos08:35:103
288399954,0cyclictest21582-21diskmemload11:55:163
288399953,1cyclictest21582-21diskmemload09:35:213
288399953,1cyclictest2117-21wc08:25:183
288399953,1cyclictest11781-21tr07:40:153
288399952,1cyclictest3281-21ls07:20:193
288399952,1cyclictest254-21systemd-journal09:00:003
288399952,1cyclictest254-21systemd-journal08:50:003
288399950,5cyclictest0-21swapper/308:51:523
288399950,3cyclictest7290-21df07:30:143
288299954,1cyclictest60950irq/123-eno109:00:142
288299954,1cyclictest60950irq/123-eno107:25:102
288299953,1cyclictest60950irq/123-eno108:10:102
288299953,1cyclictest0-21swapper/207:35:142
288299950,3cyclictest0-21swapper/208:05:022
288209951,3cyclictest0-21swapper/112:26:271
288209951,3cyclictest0-21swapper/110:15:531
288209951,2cyclictest0-21swapper/111:05:011
288209951,1cyclictest0-21swapper/108:15:141
288209950,4cyclictest0-21swapper/112:07:001
288209950,3cyclictest0-21swapper/110:50:151
288209950,3cyclictest0-21swapper/109:21:061
288209950,3cyclictest0-21swapper/108:10:191
288209950,2cyclictest0-21swapper/112:35:191
288209950,2cyclictest0-21swapper/112:30:061
288209950,2cyclictest0-21swapper/111:31:141
288209950,2cyclictest0-21swapper/110:55:181
288209950,2cyclictest0-21swapper/109:00:161
288209950,2cyclictest0-21swapper/107:55:251
288209950,1cyclictest0-21swapper/111:35:111
288209950,1cyclictest0-21swapper/110:07:531
288209950,1cyclictest0-21swapper/109:40:211
288209950,1cyclictest0-21swapper/109:30:151
288129955,0cyclictest9-21ksoftirqd/007:55:010
288129952,1cyclictest254-21systemd-journal08:52:580
288129950,4cyclictest2077-21/usr/sbin/munin07:20:130
288129950,0cyclictest0-21swapper/009:08:140
288399942,1cyclictest32298-21unixbench_multi08:20:193
288399942,1cyclictest29271-21tr07:10:143
288399941,2cyclictest28240-21apt-get08:15:113
288399941,2cyclictest13879-21apt-get07:45:103
288399941,1cyclictest5599-21ntpq07:25:163
288399940,1cyclictest0-21swapper/309:05:123
288209943,1cyclictest142942sleep108:52:411
288209942,2cyclictest0-21swapper/107:25:131
288209942,1cyclictest311672sleep112:20:251
288209941,1cyclictest0-21swapper/108:00:181
288209940,3cyclictest0-21swapper/109:45:141
288209940,2cyclictest0-21swapper/109:36:161
288209940,1cyclictest0-21swapper/110:35:191
288209940,1cyclictest0-21swapper/108:56:371
288209940,1cyclictest0-21swapper/108:45:151
288209940,1cyclictest0-21swapper/108:25:591
288209940,1cyclictest0-21swapper/107:35:111
288209940,1cyclictest0-21swapper/107:10:201
288209931,1cyclictest0-21swapper/109:05:091
288209931,1cyclictest0-21swapper/107:45:121
288209930,2cyclictest0-21swapper/107:30:131
288209930,1cyclictest0-21swapper/108:35:101
288209930,1cyclictest0-21swapper/108:30:111
288209930,1cyclictest0-21swapper/108:20:151
288209930,0cyclictest0-21swapper/108:40:171
288209930,0cyclictest0-21swapper/107:50:221
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional