You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 13:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Thu Sep 18, 2025 12:45:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
178142217154,50sleep20-21swapper/207:09:432
175922209172,24sleep10-21swapper/107:06:491
177202208157,26sleep00-21swapper/007:08:290
176062198159,26sleep30-21swapper/307:06:593
22552710,1sleep2254-21systemd-journal11:10:012
85472680,0sleep20-21swapper/211:17:222
20712620,0sleep00-21swapper/011:54:280
272172190,0sleep10-21swapper/110:15:001
1792099153,10cyclictest10779-21diskmemload12:23:020
1792099150,1cyclictest16745-21cut11:29:590
1792099150,1cyclictest0-21swapper/009:45:110
1792099150,1cyclictest0-21swapper/009:00:100
189672140,0sleep20-21swapper/210:02:082
17933991412,1cyclictest10779-21diskmemload10:30:122
1792499140,13cyclictest0-21swapper/107:35:161
1792099140,13cyclictest0-21swapper/011:39:060
1792099140,1cyclictest9524-21apt-get10:35:120
1792099140,1cyclictest29301-21runrttasks09:32:500
1792099140,1cyclictest1723-21sshd12:37:440
1792099140,1cyclictest15489-21hddtemp_smartct09:15:180
1792099140,1cyclictest14500-21sshd08:07:540
1792099140,1cyclictest10779-21diskmemload12:04:500
1792099140,0cyclictest8660-21apt-get09:05:130
1792099140,0cyclictest8660-21apt-get09:05:130
17945991311,1cyclictest2292-21sh10:25:063
1792099132,10cyclictest31363-21apt-get11:05:110
1792099130,1cyclictest0-21swapper/012:15:110
1792099130,1cyclictest0-21swapper/007:45:180
17945991210,1cyclictest35-21ksoftirqd/311:00:013
1794599121,1cyclictest22662-21apt-get09:25:133
1793399129,1cyclictest28-21ksoftirqd/211:54:592
1793399122,3cyclictest2536-21apt-get11:10:122
1793399120,12cyclictest0-21swapper/209:40:132
1792099122,9cyclictest10779-21diskmemload11:48:490
1792099122,9cyclictest10779-21diskmemload11:33:530
1792099122,9cyclictest10779-21diskmemload10:46:020
1792099122,9cyclictest10779-21diskmemload10:01:290
1792099120,2cyclictest31649-21apt-get08:45:130
1792099120,2cyclictest10779-21diskmemload11:57:510
1792099120,2cyclictest10779-21diskmemload10:59:470
1792099120,11cyclictest7140-21memory11:15:160
1792099120,11cyclictest10779-21diskmemload09:42:560
1792099120,11cyclictest0-21swapper/009:26:220
1792099120,1cyclictest10779-21diskmemload11:20:260
1792099120,1cyclictest10779-21diskmemload10:51:070
1792099120,1cyclictest0-21swapper/010:20:190
1792099120,0cyclictest10779-21diskmemload12:11:410
1792099120,0cyclictest10779-21diskmemload10:26:340
1792099120,0cyclictest10779-21diskmemload09:51:420
1792099120,0cyclictest10779-21diskmemload09:24:570
1792099120,0cyclictest0-21swapper/012:25:420
1792099120,0cyclictest0-21swapper/012:05:200
79212110,0sleep310779-21diskmemload11:15:273
17945991110,0cyclictest10779-21diskmemload11:43:063
1793399119,1cyclictest28-21ksoftirqd/208:50:002
1792099112,8cyclictest10779-21diskmemload11:03:400
1792099111,0cyclictest10779-21diskmemload09:55:470
1792099110,2cyclictest0-21swapper/008:40:210
1792099110,1cyclictest31954-21ntpq07:35:170
1792099110,1cyclictest243152chrt08:29:580
1792099110,1cyclictest10779-21diskmemload09:36:310
1792099110,1cyclictest10779-21diskmemload09:12:130
1792099110,1cyclictest0-21swapper/010:30:170
1792099110,1cyclictest0-21swapper/010:19:260
1792099110,1cyclictest0-21swapper/008:00:180
1792099110,0cyclictest10779-21diskmemload11:12:540
1792099110,0cyclictest10779-21diskmemload10:43:110
1792099110,0cyclictest0-21swapper/011:42:030
1794599109,1cyclictest35-21ksoftirqd/312:10:013
1794599109,1cyclictest35-21ksoftirqd/308:15:003
1794599108,1cyclictest35-21ksoftirqd/312:35:003
1794599108,1cyclictest35-21ksoftirqd/309:15:013
1794599108,1cyclictest35-21ksoftirqd/309:00:003
1794599100,5cyclictest0-21swapper/310:15:123
1793399109,1cyclictest28-21ksoftirqd/210:55:012
1793399109,1cyclictest28-21ksoftirqd/210:09:592
1793399108,1cyclictest28-21ksoftirqd/207:15:012
1792099103,6cyclictest27702-21grep08:35:150
1792099100,9cyclictest0-21swapper/010:12:090
1792099100,9cyclictest0-21swapper/008:30:110
1792099100,1cyclictest0-21swapper/008:50:180
1792099100,0cyclictest10779-21diskmemload12:30:550
1792099100,0cyclictest0-21swapper/010:05:210
9074290,0sleep30-21swapper/309:50:083
179459999,0cyclictest35-21ksoftirqd/309:20:013
179459998,1cyclictest35-21ksoftirqd/312:29:593
179459997,1cyclictest35-21ksoftirqd/309:59:593
179459990,7cyclictest0-21swapper/311:10:123
179339998,1cyclictest28-21ksoftirqd/207:25:002
179339997,1cyclictest28-21ksoftirqd/207:40:002
179339990,1cyclictest254-21systemd-journal12:25:042
179209993,5cyclictest232572sleep007:17:010
179209992,6cyclictest15656-21grep08:10:150
179209990,1cyclictest0-21swapper/008:55:170
179209990,1cyclictest0-21swapper/008:15:140
179209990,1cyclictest0-21swapper/007:40:160
179209990,1cyclictest0-21swapper/007:24:460
16174290,0sleep20-21swapper/212:13:342
7399280,2sleep30-21swapper/307:52:423
24580280,0sleep20-21swapper/210:10:142
179459987,1cyclictest35-21ksoftirqd/310:40:273
179459987,1cyclictest35-21ksoftirqd/310:40:003
179459986,1cyclictest35-21ksoftirqd/310:25:003
179459986,1cyclictest35-21ksoftirqd/310:05:463
179459983,4cyclictest13512-21kworker/u8:112:11:033
179459982,4cyclictest5463-21apt-get09:45:093
179459981,6cyclictest26412-1kworker/u9:211:49:523
179459981,4cyclictest819-21lldpd08:00:113
179459981,3cyclictest0-21swapper/310:52:513
179459980,5cyclictest254-21systemd-journal12:39:193
179459980,5cyclictest0-21swapper/309:20:293
179459980,4cyclictest0-21swapper/312:03:483
179459980,3cyclictest32545-21/usr/sbin/munin07:35:213
179459980,3cyclictest0-21swapper/312:23:073
179459980,2cyclictest0-21swapper/311:50:133
179339986,1cyclictest60950irq/123-eno112:40:002
179339986,1cyclictest60950irq/123-eno112:30:182
179339986,1cyclictest60950irq/123-eno111:30:152
179339986,1cyclictest60950irq/123-eno111:20:162
179339986,1cyclictest60950irq/123-eno110:16:132
179339986,1cyclictest60950irq/123-eno109:55:222
179339986,1cyclictest28-21ksoftirqd/212:04:592
179339982,5cyclictest20484-21munin-node11:57:102
179339981,5cyclictest27726-21sh09:30:212
179249981,2cyclictest0-21swapper/109:48:591
179249980,4cyclictest0-21swapper/111:10:111
179249980,1cyclictest0-21swapper/112:06:311
179209980,2cyclictest27345-21head07:25:220
179209980,1cyclictest254-21systemd-journal08:20:440
179209980,1cyclictest254-21systemd-journal07:58:440
179209980,1cyclictest254-21systemd-journal07:10:430
179459976,1cyclictest35-21ksoftirqd/310:05:003
179459976,1cyclictest35-21ksoftirqd/309:40:163
179459975,1cyclictest3708-21perf08:55:003
179459975,1cyclictest16392-21ssh11:29:113
179459973,0cyclictest10779-21diskmemload09:36:373
179459972,3cyclictest25693-21sh10:10:273
179459972,0cyclictest10779-21diskmemload10:33:463
179459971,1cyclictest9019-21/usr/sbin/munin07:55:223
179459970,6cyclictest20484-21munin-node11:20:263
179459970,3cyclictest10779-21diskmemload12:00:003
179459970,3cyclictest0-21swapper/311:07:233
179459970,1cyclictest0-21swapper/310:46:503
179339976,1cyclictest60950irq/123-eno112:08:192
179339976,1cyclictest60950irq/123-eno111:49:282
179339976,1cyclictest60950irq/123-eno111:35:202
179339976,1cyclictest60950irq/123-eno111:25:392
179339976,1cyclictest60950irq/123-eno110:25:182
179339976,1cyclictest60950irq/123-eno110:23:292
179339976,1cyclictest60950irq/123-eno109:19:452
179339976,1cyclictest60950irq/123-eno108:40:212
179339975,1cyclictest6607-21ntpq07:50:182
179339975,1cyclictest60950irq/123-eno109:50:402
179339975,1cyclictest60950irq/123-eno108:25:162
179339975,1cyclictest60950irq/123-eno107:55:182
179339975,1cyclictest28-21ksoftirqd/208:15:012
179339975,1cyclictest12151-21ssh10:37:562
179339973,2cyclictest254-21systemd-journal12:17:042
179339973,1cyclictest0-21swapper/211:40:052
179339972,4cyclictest742-21runrttasks09:13:322
179339971,5cyclictest3933-21apt-get08:55:122
179339970,1cyclictest10779-21diskmemload09:25:132
179249971,2cyclictest0-21swapper/110:50:121
179249970,6cyclictest0-21swapper/111:50:221
179249970,6cyclictest0-21swapper/109:20:541
179249970,4cyclictest0-21swapper/111:17:271
179249970,3cyclictest0-21swapper/112:04:071
179209970,1cyclictest5477-21apt-get07:50:120
179209970,1cyclictest29179-21grep07:30:120
179459965,1cyclictest28882-21ssh09:31:483
179459964,1cyclictest20738-21cat08:20:163
179459964,1cyclictest18334-21sendmail_mailst11:30:193
179459964,0cyclictest10779-21diskmemload11:00:503
179459962,2cyclictest254-21systemd-journal07:34:433
179459960,5cyclictest0-21swapper/308:15:123
179459960,2cyclictest254-21systemd-journal08:45:293
179459960,2cyclictest10779-21diskmemload12:15:123
179459960,2cyclictest0-21swapper/309:05:133
179459960,2cyclictest0-21swapper/309:05:123
179459960,1cyclictest0-21swapper/308:05:163
179339966,0cyclictest60950irq/123-eno110:55:222
179339966,0cyclictest60950irq/123-eno110:45:152
179339966,0cyclictest60950irq/123-eno110:42:442
179339966,0cyclictest60950irq/123-eno109:20:092
179339966,0cyclictest60950irq/123-eno108:32:012
179339966,0cyclictest60950irq/123-eno108:08:482
179339966,0cyclictest60950irq/123-eno107:45:172
179339966,0cyclictest60950irq/123-eno107:33:362
179339966,0cyclictest60950irq/123-eno107:25:352
179339966,0cyclictest60950irq/123-eno107:16:542
179339965,1cyclictest60950irq/123-eno109:37:072
179339965,1cyclictest60950irq/123-eno108:00:182
179339965,1cyclictest28078-21kworker/2:208:50:132
179339964,1cyclictest60950irq/123-eno112:20:242
179339964,1cyclictest60950irq/123-eno111:00:142
179339962,1cyclictest0-21swapper/208:35:122
179339961,5cyclictest10779-21diskmemload09:45:092
179339960,3cyclictest0-21swapper/208:15:122
179339960,1cyclictest0-21swapper/208:20:132
179249966,0cyclictest0-21swapper/110:04:481
179249963,2cyclictest0-21swapper/111:57:241
179249963,1cyclictest0-21swapper/109:27:471
179249961,1cyclictest0-21swapper/109:57:351
179249960,5cyclictest0-21swapper/107:55:221
179249960,3cyclictest0-21swapper/112:15:141
179249960,3cyclictest0-21swapper/111:07:141
179249960,3cyclictest0-21swapper/109:15:021
179249960,2cyclictest0-21swapper/111:03:281
179249960,2cyclictest0-21swapper/110:22:021
179249960,2cyclictest0-21swapper/109:50:111
179249960,2cyclictest0-21swapper/109:10:111
179249960,0cyclictest0-21swapper/112:37:311
179249960,0cyclictest0-21swapper/110:49:541
179459954,1cyclictest35-21ksoftirqd/308:30:133
179459953,1cyclictest23758-21apt-get07:20:113
179459952,1cyclictest3121-21/usr/sbin/munin07:45:113
179459952,1cyclictest27907-21runrttasks07:26:023
179459951,1cyclictest6810-21diskstats09:00:123
179459951,1cyclictest27652-21gltestperf08:35:153
179459951,0cyclictest10779-21diskmemload11:35:113
179459950,3cyclictest18900-21fschecks_count07:10:143
179459950,1cyclictest0-21swapper/308:29:153
179339955,0cyclictest60950irq/123-eno109:00:092
179339954,1cyclictest60950irq/123-eno109:05:092
179339954,1cyclictest60950irq/123-eno109:05:082
179339954,1cyclictest60950irq/123-eno107:40:152
179249955,0cyclictest0-21swapper/109:07:281
179249955,0cyclictest0-21swapper/109:07:281
179249955,0cyclictest0-21swapper/108:20:251
179249952,1cyclictest0-21swapper/110:55:241
179249951,1cyclictest0-21swapper/111:35:241
179249951,1cyclictest0-21swapper/107:50:121
179249951,1cyclictest0-21swapper/107:14:541
179249950,5cyclictest0-21swapper/112:10:271
179249950,5cyclictest0-21swapper/111:25:201
179249950,5cyclictest0-21swapper/108:08:031
179249950,5cyclictest0-21swapper/107:23:501
179249950,4cyclictest0-21swapper/110:37:161
179249950,3cyclictest0-21swapper/111:21:471
179249950,3cyclictest0-21swapper/109:30:021
179249950,2cyclictest0-21swapper/112:30:511
179249950,2cyclictest0-21swapper/111:45:131
179249950,2cyclictest0-21swapper/111:40:211
179249950,2cyclictest0-21swapper/111:32:471
179249950,2cyclictest0-21swapper/110:25:551
179249950,2cyclictest0-21swapper/110:17:581
179249950,2cyclictest0-21swapper/110:06:101
179249950,2cyclictest0-21swapper/109:44:421
179249950,2cyclictest0-21swapper/108:25:291
179249950,1cyclictest0-21swapper/112:25:131
179249950,1cyclictest0-21swapper/112:20:151
179249950,1cyclictest0-21swapper/110:31:261
179249950,1cyclictest0-21swapper/109:35:141
179249950,1cyclictest0-21swapper/108:00:121
179249950,0cyclictest0-21swapper/110:40:221
179249950,0cyclictest0-21swapper/108:41:021
179249950,0cyclictest0-21swapper/108:36:541
179249950,0cyclictest0-21swapper/108:32:481
179459942,1cyclictest29331-21aten_r1power_en08:40:133
179459942,1cyclictest21379-21apt-get07:15:113
179459941,1cyclictest755-21apt-get07:40:103
179249944,0cyclictest0-21swapper/108:16:181
179249944,0cyclictest0-21swapper/108:10:071
179249944,0cyclictest0-21swapper/107:29:231
179249941,1cyclictest0-21swapper/108:45:141
179249940,0cyclictest0-21swapper/108:55:201
179249940,0cyclictest0-21swapper/107:45:161
179249931,1cyclictest0-21swapper/108:50:121
179249931,1cyclictest0-21swapper/107:40:091
179249931,1cyclictest0-21swapper/107:30:081
179249930,2cyclictest0-21swapper/107:15:161
179249930,1cyclictest0-21swapper/109:00:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional