You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-10 - 03:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Mon Aug 10, 2026 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32658072720,1sleep50-21swapper/523:54:215
262023725822,31sleep70-21swapper/719:05:197
262035825141,7sleep40-21swapper/419:07:014
2620741994944,4cyclictest3219544-21latency_hist23:38:147
262027624737,7sleep60-21swapper/619:05:516
2620735994341,2cyclictest3173074-21kworker/u16:0+events_unbound23:33:425
262040424131,7sleep50-21swapper/519:07:425
2620735993836,2cyclictest2892272-21kworker/u16:3+events_unbound21:58:435
2620735993835,2cyclictest1834744-21kworker/u16:5+events_unbound19:53:175
2620735993735,2cyclictest3231744-21kworker/u16:4+events_unbound00:29:125
2620735993735,2cyclictest3217933-21kworker/u16:3+flush-8:000:03:145
2620735993735,2cyclictest3147587-21kworker/u16:1+events_unbound23:27:135
2620741993633,2cyclictest2857640-21diskmemload00:08:297
2620739993634,2cyclictest3217933-21kworker/u16:3+events_unbound00:35:216
2620735993634,2cyclictest2644220-21kworker/u16:2+events_unbound21:11:025
2620739993533,2cyclictest2926892-21kworker/u16:4+events_unbound22:55:216
2620739993533,2cyclictest2926892-21kworker/u16:4+events_unbound22:22:376
2620739993533,2cyclictest2892272-21kworker/u16:3+events_unbound21:58:476
2620735993533,2cyclictest3111074-21kworker/u16:3+events_unbound22:57:425
2620735993533,2cyclictest3035537-21kworker/u16:0+events_unbound22:19:185
2620726993533,2cyclictest2610852-21kworker/u16:3+flush-8:019:38:434
262074199340,32cyclictest2881761-21latency_hist21:18:157
2620739993432,2cyclictest3173074-21kworker/u16:0+flush-8:023:32:366
2620739993432,2cyclictest2859399-21kworker/u16:0+events_unbound21:12:536
2620739993432,2cyclictest2789457-21kworker/u16:1+events_unbound21:21:046
2620735993432,2cyclictest3292391-21kworker/u16:2+flush-8:000:16:485
2620735993432,2cyclictest3159607-21kworker/u16:5+events_unbound23:16:065
2620735993432,2cyclictest3147587-21kworker/u16:1+events_unbound23:42:375
2620735993432,2cyclictest3147587-21kworker/u16:1+events_unbound23:42:375
2620735993432,2cyclictest2926892-21kworker/u16:4+events_unbound22:32:575
2620735993432,2cyclictest2918001-21kworker/u16:2+events_unbound21:36:055
2620735993432,2cyclictest2892272-21kworker/u16:3+events_unbound21:22:065
2620741993327,5cyclictest648-21systemd-journal21:13:157
2620739993331,2cyclictest3173074-21kworker/u16:0+events_unbound23:41:176
2620739993331,2cyclictest3173074-21kworker/u16:0+events_unbound23:41:176
2620739993331,2cyclictest2892272-21kworker/u16:3+events_unbound21:33:056
2620735993331,2cyclictest3217933-21kworker/u16:3+events_unbound00:35:135
2620735993331,2cyclictest2951875-21kworker/u16:0+events_unbound21:54:415
2620735993331,2cyclictest2926892-21kworker/u16:4+flush-8:021:50:335
2620735993331,2cyclictest2926892-21kworker/u16:4+events_unbound22:42:495
2620735993331,2cyclictest2926892-21kworker/u16:4+events_unbound22:37:485
2620735993331,2cyclictest2926892-21kworker/u16:4+events_unbound22:12:025
2620735993331,2cyclictest2892272-21kworker/u16:3+events_unbound22:16:575
2620735993331,2cyclictest2859399-21kworker/u16:0+events_unbound21:32:225
2620726993331,2cyclictest3231744-21kworker/u16:4+flush-8:000:28:294
2620741993227,4cyclictest3014491-21latency_hist22:13:157
2620739993230,2cyclictest3231744-21kworker/u16:4+events_unbound00:24:486
2620739993230,2cyclictest3147587-21kworker/u16:1+events_unbound23:27:486
2620739993230,2cyclictest3048750-21kworker/u16:1+flush-8:022:30:096
2620739993230,2cyclictest2926892-21kworker/u16:4+events_unbound23:08:096
2620739993230,2cyclictest2892272-21kworker/u16:3+events_unbound22:04:096
2620735993230,2cyclictest3133110-21kworker/u16:0+flush-8:023:04:175
2620735993230,2cyclictest2926892-21kworker/u16:4+events_unbound22:49:285
2620735993230,2cyclictest2892272-21kworker/u16:3+events_unbound21:46:305
2620735993230,2cyclictest2859399-21kworker/u16:0+events_unbound21:25:535
2620735993230,2cyclictest2789457-21kworker/u16:1+events_unbound21:14:455
262074199310,29cyclictest3159186-21latency_hist23:13:157
2620739993129,2cyclictest3217933-21kworker/u16:3+events_unbound23:36:206
2620739993129,2cyclictest3036391-21kworker/u16:2+events_unbound22:37:216
2620739993129,2cyclictest2926892-21kworker/u16:4+events_unbound21:37:296
2620739993128,2cyclictest2644220-21kworker/u16:2+events_unbound19:43:176
2620735993129,2cyclictest3217933-21kworker/u16:3+flush-8:023:49:205
2620735993129,2cyclictest3217933-21kworker/u16:3+events_unbound23:47:365
2620735993129,2cyclictest3048750-21kworker/u16:1+events_unbound22:43:575
2620735993129,2cyclictest2926892-21kworker/u16:4+events_unbound23:00:135
2620735993129,2cyclictest2926892-21kworker/u16:4+events_unbound23:00:135
2620735993129,2cyclictest2892272-21kworker/u16:3+events_unbound22:04:375
2620735993128,2cyclictest3231744-21kworker/u16:4+events_unbound00:18:175
2620726993129,2cyclictest3231744-21kworker/u16:4+events_unbound00:16:044
2620739993028,2cyclictest3325320-21kworker/u16:0+events_unbound00:22:416
2620739993028,2cyclictest3217933-21kworker/u16:3+events_unbound23:47:096
2620739993028,2cyclictest3217933-21kworker/u16:3+events_unbound00:09:456
2620739993028,2cyclictest3147587-21kworker/u16:1+events_unbound23:09:286
2620739993028,2cyclictest3048750-21kworker/u16:1+events_unbound22:41:176
2620739993028,2cyclictest2926892-21kworker/u16:4+events_unbound21:50:386
2620739993028,2cyclictest2892272-21kworker/u16:3+events_unbound21:56:146
2620739993028,2cyclictest2789457-21kworker/u16:1+events_unbound20:55:496
2620735993028,2cyclictest3279064-21kworker/u16:1+events_unbound00:12:585
2620735993028,2cyclictest3231744-21kworker/u16:4+events_unbound00:24:565
2620735993028,2cyclictest3217933-21kworker/u16:3+events_unbound00:05:055
2620735993028,2cyclictest3205580-21kworker/u16:2+events_unbound23:31:175
2620735993028,2cyclictest2892272-21kworker/u16:3+events_unbound21:40:545
2620735993028,2cyclictest2892272-21kworker/u16:3+events_unbound21:40:545
2620726993028,2cyclictest3173074-21kworker/u16:0+events_unbound00:00:014
2620726993027,3cyclictest2926892-21kworker/u16:4+flush-8:023:23:254
2620741992924,4cyclictest2966088-21latency_hist21:53:157
2620739992927,2cyclictest3147587-21kworker/u16:1+events_unbound23:14:486
2620739992927,2cyclictest2926892-21kworker/u16:4+events_unbound22:46:286
2620739992926,2cyclictest2926892-21kworker/u16:4+events_unbound22:58:176
2620739992926,2cyclictest2926892-21kworker/u16:4+events_unbound22:58:176
2620735992927,2cyclictest3147587-21kworker/u16:1+events_unbound23:19:205
2620735992927,2cyclictest3111074-21kworker/u16:3+flush-8:023:12:285
2620735992927,2cyclictest2610852-21kworker/u16:3+events_unbound19:42:265
2620726992927,2cyclictest3011503-21kworker/u16:1+flush-8:022:13:434
2620726992927,2cyclictest2610852-21kworker/u16:3+events_unbound19:08:304
2620741992823,4cyclictest3340239-21latency_hist00:28:147
2620741992822,5cyclictest2711863-21latency_hist19:53:157
2620739992826,2cyclictest3292391-21kworker/u16:2+flush-8:000:15:476
2620739992826,2cyclictest3279064-21kworker/u16:1+events_unbound00:06:006
2620739992826,2cyclictest2892272-21kworker/u16:3+flush-8:021:43:136
2620739992826,2cyclictest2892272-21kworker/u16:3+flush-8:021:43:136
2620739992826,2cyclictest2750339-21kworker/u16:3+events_unbound20:40:506
2620739992826,2cyclictest2720584-21kworker/u16:1+flush-8:019:59:016
2620739992825,2cyclictest2610852-21kworker/u16:3+flush-8:019:18:266
2620739992825,2cyclictest1834744-21kworker/u16:5+events_unbound19:28:166
2620735992826,2cyclictest2591810-21kworker/u16:1+flush-8:019:13:405
2620726992826,2cyclictest2720584-21kworker/u16:1+flush-8:020:00:494
2620726992826,2cyclictest2610852-21kworker/u16:3+events_unbound19:17:454
29887472270,1chrt2988746-21ssh22:00:197
2620739992725,2cyclictest3328254-21kworker/u16:1+events_unbound00:32:176
2620739992725,2cyclictest3231636-21kworker/u16:2+events_unbound00:00:516
2620739992725,2cyclictest2926892-21kworker/u16:4+flush-8:023:20:296
2620739992725,2cyclictest2926892-21kworker/u16:4+events_unbound21:44:176
2620739992725,2cyclictest2720584-21kworker/u16:1+events_unbound20:04:026
2620735992725,2cyclictest3048750-21kworker/u16:1+events_unbound22:24:385
2620735992725,2cyclictest2750339-21kworker/u16:3+flush-8:020:13:175
2620726992725,2cyclictest3173074-21kworker/u16:0+events_unbound23:44:464
2620726992725,2cyclictest2926892-21kworker/u16:4+events_unbound23:09:084
2620726992725,2cyclictest2926892-21kworker/u16:4+events_unbound22:49:434
2620726992725,2cyclictest2720584-21kworker/u16:1+events_unbound20:21:024
2620726992725,2cyclictest2720584-21kworker/u16:1+events_unbound20:21:024
2620739992624,2cyclictest3173074-21kworker/u16:0+events_unbound23:54:096
2620739992624,2cyclictest2859399-21kworker/u16:0+events_unbound21:16:036
2620739992624,2cyclictest2848119-21kworker/u16:4+events_unbound21:04:546
2620739992624,2cyclictest2750339-21kworker/u16:3+events_unbound20:43:176
2620739992624,2cyclictest2610852-21kworker/u16:3+flush-8:019:41:376
2620735992624,2cyclictest2591810-21kworker/u16:1+events_unbound19:12:505
2620735992624,2cyclictest1834744-21kworker/u16:5+events_unbound19:46:255
2620726992624,2cyclictest3159607-21kworker/u16:5+events_unbound23:14:584
2620726992624,2cyclictest2926892-21kworker/u16:4+flush-8:022:20:464
2620726992624,2cyclictest2926892-21kworker/u16:4+events_unbound22:00:404
2620726992624,2cyclictest2918001-21kworker/u16:2+events_unbound21:44:034
2620726992624,2cyclictest2918001-21kworker/u16:2+events_unbound21:42:324
2620726992624,2cyclictest2918001-21kworker/u16:2+events_unbound21:42:324
2620726992624,2cyclictest2859399-21kworker/u16:0+events_unbound21:19:464
2620726992624,2cyclictest2750339-21kworker/u16:3+events_unbound20:35:224
2620726992624,2cyclictest2692854-21kworker/u16:0+events_unbound20:10:294
2620726992623,2cyclictest2789457-21kworker/u16:1+flush-8:020:43:204
2620739992523,2cyclictest3217933-21kworker/u16:3+flush-8:023:49:086
2620739992523,2cyclictest2926892-21kworker/u16:4+flush-8:022:49:466
2620739992523,2cyclictest2720584-21kworker/u16:1+flush-8:019:54:026
2620739992523,2cyclictest1834744-21kworker/u16:5+events_unbound19:35:106
2620739992523,2cyclictest1834744-21kworker/u16:5+events_unbound19:35:106
2620735992522,2cyclictest2644220-21kworker/u16:2+events_unbound20:58:025
2620726992523,2cyclictest3036391-21kworker/u16:2+events_unbound22:38:194
2620726992523,2cyclictest2926892-21kworker/u16:4+events_unbound22:47:304
2620726992523,2cyclictest2926892-21kworker/u16:4+events_unbound22:26:264
2620726992523,2cyclictest2926892-21kworker/u16:4+events_unbound21:57:314
2620726992523,2cyclictest2892272-21kworker/u16:3+events_unbound22:09:264
2620726992523,2cyclictest2892272-21kworker/u16:3+events_unbound21:34:274
2620726992523,2cyclictest2750339-21kworker/u16:3+events_unbound20:53:304
2620726992523,2cyclictest2692854-21kworker/u16:0+events_unbound19:46:544
2620739992422,2cyclictest2892272-21kworker/u16:3+events_unbound22:11:076
2620739992422,2cyclictest2610852-21kworker/u16:3+flush-8:019:28:136
2620739992422,2cyclictest2610852-21kworker/u16:3+events_unbound19:15:426
2620726992422,2cyclictest3231744-21kworker/u16:4+flush-8:000:24:194
2620726992422,2cyclictest2926892-21kworker/u16:4+events_unbound23:07:524
2620726992422,2cyclictest2750339-21kworker/u16:3+events_unbound21:08:274
2620726992422,2cyclictest2644220-21kworker/u16:2+events_unbound20:05:144
2620726992422,2cyclictest1834744-21kworker/u16:5+flush-8:019:35:134
2620726992422,2cyclictest1834744-21kworker/u16:5+flush-8:019:35:134
262074199230,21cyclictest3328219-21latency_hist00:23:147
2620739992321,2cyclictest2789457-21kworker/u16:1+events_unbound20:59:166
2620739992321,2cyclictest2779535-21kworker/u16:0+events_unbound20:28:226
2620739992321,2cyclictest2644220-21kworker/u16:2+events_unbound19:49:466
2620726992321,2cyclictest3217933-21kworker/u16:3+events_unbound23:49:394
2620726992321,2cyclictest3147587-21kworker/u16:1+events_unbound23:30:094
2620726992321,2cyclictest2859399-21kworker/u16:0+events_unbound21:32:554
2620726992321,2cyclictest2859399-21kworker/u16:0+events_unbound21:24:354
2620726992321,2cyclictest2779535-21kworker/u16:0+events_unbound20:25:574
2620726992321,2cyclictest2644220-21kworker/u16:2+flush-8:019:49:334
2620741992220,1cyclictest2731298-21awk20:03:157
2620739992220,2cyclictest3035537-21kworker/u16:0+events_unbound22:24:356
2620739992220,2cyclictest2692854-21kworker/u16:0+events_unbound20:10:256
2620735992220,2cyclictest2789457-21kworker/u16:1+events_unbound20:52:265
2620735992220,2cyclictest2720584-21kworker/u16:1+events_unbound20:23:175
2620726992220,2cyclictest3231744-21kworker/u16:4+flush-8:000:33:544
2620726992220,2cyclictest3217933-21kworker/u16:3+events_unbound00:04:034
2620726992220,2cyclictest3205580-21kworker/u16:2+events_unbound23:33:304
2620726992220,2cyclictest2750339-21kworker/u16:3+events_unbound21:06:344
2620726992220,2cyclictest2750339-21kworker/u16:3+events_unbound20:42:064
2620741992120,0cyclictest0-21swapper/720:42:207
2620741992116,4cyclictest3123061-21latency_hist22:58:147
2620739992119,2cyclictest2926892-21kworker/u16:4+events_unbound22:13:526
2620739992119,2cyclictest2859399-21kworker/u16:0+events_unbound21:23:506
2620739992119,2cyclictest2789457-21kworker/u16:1+flush-8:020:48:516
2620735992119,2cyclictest2789457-21kworker/u16:1+events_unbound21:00:255
2620735992119,2cyclictest2779535-21kworker/u16:0+flush-8:020:28:485
2620735992119,2cyclictest2644220-21kworker/u16:2+events_unbound20:33:425
2620726992119,2cyclictest2859399-21kworker/u16:0+events_unbound21:16:204
2620726992119,2cyclictest2789457-21kworker/u16:1+events_unbound20:52:514
2620726992119,2cyclictest2750339-21kworker/u16:3+events_unbound20:30:054
2620726992119,2cyclictest2720584-21kworker/u16:1+flush-8:020:13:494
2620726992119,2cyclictest2644220-21kworker/u16:2+events_unbound21:01:374
2620726992119,2cyclictest1834744-21kworker/u16:5+events_unbound19:23:014
2620735992018,2cyclictest1834744-21kworker/u16:5+events_unbound19:34:105
2620735992018,2cyclictest1834744-21kworker/u16:5+events_unbound19:34:105
2620726992018,2cyclictest3279064-21kworker/u16:1+flush-8:000:08:514
2620726992018,2cyclictest3173074-21kworker/u16:0+flush-8:023:53:304
2620726992018,2cyclictest2610852-21kworker/u16:3+events_unbound19:24:574
2620741991915,3cyclictest1302-21snmpd20:35:287
2620741991915,3cyclictest1302-21snmpd20:25:497
2620741991912,5cyclictest648-21systemd-journal19:38:157
2620741991912,5cyclictest648-21systemd-journal19:38:157
2620735991917,2cyclictest2720584-21kworker/u16:1+flush-8:020:18:535
2620735991917,2cyclictest2720584-21kworker/u16:1+flush-8:020:18:535
2620735991917,2cyclictest2692854-21kworker/u16:0+flush-8:020:09:175
2620726991917,2cyclictest3147587-21kworker/u16:1+events_unbound23:40:204
2620726991917,2cyclictest3147587-21kworker/u16:1+events_unbound23:40:204
2620726991916,2cyclictest3231744-21kworker/u16:4+events_unbound00:18:214
2620739991815,2cyclictest2720584-21kworker/u16:1+events_unbound20:18:226
2620739991815,2cyclictest2720584-21kworker/u16:1+events_unbound20:18:226
2620735991816,2cyclictest2644220-21kworker/u16:2+flush-8:019:49:015
2620735991816,2cyclictest1834744-21kworker/u16:5+events_unbound19:18:325
2620735991815,2cyclictest2644220-21kworker/u16:2+events_unbound21:03:155
2620726991816,2cyclictest3111074-21kworker/u16:3+flush-8:022:58:214
2620726991816,2cyclictest3111074-21kworker/u16:3+flush-8:022:58:214
2620726991816,2cyclictest3036391-21kworker/u16:2+events_unbound22:28:534
2620726991816,2cyclictest2926892-21kworker/u16:4+events_unbound22:54:544
2620726991816,2cyclictest2892272-21kworker/u16:3+events_unbound22:03:384
262074199170,16cyclictest0-21swapper/721:18:397
2620739991715,2cyclictest2750339-21kworker/u16:3+events_unbound20:26:136
2620735991715,2cyclictest2750339-21kworker/u16:3+flush-8:020:45:525
2620726991715,2cyclictest1834744-21kworker/u16:5+events_unbound19:31:454
2620726991714,2cyclictest3048750-21kworker/u16:1+flush-8:022:33:404
2620741991615,0cyclictest0-21swapper/723:23:307
2620741991611,4cyclictest648-21systemd-journal20:28:157
262074199160,14cyclictest2857640-21diskmemload23:18:397
262074199160,14cyclictest2857640-21diskmemload22:48:397
2620739991614,2cyclictest2644220-21kworker/u16:2+events_unbound20:16:306
2620735991614,2cyclictest1834744-21kworker/u16:5+flush-8:019:32:505
2620726991614,2cyclictest2926892-21kworker/u16:4+flush-8:023:18:474
2620726991614,2cyclictest2644220-21kworker/u16:2+flush-8:019:53:214
262074199157,7cyclictest5965-21gmain00:03:327
262074199150,14cyclictest0-21swapper/719:23:397
2620739991513,2cyclictest2789457-21kworker/u16:1+events_unbound20:35:066
2620735991513,2cyclictest2720584-21kworker/u16:1+events_unbound20:00:115
2620735991513,2cyclictest2610852-21kworker/u16:3+flush-8:019:23:215
2620726991513,2cyclictest2892272-21kworker/u16:3+events_unbound21:48:514
262074199140,1cyclictest0-21swapper/720:53:437
262074199140,1cyclictest0-21swapper/719:18:397
2620739991412,2cyclictest2591810-21kworker/u16:1+flush-8:019:11:306
2620735991412,2cyclictest2750339-21kworker/u16:3+events_unbound20:42:125
2620735991412,2cyclictest2720584-21kworker/u16:1+events_unbound20:06:215
262074199139,3cyclictest1302-21snmpd23:43:427
262074199139,3cyclictest1302-21snmpd23:02:297
262074199139,3cyclictest1302-21snmpd23:02:297
262074199139,3cyclictest1302-21snmpd22:23:197
262074199139,3cyclictest1302-21snmpd20:07:197
262074199138,4cyclictest2942005-21latency_hist21:43:157
262074199138,4cyclictest2942005-21latency_hist21:43:157
262074199137,5cyclictest5965-21gmain19:08:177
262074199137,5cyclictest2918000-21cat21:33:157
262074199130,2cyclictest2691552-21ntpq19:38:427
262074199130,11cyclictest648-21systemd-journal23:58:157
262074199130,11cyclictest1302-21snmpd19:15:537
262074199129,2cyclictest1302-21snmpd21:56:307
262074199128,3cyclictest1302-21snmpd22:34:317
262074199128,3cyclictest1302-21snmpd21:03:147
262074199128,3cyclictest1302-21snmpd20:45:017
262074199128,3cyclictest1302-21snmpd20:14:527
262074199128,3cyclictest1302-21snmpd19:44:157
262074199128,3cyclictest1302-21snmpd19:31:427
262074199122,9cyclictest3341239-21ssh00:28:287
262074199120,11cyclictest3147166-21latency_hist23:08:157
262074199120,11cyclictest2750653-21latency_hist20:13:157
262074199120,11cyclictest1302-21snmpd21:34:027
262074199120,10cyclictest2720578-21ntpq19:53:417
262074199119,1cyclictest3257047-21ssh23:53:307
262074199119,1cyclictest3207497-21basename23:33:157
262074199118,2cyclictest1302-21snmpd23:42:427
262074199118,2cyclictest1302-21snmpd23:42:427
262074199117,3cyclictest1302-21snmpd22:19:007
262074199117,3cyclictest1302-21snmpd22:13:217
262074199117,3cyclictest1302-21snmpd20:49:167
262074199117,3cyclictest1302-21snmpd20:22:377
262074199117,3cyclictest1302-21snmpd20:22:377
262074199116,4cyclictest934-21dbus-daemon21:05:497
262074199115,5cyclictest2951079-21ssh21:43:417
2620741991111,0cyclictest0-21swapper/722:45:527
262074199110,1cyclictest3315665-21ssh00:17:197
262074199110,1cyclictest3001804-21ssh22:07:127
262074199110,10cyclictest1302-21snmpd00:35:527
262074199100,9cyclictest2857640-21diskmemload22:38:497
262074199100,1cyclictest3169383-21ssh23:14:277
262074199100,1cyclictest2905291-21ssh21:27:107
262074199100,1cyclictest2857640-21diskmemload22:28:307
26207419994,4cyclictest3244062-21rm23:48:157
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional