You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-03 - 08:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Fri Jul 03, 2026 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26255521260,111pltrace0-21swapper/319:09:553
26255521220,110pltrace0-21swapper/519:10:015
26255521120,104pltrace0-21swapper/619:09:516
23469521050,56pltrace0-21swapper/719:05:177
700152980,1pltrace38-21ksoftirqd/220:26:392
66232960,0sleep60-21swapper/621:55:126
1076952940,0pltrace0-21swapper/023:41:400
1076952940,0pltrace0-21swapper/023:41:400
2625552900,86pltrace0-21swapper/219:09:532
2625552850,81pltrace0-21swapper/119:09:331
25812840,0sleep670-21ksoftirqd/622:25:176
191802780,0sleep10-21swapper/122:09:171
2632527342,10sleep40-21swapper/419:07:334
2629227143,10sleep00-21swapper/019:07:050
995452560,13pltrace78-21ksoftirqd/700:17:567
2763452500,1pltrace78-21ksoftirqd/723:31:167
482252470,5pltrace78-21ksoftirqd/723:03:457
2902552460,7pltrace78-21ksoftirqd/700:39:207
2763452460,1pltrace0-21swapper/723:28:347
543652440,5pltrace78-21ksoftirqd/700:13:487
1392052440,2pltrace0-21swapper/723:16:207
1388752420,5pltrace78-21ksoftirqd/722:39:527
3268252410,7pltrace78-21ksoftirqd/721:12:507
2811152400,7pltrace78-21ksoftirqd/722:54:057
1388752390,10pltrace78-21ksoftirqd/722:41:067
1886552380,0pltrace0-21swapper/700:29:277
1392052370,6pltrace78-21ksoftirqd/723:14:097
890352350,7pltrace78-21ksoftirqd/721:59:187
2664499340,23cyclictest0-21swapper/021:59:410
1388552340,1pltrace0-21swapper/521:26:395
3268252330,4pltrace0-21swapper/721:16:257
482252310,3pltrace78-21ksoftirqd/723:05:017
2293852300,0pltrace0-21swapper/721:38:227
890352290,2pltrace12444-21ssh22:00:217
2666199290,28cyclictest0-21swapper/400:14:484
26674992826,1cyclictest0-21swapper/722:05:017
2716752260,4pltrace0-21swapper/722:16:587
194512250,0sleep40-21swapper/422:42:454
2811152230,3pltrace31896-21timerwakeupswit22:55:217
543652220,1pltrace5440-21pltrace-run00:11:403
2664499221,20cyclictest0-21swapper/022:04:410
1978852220,2pltrace0-21swapper/723:56:117
2376552210,5pltrace0-21swapper/700:31:427
863252200,1pltrace8634-21tee22:31:412
2665299201,12cyclictest0-21swapper/219:25:182
432952190,4pltrace0-21swapper/721:54:297
2544852190,6pltrace0-21swapper/720:01:587
2666199180,4cyclictest1543-21cstates22:25:114
2664499180,17cyclictest0-21swapper/022:53:450
2664499180,13cyclictest0-21swapper/023:55:460
1076952180,5pltrace0-21swapper/723:42:117
1076952180,5pltrace0-21swapper/723:42:117
1076952180,13pltrace14825-21ssh23:45:385
386952170,13pltrace0-21swapper/022:27:120
26669991711,5cyclictest0-21swapper/620:23:126
2666999170,16cyclictest0-21swapper/600:05:226
26666991712,3cyclictest0-21swapper/519:38:125
2664899171,9cyclictest0-21swapper/122:34:511
26644991711,5cyclictest0-21swapper/021:54:440
2664499170,16cyclictest0-21swapper/023:21:470
2664499170,13cyclictest0-21swapper/021:13:520
2664499170,1cyclictest0-21swapper/023:38:080
2664499170,1cyclictest0-21swapper/023:38:070
1886552170,8pltrace54-21ksoftirqd/400:28:494
1149552170,12pltrace12408-21expr19:40:117
108882170,0sleep20-21swapper/219:35:192
39552160,11pltrace0-21swapper/623:33:326
26674991611,3cyclictest0-21swapper/720:43:417
26674991611,3cyclictest0-21swapper/720:43:417
26669991613,2cyclictest0-21swapper/619:31:116
26669991612,2cyclictest0-21swapper/600:27:386
26669991610,5cyclictest0-21swapper/621:10:216
2666999161,14cyclictest0-21swapper/619:20:166
2666999160,16cyclictest0-21swapper/623:40:206
2666999160,16cyclictest0-21swapper/623:40:206
26666991610,5cyclictest0-21swapper/520:31:005
2666699161,8cyclictest0-21swapper/523:05:555
2666699160,4cyclictest0-21swapper/520:52:115
2666699160,15cyclictest0-21swapper/521:58:435
2666699160,15cyclictest0-21swapper/521:20:495
2666199161,3cyclictest0-21swapper/422:51:214
26657991611,3cyclictest0-21swapper/320:36:113
2665799161,14cyclictest0-21swapper/321:28:353
2665799160,15cyclictest0-21swapper/323:09:483
2665799160,15cyclictest0-21swapper/319:27:453
26652991611,4cyclictest0-21swapper/222:16:452
26652991611,3cyclictest0-21swapper/221:43:162
26652991610,5cyclictest0-21swapper/221:02:032
2665299161,14cyclictest0-21swapper/223:41:082
2665299161,14cyclictest0-21swapper/223:41:082
2665299160,15cyclictest0-21swapper/200:33:202
2664899161,4cyclictest0-21swapper/122:23:471
2664899161,14cyclictest0-21swapper/120:13:461
2664899160,15cyclictest0-21swapper/119:40:121
2664899160,15cyclictest0-21swapper/119:19:301
2664499161,8cyclictest0-21swapper/020:52:570
2664499161,14cyclictest0-21swapper/021:44:370
2664499160,15cyclictest0-21swapper/019:53:310
1842152160,12pltrace0-21swapper/621:32:056
1388552160,11pltrace18361-21ssh21:31:345
936452150,6pltrace0-21swapper/623:08:096
567652150,10pltrace54-21ksoftirqd/423:41:354
567652150,10pltrace54-21ksoftirqd/423:41:354
3103952150,10pltrace54-21ksoftirqd/420:13:244
2667499150,8cyclictest0-21swapper/721:30:137
2667499150,8cyclictest0-21swapper/721:25:377
2667499150,7cyclictest98152sleep720:31:567
2667499150,7cyclictest0-21swapper/722:29:397
2667499150,4cyclictest0-21swapper/723:39:197
2667499150,4cyclictest0-21swapper/723:39:197
2667499150,14cyclictest0-21swapper/722:46:157
2667499150,14cyclictest0-21swapper/721:41:407
2667499150,14cyclictest0-21swapper/721:05:227
2666999150,8cyclictest0-21swapper/620:40:146
2666999150,8cyclictest0-21swapper/620:40:146
2666999150,7cyclictest0-21swapper/623:00:046
2666999150,2cyclictest0-21swapper/623:35:126
2666999150,2cyclictest0-21swapper/623:35:126
2666999150,14cyclictest0-21swapper/622:06:176
2666999150,14cyclictest0-21swapper/621:04:126
2666999150,14cyclictest0-21swapper/600:38:566
2666699159,5cyclictest0-21swapper/522:35:305
2666699150,8cyclictest0-21swapper/520:01:085
2666699150,4cyclictest4764-21ssh22:28:445
2666699150,14cyclictest0-21swapper/522:40:125
2666699150,14cyclictest0-21swapper/521:12:475
2666699150,14cyclictest0-21swapper/500:07:585
2666699150,13cyclictest0-21swapper/521:16:125
2666199150,7cyclictest0-21swapper/420:17:234
2666199150,14cyclictest27359-21ssh22:17:064
2666199150,14cyclictest0-21swapper/422:04:144
2665799159,2cyclictest0-21swapper/323:15:183
26657991512,2cyclictest1064-13audispd00:05:003
26657991511,2cyclictest0-21swapper/319:41:103
26657991510,4cyclictest0-21swapper/319:46:333
2665799150,8cyclictest0-21swapper/323:34:023
2665799150,7cyclictest0-21swapper/319:52:433
2665799150,3cyclictest0-21swapper/323:36:563
2665799150,3cyclictest0-21swapper/323:36:563
2665799150,2cyclictest0-21swapper/323:25:573
2665799150,14cyclictest0-21swapper/323:43:203
2665799150,14cyclictest0-21swapper/323:43:203
2665799150,14cyclictest0-21swapper/321:30:263
2665299151,7cyclictest0-21swapper/221:14:302
2665299151,6cyclictest0-21swapper/219:50:582
2665299150,2cyclictest0-21swapper/223:35:142
2665299150,2cyclictest0-21swapper/223:35:142
2665299150,14cyclictest0-21swapper/223:03:042
2665299150,14cyclictest0-21swapper/220:14:582
2665299150,14cyclictest0-21swapper/200:36:242
2665299150,14cyclictest0-21swapper/200:22:582
26648991510,3cyclictest0-21swapper/123:10:081
26648991510,3cyclictest0-21swapper/123:00:441
2664899151,3cyclictest0-21swapper/120:35:201
2664899150,8cyclictest0-21swapper/121:45:421
2664899150,7cyclictest0-21swapper/121:02:451
2664899150,4cyclictest0-21swapper/122:51:281
2664899150,4cyclictest0-21swapper/122:47:311
2664899150,2cyclictest25404-21sh23:59:141
2664899150,2cyclictest0-21swapper/123:35:121
2664899150,2cyclictest0-21swapper/123:35:121
2664899150,14cyclictest0-21swapper/120:18:231
2664499159,5cyclictest0-21swapper/023:46:530
2664499154,9cyclictest1141-21polkitd23:10:010
2664499153,10cyclictest12936-21switchtime23:10:210
26644991510,4cyclictest0-21swapper/022:47:560
26644991510,4cyclictest0-21swapper/020:59:370
26644991510,4cyclictest0-21swapper/020:48:150
26644991510,4cyclictest0-21swapper/020:48:150
2664499150,7cyclictest0-21swapper/020:34:140
2664499150,4cyclictest0-21swapper/021:47:400
2664499150,14cyclictest0-21swapper/020:10:430
2664499150,14cyclictest0-21swapper/000:10:000
2264352150,10pltrace54-21ksoftirqd/419:58:134
1985752150,4pltrace0-21swapper/319:56:103
1848652150,8pltrace20296-21latency_hist23:20:011
995452140,6pltrace0-21swapper/300:18:233
863252140,3pltrace9731-21ssh22:33:356
39552140,10pltrace54-21ksoftirqd/423:33:404
3212952140,3pltrace4039-21chrt21:51:036
2667499140,3cyclictest0-21swapper/700:01:067
2667499140,13cyclictest0-21swapper/700:06:227
2667499140,1cyclictest0-21swapper/721:20:257
26669991413,1cyclictest0-21swapper/600:11:376
26669991412,1cyclictest0-21swapper/622:57:276
2666999140,7cyclictest0-21swapper/621:44:226
2666999140,3cyclictest0-21swapper/620:14:116
2666999140,14cyclictest0-21swapper/623:46:216
2666999140,14cyclictest0-21swapper/621:46:516
2666999140,14cyclictest0-21swapper/600:02:046
2666999140,13cyclictest0-21swapper/621:29:406
2666999140,13cyclictest0-21swapper/621:22:246
2666999140,13cyclictest0-21swapper/619:20:006
2666999140,1cyclictest0-21swapper/622:12:076
26666991413,1cyclictest0-21swapper/500:13:495
2666699140,12cyclictest0-21swapper/520:35:395
2666699140,1cyclictest0-21swapper/523:35:215
2666699140,1cyclictest0-21swapper/523:35:215
2666699140,1cyclictest0-21swapper/500:35:295
2666699140,1cyclictest0-21swapper/500:23:405
26661991411,2cyclictest1146-21snmpd21:57:144
2666199141,12cyclictest0-21swapper/421:00:224
2666199140,6cyclictest0-21swapper/421:12:494
2665799149,2cyclictest0-21swapper/300:24:123
26657991413,1cyclictest0-21swapper/300:07:433
2665799140,7cyclictest0-21swapper/322:39:463
2665799140,3cyclictest0-21swapper/323:22:403
2665799140,13cyclictest0-21swapper/321:47:323
2665799140,13cyclictest0-21swapper/321:16:263
2665299148,5cyclictest0-21swapper/220:58:392
26652991413,1cyclictest0-21swapper/222:59:252
26652991413,1cyclictest0-21swapper/221:31:592
26652991412,1cyclictest0-21swapper/223:28:432
2665299140,7cyclictest0-21swapper/223:21:552
2665299140,7cyclictest0-21swapper/220:00:282
2665299140,14cyclictest0-21swapper/222:52:472
2665299140,14cyclictest0-21swapper/222:06:292
2665299140,14cyclictest0-21swapper/221:53:512
2665299140,14cyclictest0-21swapper/200:07:152
2665299140,1cyclictest0-21swapper/223:45:432
2665299140,1cyclictest0-21swapper/223:06:032
2665299140,1cyclictest0-21swapper/222:12:192
2664899149,3cyclictest0-21swapper/100:05:061
2664899148,5cyclictest0-21swapper/120:54:421
26648991413,1cyclictest0-21swapper/100:27:441
2664899140,7cyclictest0-21swapper/121:33:411
2664899140,13cyclictest0-21swapper/123:25:351
2664899140,13cyclictest0-21swapper/121:19:171
2664899140,13cyclictest0-21swapper/120:00:181
2664499148,5cyclictest0-21swapper/021:33:370
2664499143,9cyclictest25808-21missed_timers22:15:170
2664499143,9cyclictest23486-21cpuspeed_turbos20:00:120
2664499143,10cyclictest9651-21cut19:35:110
2664499143,10cyclictest1089-21dbus-daemon23:20:010
2664499142,10cyclictest30274-21cut23:30:120
2664499142,10cyclictest27782-21fschecks_count21:05:140
2664499142,10cyclictest20649-21cut22:10:110
2664499141,12cyclictest0-21swapper/021:30:010
2664499140,6cyclictest0-21swapper/021:15:210
2664499140,6cyclictest0-21swapper/019:42:410
2664499140,3cyclictest0-21swapper/000:18:360
2664499140,13cyclictest0-21swapper/022:40:190
2544852140,10pltrace54-21ksoftirqd/420:06:144
2354252140,6pltrace0-21swapper/322:50:583
1886552140,7pltrace0-21swapper/200:28:562
1706652140,10pltrace54-21ksoftirqd/419:49:284
141752140,1pltrace0-21swapper/720:18:547
1149552140,7pltrace54-21ksoftirqd/419:40:004
3212952130,5pltrace0-21swapper/321:51:103
2716752130,5pltrace0-21swapper/122:19:331
2716752130,1pltrace0-21swapper/522:19:315
2667499137,3cyclictest0-21swapper/723:50:447
26674991312,1cyclictest0-21swapper/721:49:447
2667499130,12cyclictest0-21swapper/723:23:187
2667499130,12cyclictest0-21swapper/719:11:407
2667499130,1cyclictest0-21swapper/723:47:177
2667499130,1cyclictest0-21swapper/719:50:247
26669991312,1cyclictest0-21swapper/622:49:026
2666999130,13cyclictest0-21swapper/622:50:486
2666999130,13cyclictest0-21swapper/600:30:046
2666999130,12cyclictest0-21swapper/620:27:056
2666999130,12cyclictest0-21swapper/619:12:386
2666999130,1cyclictest0-21swapper/623:13:096
26666991312,1cyclictest0-21swapper/523:40:365
26666991312,1cyclictest0-21swapper/523:40:365
26666991312,1cyclictest0-21swapper/523:12:265
26666991312,1cyclictest0-21swapper/522:48:195
26666991312,1cyclictest0-21swapper/500:25:175
26666991312,1cyclictest0-21swapper/500:16:445
26666991311,1cyclictest0-21swapper/520:20:405
2666699130,6cyclictest0-21swapper/523:19:585
2666699130,13cyclictest0-21swapper/522:56:445
2666699130,13cyclictest0-21swapper/521:41:075
26661991312,1cyclictest0-21swapper/423:51:494
26661991312,1cyclictest0-21swapper/423:39:114
26661991312,1cyclictest0-21swapper/423:39:114
26661991311,1cyclictest0-21swapper/423:59:454
26661991311,1cyclictest0-21swapper/400:22:444
2666199130,12cyclictest0-21swapper/421:35:424
2666199130,1cyclictest0-21swapper/423:13:464
2666199130,1cyclictest0-21swapper/422:48:304
2666199130,1cyclictest0-21swapper/421:47:584
2666199130,1cyclictest0-21swapper/421:29:214
2666199130,1cyclictest0-21swapper/400:37:574
2665799137,3cyclictest0-21swapper/322:15:063
26657991312,1cyclictest0-21swapper/321:55:183
2665799130,13cyclictest0-21swapper/322:47:253
2665799130,12cyclictest0-21swapper/323:48:183
2665799130,12cyclictest0-21swapper/322:24:213
2665799130,12cyclictest0-21swapper/320:17:403
2665799130,1cyclictest0-21swapper/323:59:473
2665799130,1cyclictest0-21swapper/321:22:553
2665299139,2cyclictest0-21swapper/221:38:222
2665299133,8cyclictest0-21swapper/222:29:522
26652991312,1cyclictest0-21swapper/223:33:252
26652991310,2cyclictest1-21systemd21:59:592
2665299130,13cyclictest0-21swapper/221:22:362
2665299130,12cyclictest0-21swapper/223:59:182
2665299130,12cyclictest0-21swapper/220:22:412
2665299130,1cyclictest0-21swapper/200:10:102
26648991312,1cyclictest0-21swapper/123:30:171
26648991312,1cyclictest0-21swapper/122:57:541
26648991312,1cyclictest0-21swapper/121:40:491
26648991310,2cyclictest1065-17sedispatch19:36:421
26648991310,2cyclictest0-21swapper/121:20:151
2664899130,13cyclictest0-21swapper/122:02:111
2664899130,13cyclictest0-21swapper/121:53:361
2664899130,1cyclictest0-21swapper/123:06:191
2664499138,4cyclictest0-21swapper/000:28:380
2664499138,2cyclictest0-21swapper/000:33:190
2664499133,9cyclictest27080-21hwlatdetect20:05:140
2664499133,9cyclictest15228-21cut19:45:120
2664499132,9cyclictest10783-21cat20:35:120
2664499130,5cyclictest6888-21sort21:20:130
2664499130,5cyclictest26964-21cut00:35:130
2664499130,5cyclictest26436-21chrt21:00:490
2664499130,5cyclictest2027-21if_err_eth019:20:150
2664499130,5cyclictest11796-21/usr/sbin/munin00:20:170
2664499130,5cyclictest1178-21runrttasks22:31:490
2664499130,4cyclictest6545-21ssh00:14:170
2354252130,5pltrace27803-21ssh22:50:595
1985752130,8pltrace21526-21if_err_eth019:55:147
1978852130,5pltrace0-21swapper/623:55:146
1848652130,5pltrace0-21swapper/523:20:055
1848652130,1pltrace0-21swapper/123:20:011
141752130,5pltrace0-21swapper/320:20:123
1348852130,3pltrace17337-21grep22:05:205
936452120,7pltrace9646-21ssh23:07:174
871052120,4pltrace0-21swapper/719:34:197
592352120,6pltrace0-21swapper/119:30:131
3275152120,5pltrace0-21swapper/119:20:541
2911652120,0pltrace0-21swapper/719:16:337
2716752120,3pltrace29937-21gltestperf22:20:145
2667499127,3cyclictest0-21swapper/722:12:567
2667499124,7cyclictest0-21swapper/700:21:567
26674991211,1cyclictest0-21swapper/722:21:187
2667499120,11cyclictest0-21swapper/720:28:357
2667499120,11cyclictest0-21swapper/720:10:137
2666999126,5cyclictest0-21swapper/622:18:116
26669991211,1cyclictest0-21swapper/621:39:056
2666699128,3cyclictest0-21swapper/519:51:405
2666699126,5cyclictest0-21swapper/519:25:455
2666699126,3cyclictest0-21swapper/520:56:435
26666991211,1cyclictest0-21swapper/523:01:355
26666991211,1cyclictest0-21swapper/522:01:315
26666991211,1cyclictest0-21swapper/521:50:405
26666991211,1cyclictest0-21swapper/521:48:245
26666991210,1cyclictest0-21swapper/521:05:115
26661991211,1cyclictest0-21swapper/421:50:424
26661991211,1cyclictest0-21swapper/421:24:204
2666199120,11cyclictest0-21swapper/420:27:584
2666199120,11cyclictest0-21swapper/420:04:594
2666199120,1cyclictest0-21swapper/423:45:594
2665799126,5cyclictest0-21swapper/323:13:373
2665799126,5cyclictest0-21swapper/300:35:373
26657991211,1cyclictest0-21swapper/322:11:093
26657991210,1cyclictest0-21swapper/300:30:043
2665799120,12cyclictest0-21swapper/321:41:323
2665799120,12cyclictest0-21swapper/319:13:423
2665799120,11cyclictest0-21swapper/320:52:423
2665799120,11cyclictest0-21swapper/319:16:563
2665299126,5cyclictest0-21swapper/222:38:432
2665299126,3cyclictest0-21swapper/223:19:222
26652991211,1cyclictest0-21swapper/219:12:062
26652991211,1cyclictest0-21swapper/200:04:202
2665299120,11cyclictest0-21swapper/200:16:482
2664899129,2cyclictest0-21swapper/100:11:191
2664899126,5cyclictest0-21swapper/120:29:501
2664899120,12cyclictest0-21swapper/120:06:451
2664899120,12cyclictest0-21swapper/100:37:081
2664499122,8cyclictest20668-21expr21:35:130
2664499122,8cyclictest1064-13audispd00:01:500
2664499120,5cyclictest6866-21tr19:30:110
2664499120,5cyclictest5110-21grep20:25:100
2664499120,5cyclictest3815-21cut19:25:100
2664499120,5cyclictest31915-21tr20:15:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional