You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-10 - 09:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Tue Mar 10, 2026 00:44:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12230521110,106pltrace0-21swapper/319:05:113
12230521110,103pltrace0-21swapper/619:06:056
12230521010,97pltrace0-21swapper/119:06:491
12230521010,93pltrace0-21swapper/219:07:112
12230521000,87pltrace0-21swapper/519:07:165
1501552880,56pltrace0-21swapper/719:09:107
1491227443,10sleep40-21swapper/419:07:424
1496426046,10sleep00-21swapper/019:08:270
1355952320,0pltrace0-21swapper/722:00:157
1355952320,0pltrace0-21swapper/722:00:157
3093552260,1pltrace30939-21pltrace-run20:33:545
176852260,0pltrace0-21swapper/723:35:187
1501552260,0pltrace0-21swapper/719:10:177
1501552260,0pltrace0-21swapper/719:10:177
519652250,0pltrace0-21swapper/721:45:237
1530699241,22cyclictest0-21swapper/700:30:247
1528699240,16cyclictest0-21swapper/223:55:262
1530699220,1cyclictest0-21swapper/721:30:197
1527899220,16cyclictest0-21swapper/022:25:490
1530699210,15cyclictest0-21swapper/722:35:007
15295992112,8cyclictest0-21swapper/421:58:204
15286992112,8cyclictest0-21swapper/220:15:242
581652200,14pltrace8509-21chrt19:52:456
2365852200,0pltrace0-21swapper/721:21:037
63552190,6pltrace0-21swapper/722:37:047
2707252190,4pltrace0-21swapper/719:29:557
2473352180,0pltrace0-21swapper/722:20:397
2473352180,0pltrace0-21swapper/722:20:397
15295991813,4cyclictest0-21swapper/400:39:214
15278991815,2cyclictest4015-21taskset20:42:490
15278991815,2cyclictest32362-21taskset00:27:370
15278991815,2cyclictest22568-21perl00:10:130
15278991813,4cyclictest6863-21timerwakeupswit23:40:200
2859652170,2pltrace0-21swapper/723:25:397
285952170,5pltrace0-21swapper/700:35:137
2644852170,2pltrace0-21swapper/721:25:157
1572752170,4pltrace0-21swapper/700:00:167
1530399171,8cyclictest0-21swapper/623:54:506
15299991711,5cyclictest0-21swapper/521:05:455
1529999170,15cyclictest1102-21sed22:35:005
15286991711,5cyclictest0-21swapper/221:37:422
1527899178,4cyclictest15-21ksoftirqd/023:10:160
15278991715,1cyclictest31853-21taskset21:31:460
15278991714,2cyclictest24771-21taskset22:19:220
15278991714,2cyclictest24771-21taskset22:19:220
15278991714,2cyclictest15735-21sed22:00:210
15278991714,2cyclictest15735-21sed22:00:210
15278991711,5cyclictest0-21swapper/022:50:520
15278991710,4cyclictest15-21ksoftirqd/023:24:130
1527899171,8cyclictest0-21swapper/020:36:460
2536152160,0pltrace0-21swapper/720:24:127
1530699161,4cyclictest0-21swapper/719:23:207
15303991611,2cyclictest0-21swapper/623:46:326
1530399161,4cyclictest0-21swapper/620:32:326
1530399160,15cyclictest0-21swapper/622:21:326
1530399160,15cyclictest0-21swapper/622:21:326
1530399160,14cyclictest0-21swapper/619:10:476
1530399160,14cyclictest0-21swapper/619:10:476
1529999160,15cyclictest0-21swapper/522:05:405
1529999160,15cyclictest0-21swapper/522:05:405
1529599161,8cyclictest0-21swapper/419:34:444
15290991611,2cyclictest0-21swapper/323:16:433
15290991610,5cyclictest0-21swapper/300:21:003
1528699160,8cyclictest0-21swapper/222:36:382
1528699160,8cyclictest0-21swapper/220:28:372
1528699160,8cyclictest0-21swapper/200:14:462
1528699160,4cyclictest0-21swapper/223:40:512
15281991611,3cyclictest0-21swapper/122:29:541
1528199161,8cyclictest0-21swapper/122:14:051
1528199161,14cyclictest0-21swapper/123:38:251
1528199161,14cyclictest0-21swapper/122:08:041
1528199161,14cyclictest0-21swapper/122:08:041
1528199160,15cyclictest0-21swapper/119:28:441
1527899169,4cyclictest15-21ksoftirqd/019:30:120
1527899167,6cyclictest15-21ksoftirqd/020:10:120
15278991614,1cyclictest1178-21runrttasks21:38:010
15278991613,2cyclictest9774-21awk23:45:210
15278991613,2cyclictest4578-21aten_r4power_cu20:45:120
15278991613,2cyclictest25633-21perl19:25:130
15278991613,2cyclictest1146-21snmpd21:25:150
15278991613,2cyclictest1146-21snmpd20:50:080
15278991610,5cyclictest0-21swapper/022:48:430
1527899161,8cyclictest0-21swapper/019:37:420
734152150,10pltrace54-21ksoftirqd/423:48:524
3202152150,10pltrace54-21ksoftirqd/421:37:224
2644852150,10pltrace54-21ksoftirqd/421:27:194
2257252150,6pltrace0-21swapper/620:20:226
1853752150,0pltrace0-21swapper/700:05:187
1699852150,2pltrace0-21swapper/720:10:467
15306991511,3cyclictest0-21swapper/723:00:017
1530699150,8cyclictest0-21swapper/719:32:507
1530699150,14cyclictest0-21swapper/723:47:537
1530699150,14cyclictest0-21swapper/720:03:247
1530399151,3cyclictest0-21swapper/621:47:376
1530399151,3cyclictest0-21swapper/620:11:556
1530399150,7cyclictest0-21swapper/600:24:396
1529999151,13cyclictest0-21swapper/522:39:145
1529999150,14cyclictest0-21swapper/523:31:235
1529999150,14cyclictest0-21swapper/519:19:475
1529999150,14cyclictest0-21swapper/500:30:095
1529599150,8cyclictest0-21swapper/420:44:234
1529599150,8cyclictest0-21swapper/419:16:464
1529599150,7cyclictest0-21swapper/422:20:144
1529599150,7cyclictest0-21swapper/422:20:144
1529599150,7cyclictest0-21swapper/421:31:014
1529599150,4cyclictest0-21swapper/419:41:544
1529599150,14cyclictest0-21swapper/419:50:574
1529599150,11cyclictest0-21swapper/423:55:064
1529099159,5cyclictest0-21swapper/319:16:303
1529099150,14cyclictest0-21swapper/323:55:213
1529099150,14cyclictest0-21swapper/323:42:593
1529099150,14cyclictest0-21swapper/300:19:213
1528699159,5cyclictest0-21swapper/223:49:292
15286991512,2cyclictest0-21swapper/219:20:462
1528699150,8cyclictest0-21swapper/223:06:152
1528699150,4cyclictest0-21swapper/219:29:272
1528699150,3cyclictest0-21swapper/222:50:002
1528699150,14cyclictest0-21swapper/221:49:402
1528699150,14cyclictest0-21swapper/219:36:432
1528699150,14cyclictest0-21swapper/200:01:352
15281991510,3cyclictest0-21swapper/123:14:541
1528199151,7cyclictest0-21swapper/120:38:521
1528199150,7cyclictest0-21swapper/120:01:581
1528199150,14cyclictest0-21swapper/123:26:491
1528199150,14cyclictest0-21swapper/122:51:091
1528199150,14cyclictest0-21swapper/120:08:541
1527899159,5cyclictest0-21swapper/020:03:130
15278991512,2cyclictest3850-21http_loadtime21:40:140
15278991512,2cyclictest30872-21sshd20:33:170
15278991512,2cyclictest29520-21expr23:25:110
15278991512,2cyclictest26811-21hostname20:25:150
15278991512,2cyclictest21111-21taskset22:10:190
15278991512,2cyclictest20414-21timerwakeupswit21:10:220
15278991512,2cyclictest1146-21snmpd20:56:320
15278991510,2cyclictest15-21ksoftirqd/019:48:230
1527899150,14cyclictest0-21swapper/023:56:050
968552140,8pltrace0-21swapper/620:58:026
15306991413,1cyclictest0-21swapper/700:10:197
1530699140,8cyclictest0-21swapper/722:51:527
1530699140,7cyclictest0-21swapper/720:47:177
1530699140,3cyclictest0-21swapper/723:09:587
1530699140,14cyclictest0-21swapper/719:50:187
1530699140,1cyclictest0-21swapper/723:10:167
1530699140,1cyclictest0-21swapper/722:05:017
1530699140,1cyclictest0-21swapper/722:05:017
15303991412,1cyclictest0-21swapper/619:40:206
1530399140,7cyclictest0-21swapper/622:01:346
1530399140,7cyclictest0-21swapper/622:01:346
1530399140,7cyclictest0-21swapper/621:51:586
1530399140,7cyclictest0-21swapper/620:27:596
15299991412,1cyclictest0-21swapper/500:28:205
1529999141,12cyclictest0-21swapper/522:18:595
1529999141,12cyclictest0-21swapper/522:18:595
1529999140,8cyclictest0-21swapper/520:09:545
1529999140,7cyclictest0-21swapper/521:35:395
1529999140,3cyclictest0-21swapper/519:38:245
1529999140,13cyclictest0-21swapper/522:00:115
1529999140,13cyclictest0-21swapper/522:00:115
1529599149,4cyclictest0-21swapper/422:38:594
1529599140,8cyclictest0-21swapper/423:11:214
1529599140,7cyclictest0-21swapper/400:10:564
1529599140,3cyclictest0-21swapper/421:20:074
1529599140,13cyclictest0-21swapper/420:15:174
1529099141,6cyclictest0-21swapper/322:22:563
1529099141,6cyclictest0-21swapper/322:22:563
1529099140,1cyclictest0-21swapper/319:40:113
1528699140,7cyclictest0-21swapper/223:27:222
1528699140,3cyclictest0-21swapper/219:14:542
1528699140,3cyclictest0-21swapper/219:14:532
1528699140,13cyclictest0-21swapper/223:11:092
1528199149,4cyclictest0-21swapper/100:36:071
15281991411,2cyclictest0-21swapper/122:45:201
1528199140,7cyclictest0-21swapper/100:25:551
1528199140,6cyclictest0-21swapper/121:39:331
1528199140,13cyclictest0-21swapper/122:00:211
1528199140,13cyclictest0-21swapper/122:00:211
1527899149,2cyclictest15-21ksoftirqd/020:16:270
15278991412,1cyclictest9424-21expr19:55:130
15278991412,1cyclictest30857-21aten_r4power_vo22:30:120
15278991412,1cyclictest23485-21/usr/sbin/munin23:15:100
15278991411,2cyclictest820-21cat19:40:110
15278991411,2cyclictest5684-21wget21:45:130
15278991411,2cyclictest4742-21grep22:40:130
15278991411,2cyclictest3664-21cstates00:35:110
15278991411,2cyclictest32395-21entropy23:30:120
15278991411,2cyclictest26049-21cat00:15:190
15278991411,2cyclictest24540-21expr21:20:110
15278991411,2cyclictest24373-21cat20:20:170
15278991411,2cyclictest2356-21sed22:35:170
15278991411,2cyclictest2345-21sed00:30:220
15278991411,2cyclictest22153-21cpuspeed_turbos19:20:110
15278991411,2cyclictest17780-21sensors00:00:190
15278991411,2cyclictest17039-21missed_timers21:05:170
15278991411,2cyclictest15936-21grep23:00:140
15278991411,2cyclictest14578-21taskset22:58:240
15278991411,2cyclictest1146-21snmpd23:50:560
15278991411,2cyclictest1146-21snmpd23:10:010
15278991411,2cyclictest1146-21snmpd20:05:460
15278991411,1cyclictest191rcu_preempt23:35:140
1527899140,1cyclictest0-21swapper/022:05:180
1527899140,1cyclictest0-21swapper/022:05:180
689452130,6pltrace0-21swapper/520:48:595
348152130,5pltrace0-21swapper/722:42:357
2968752130,0pltrace0-21swapper/700:27:497
240652130,11pltrace0-21swapper/521:40:565
2302452130,9pltrace78-21ksoftirqd/723:15:217
2302452130,4pltrace0-21swapper/623:14:236
1916152130,4pltrace20809-21latency22:10:165
1572752130,8pltrace54-21ksoftirqd/400:01:004
1530699139,3cyclictest0-21swapper/721:13:057
15306991311,1cyclictest0-21swapper/722:10:117
15306991311,1cyclictest0-21swapper/721:54:587
15306991310,2cyclictest0-21swapper/720:50:127
1530699130,13cyclictest0-21swapper/700:15:217
1530699130,12cyclictest0-21swapper/720:06:287
15303991310,2cyclictest0-21swapper/620:15:206
1530399130,6cyclictest0-21swapper/622:53:066
1529999138,3cyclictest0-21swapper/521:32:155
1529999131,11cyclictest0-21swapper/522:49:185
1529999130,13cyclictest0-21swapper/523:28:565
1529999130,1cyclictest0-21swapper/521:10:015
1529599130,12cyclictest0-21swapper/422:15:564
1529599130,12cyclictest0-21swapper/422:15:564
1529599130,12cyclictest0-21swapper/420:24:584
1529099138,4cyclictest0-21swapper/322:48:003
1529099136,6cyclictest0-21swapper/321:28:543
15290991312,1cyclictest0-21swapper/300:13:203
1529099130,13cyclictest0-21swapper/320:40:243
1528699137,5cyclictest0-21swapper/222:01:312
1528699137,5cyclictest0-21swapper/222:01:312
1528699137,3cyclictest0-21swapper/200:23:432
1528699130,12cyclictest0-21swapper/221:08:462
1528699130,12cyclictest0-21swapper/220:10:432
1528199139,3cyclictest0-21swapper/123:22:101
15281991311,1cyclictest0-21swapper/123:54:151
1528199130,6cyclictest0-21swapper/100:00:561
1528199130,12cyclictest0-21swapper/122:23:191
1528199130,12cyclictest0-21swapper/122:23:191
15278991311,1cyclictest20462-21/usr/sbin/munin00:05:180
15278991311,1cyclictest13800-21perl21:00:110
15278991310,2cyclictest8512-21cut21:50:110
15278991310,2cyclictest6821-21df19:50:130
15278991310,2cyclictest27368-21aten_r4power_cu00:20:090
15278991310,2cyclictest22413-21interrupts21:15:160
15278991310,2cyclictest19712-21df19:15:120
15278991310,2cyclictest16097-21df19:10:130
15278991310,2cyclictest16097-21df19:10:130
15278991310,2cyclictest1146-21snmpd22:20:030
15278991310,2cyclictest1146-21snmpd22:20:020
15278991310,2cyclictest11306-21aten_r4power_po21:55:110
1139452130,1pltrace0-21swapper/620:02:036
905652120,5pltrace0-21swapper/222:53:142
860952120,8pltrace78-21ksoftirqd/719:55:227
519652120,5pltrace0-21swapper/521:47:525
348152120,5pltrace0-21swapper/322:42:353
3264452120,5pltrace0-21swapper/219:42:352
2411052120,3pltrace191rcu_preempt00:15:001
1572752120,5pltrace0-21swapper/500:01:175
1530699127,4cyclictest0-21swapper/719:15:357
1530699127,3cyclictest0-21swapper/723:41:107
1530699120,12cyclictest0-21swapper/719:35:197
1530699120,11cyclictest0-21swapper/723:32:267
1530399128,2cyclictest0-21swapper/619:39:336
1530399126,5cyclictest0-21swapper/622:10:286
1530399126,5cyclictest0-21swapper/600:25:576
1530399122,8cyclictest0-21swapper/600:04:416
1530399120,11cyclictest0-21swapper/622:25:296
1530399120,11cyclictest0-21swapper/619:18:486
1529999129,2cyclictest1055-17auditd00:40:005
1529999120,11cyclictest0-21swapper/520:39:545
1529999120,11cyclictest0-21swapper/520:15:145
1529999120,11cyclictest0-21swapper/520:10:065
1529999120,1cyclictest0-21swapper/523:02:325
1529999120,1cyclictest0-21swapper/522:24:585
1529999120,1cyclictest0-21swapper/522:24:585
1529599129,2cyclictest1146-21snmpd22:28:414
1529599128,3cyclictest0-21swapper/420:27:164
1529599126,5cyclictest0-21swapper/423:51:424
1529599126,5cyclictest0-21swapper/422:09:584
1529599126,5cyclictest0-21swapper/422:09:584
1529599125,6cyclictest15181-21wget23:00:124
15295991211,1cyclictest0-21swapper/420:55:224
15295991211,1cyclictest0-21swapper/420:52:184
15295991210,1cyclictest0-21swapper/400:05:084
1529599120,12cyclictest54-21ksoftirqd/420:46:164
1529099127,3cyclictest0-21swapper/322:27:413
1529099126,5cyclictest0-21swapper/321:57:023
1529099126,5cyclictest0-21swapper/321:54:473
1529099126,3cyclictest0-21swapper/321:20:273
1529099120,12cyclictest0-21swapper/323:25:333
1529099120,11cyclictest0-21swapper/323:39:283
1529099120,11cyclictest0-21swapper/322:09:193
1529099120,11cyclictest0-21swapper/322:09:193
1529099120,1cyclictest0-21swapper/321:44:033
1528699127,3cyclictest0-21swapper/222:08:142
1528699127,3cyclictest0-21swapper/222:08:142
1528699126,3cyclictest0-21swapper/219:18:412
1528699120,11cyclictest0-21swapper/222:21:562
1528699120,11cyclictest0-21swapper/222:21:552
1528699120,11cyclictest0-21swapper/220:50:462
1528199126,5cyclictest0-21swapper/120:52:381
1528199122,8cyclictest0-21swapper/120:26:071
15281991211,1cyclictest0-21swapper/120:10:131
15281991211,1cyclictest0-21swapper/119:59:141
1528199120,11cyclictest0-21swapper/123:56:531
1528199120,11cyclictest0-21swapper/119:40:081
1528199120,11cyclictest0-21swapper/100:23:541
1463352120,10pltrace0-21swapper/123:01:021
1247252120,0pltrace0-21swapper/721:01:177
1012852120,4pltrace0-21swapper/323:49:063
968552110,0pltrace0-21swapper/720:57:237
3202152110,0pltrace0-21swapper/621:37:276
2644852110,4pltrace0-21swapper/121:27:251
2257252110,4pltrace23350-21tr20:20:122
2257252110,2pltrace1054-21irqbalance20:21:253
2149952110,6pltrace23940-21sed19:20:206
2087352110,4pltrace0-21swapper/121:17:131
1699852110,7pltrace54-21ksoftirqd/420:11:064
1530699116,4cyclictest16953-21timerwakeupswit23:00:237
15306991110,1cyclictest0-21swapper/721:08:017
15306991110,1cyclictest0-21swapper/720:32:547
1530699110,1cyclictest0-21swapper/723:20:577
1530699110,1cyclictest0-21swapper/721:41:037
1530699110,1cyclictest0-21swapper/720:41:007
1530399118,2cyclictest0-21swapper/600:10:236
15303991110,1cyclictest0-21swapper/622:55:376
15303991110,1cyclictest0-21swapper/621:28:396
1530399110,9cyclictest0-21swapper/619:56:006
1530399110,9cyclictest0-21swapper/619:31:056
1530399110,11cyclictest0-21swapper/623:23:576
1530399110,1cyclictest0-21swapper/623:40:466
1530399110,1cyclictest0-21swapper/621:40:096
1530399110,1cyclictest0-21swapper/600:17:416
1529999119,1cyclictest0-21swapper/521:50:105
1529999118,2cyclictest1146-21snmpd19:27:085
1529999117,3cyclictest1146-21snmpd21:21:135
1529999117,3cyclictest0-21swapper/520:59:175
1529999117,3cyclictest0-21swapper/520:28:465
1529999115,5cyclictest0-21swapper/500:24:125
1529999115,3cyclictest0-21swapper/522:29:265
15299991110,1cyclictest0-21swapper/523:16:475
15299991110,1cyclictest0-21swapper/523:06:065
1529999110,5cyclictest0-21swapper/522:41:195
1529999110,11cyclictest0-21swapper/523:56:365
1529999110,11cyclictest0-21swapper/523:37:315
1529999110,11cyclictest0-21swapper/521:15:515
1529999110,11cyclictest0-21swapper/519:43:335
1529999110,11cyclictest0-21swapper/500:05:505
1529999110,1cyclictest0-21swapper/500:10:515
1529599119,1cyclictest0-21swapper/421:44:274
1529599117,3cyclictest1146-21snmpd21:13:594
1529599117,3cyclictest0-21swapper/423:10:004
1529599115,3cyclictest0-21swapper/423:25:494
1529599115,3cyclictest0-21swapper/400:32:424
15295991110,1cyclictest0-21swapper/422:44:104
15295991110,1cyclictest0-21swapper/422:31:424
15295991110,1cyclictest0-21swapper/420:06:194
15295991110,1cyclictest0-21swapper/400:20:114
1529599110,11cyclictest0-21swapper/423:32:164
1529599110,11cyclictest0-21swapper/422:56:584
1529599110,11cyclictest0-21swapper/421:02:204
1529599110,11cyclictest0-21swapper/420:33:024
1529599110,11cyclictest0-21swapper/420:04:034
1529599110,1cyclictest0-21swapper/423:20:464
1529599110,1cyclictest0-21swapper/422:51:474
1529599110,1cyclictest0-21swapper/422:03:144
1529599110,1cyclictest0-21swapper/422:03:144
1529599110,1cyclictest0-21swapper/421:17:334
1529599110,1cyclictest0-21swapper/400:17:164
1529099118,2cyclictest0-21swapper/323:25:003
1529099117,2cyclictest0-21swapper/320:45:443
15290991110,1cyclictest0-21swapper/323:04:013
15290991110,1cyclictest0-21swapper/322:54:283
15290991110,1cyclictest0-21swapper/322:10:453
15290991110,1cyclictest0-21swapper/320:57:443
15290991110,1cyclictest0-21swapper/320:06:243
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional