You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-27 - 01:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Thu Mar 26, 2026 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13630521030,99pltrace0-21swapper/507:05:175
1363052890,85pltrace0-21swapper/107:05:121
1634827345,10sleep00-21swapper/007:08:430
1644127258,10sleep30-21swapper/307:09:413
1623327259,9sleep60-21swapper/607:07:056
1633226854,10sleep20-21swapper/207:08:282
1628126147,10sleep70-21swapper/707:07:467
1404825642,10sleep40-21swapper/407:05:014
2999252370,6pltrace0-21swapper/711:25:147
2442052350,0pltrace0-21swapper/711:15:207
1045152350,4pltrace0-21swapper/710:50:167
2396852310,0pltrace0-21swapper/708:20:137
3062452290,3pltrace0-21swapper/709:30:177
1884652280,0pltrace0-21swapper/711:05:107
1668152280,0pltrace0-21swapper/709:05:197
163952210,2pltrace2073-21/usr/sbin/munin07:40:117
1662599200,20cyclictest0-21swapper/610:25:196
1661799200,15cyclictest0-21swapper/410:16:354
16609992014,5cyclictest0-21swapper/210:36:332
1107852190,1pltrace1283-21pltrace-run08:54:256
1107852190,1pltrace1283-21pltrace-run08:54:256
2163152180,0pltrace0-21swapper/711:10:107
1660199181,2cyclictest0-21swapper/009:34:330
1431852180,4pltrace0-21swapper/711:57:557
1000552180,0pltrace0-21swapper/707:55:207
3125752170,0pltrace0-21swapper/707:36:437
2827752170,0pltrace0-21swapper/712:22:157
1776752170,3pltrace54-21ksoftirqd/410:05:134
16629991711,5cyclictest0-21swapper/709:47:527
16609991711,5cyclictest0-21swapper/212:07:002
1660199171,8cyclictest0-21swapper/007:13:530
1279152170,12pltrace14730-21processes08:00:192
316852160,4pltrace0-21swapper/311:38:503
2891452160,2pltrace0-21swapper/710:25:457
1946652160,3pltrace0-21swapper/709:10:147
1662999160,8cyclictest0-21swapper/710:35:237
16625991611,3cyclictest0-21swapper/612:37:366
1662599161,8cyclictest0-21swapper/611:36:526
1662599161,4cyclictest0-21swapper/607:25:146
1662599161,14cyclictest0-21swapper/609:47:196
1662099160,2cyclictest5133-21cstates12:35:115
16617991611,3cyclictest0-21swapper/412:11:324
1661799161,12cyclictest0-21swapper/408:45:244
1661799161,12cyclictest0-21swapper/408:45:244
16612991611,3cyclictest0-21swapper/311:44:383
1661299161,4cyclictest0-21swapper/308:10:123
16609991611,4cyclictest0-21swapper/210:03:282
16609991611,3cyclictest0-21swapper/208:58:592
1660999161,14cyclictest0-21swapper/209:17:292
1660199161,7cyclictest0-21swapper/010:57:050
1660199161,14cyclictest0-21swapper/008:32:560
1660199160,15cyclictest0-21swapper/010:36:380
1660199160,14cyclictest0-21swapper/008:50:170
1660199160,14cyclictest0-21swapper/008:50:170
1602752160,2pltrace0-21swapper/711:02:407
2505052150,0pltrace0-21swapper/709:20:127
2442052150,10pltrace0-21swapper/311:18:193
2270652150,2pltrace0-21swapper/712:11:087
1662999159,5cyclictest0-21swapper/710:46:117
1662999151,8cyclictest0-21swapper/707:22:337
1662999150,2cyclictest0-21swapper/709:25:107
1662999150,14cyclictest0-21swapper/710:16:017
1662999150,14cyclictest0-21swapper/709:19:007
1662599159,5cyclictest0-21swapper/608:44:326
1662599150,14cyclictest0-21swapper/608:58:306
1662099150,14cyclictest0-21swapper/512:00:125
1661799159,5cyclictest0-21swapper/409:02:514
1661799150,7cyclictest0-21swapper/411:28:284
1661799150,14cyclictest0-21swapper/412:09:114
16612991511,3cyclictest0-21swapper/308:03:573
16612991510,3cyclictest0-21swapper/310:43:273
1661299151,3cyclictest0-21swapper/309:41:133
1661299150,7cyclictest0-21swapper/309:03:023
1661299150,4cyclictest0-21swapper/311:00:283
1661299150,3cyclictest0-21swapper/310:23:503
1661299150,14cyclictest0-21swapper/309:23:513
1661299150,13cyclictest0-21swapper/308:24:123
16609991510,4cyclictest0-21swapper/211:53:502
16609991510,4cyclictest0-21swapper/211:53:502
1660999151,3cyclictest0-21swapper/210:29:592
1660999151,2cyclictest0-21swapper/211:26:102
1660999150,8cyclictest0-21swapper/208:10:012
1660999150,7cyclictest0-21swapper/209:12:022
1660999150,4cyclictest0-21swapper/211:07:282
1660999150,14cyclictest0-21swapper/207:30:002
1660199159,5cyclictest0-21swapper/009:07:450
1660199151,3cyclictest0-21swapper/011:32:400
1660199151,13cyclictest0-21swapper/012:31:220
1660199151,12cyclictest0-21swapper/008:22:190
1660199150,8cyclictest0-21swapper/010:28:220
1660199150,14cyclictest0-21swapper/012:17:150
1660199150,14cyclictest0-21swapper/009:43:300
1660199150,14cyclictest0-21swapper/007:50:300
1660199150,13cyclictest0-21swapper/009:53:210
144152150,6pltrace0-21swapper/212:30:222
937652140,0pltrace0-21swapper/309:49:263
658852140,1pltrace0-21swapper/009:46:290
550252140,8pltrace8074-21chrt08:46:385
550252140,8pltrace8074-21chrt08:46:385
220932140,1sleep50-21swapper/507:15:195
1992252140,5pltrace0-21swapper/112:05:011
1992252140,2pltrace0-21swapper/712:05:207
1992252140,1pltrace0-21swapper/312:05:013
16629991410,2cyclictest0-21swapper/710:06:147
1662999141,12cyclictest0-21swapper/712:28:077
1662999140,7cyclictest0-21swapper/707:13:247
1662999140,3cyclictest0-21swapper/712:19:217
1662599148,5cyclictest0-21swapper/608:46:026
1662599148,5cyclictest0-21swapper/608:46:026
1662599140,7cyclictest0-21swapper/612:15:086
1662599140,7cyclictest0-21swapper/607:33:546
1662599140,3cyclictest0-21swapper/610:40:326
1662599140,13cyclictest0-21swapper/610:53:086
1662599140,13cyclictest0-21swapper/609:05:146
1661799149,2cyclictest0-21swapper/410:43:064
16617991412,1cyclictest0-21swapper/409:05:214
1661799141,12cyclictest0-21swapper/407:14:164
1661799140,7cyclictest0-21swapper/409:45:524
1661799140,7cyclictest0-21swapper/408:31:434
1661799140,14cyclictest0-21swapper/411:35:204
1661799140,13cyclictest0-21swapper/408:50:114
1661799140,13cyclictest0-21swapper/408:50:114
1661799140,13cyclictest0-21swapper/408:35:124
1661799140,13cyclictest0-21swapper/407:36:474
1661299149,3cyclictest0-21swapper/310:59:123
16612991412,1cyclictest1716-21strings08:35:163
16612991412,1cyclictest0-21swapper/309:50:243
1661299140,8cyclictest0-21swapper/311:07:103
1661299140,13cyclictest0-21swapper/311:28:523
1661299140,1cyclictest0-21swapper/312:25:113
1660999140,3cyclictest0-21swapper/212:22:362
1660999140,1cyclictest0-21swapper/210:05:142
1660199149,3cyclictest0-21swapper/007:42:120
1660199140,13cyclictest0-21swapper/008:17:340
144152140,1pltrace0-21swapper/112:29:261
828852130,4pltrace0-21swapper/708:50:467
828852130,4pltrace0-21swapper/708:50:467
721252130,2pltrace0-21swapper/207:51:092
31052130,0pltrace0-21swapper/711:33:487
2999252130,2pltrace30024-21taskset11:24:492
2954252130,2pltrace32273-21chrt08:33:522
2846852130,10pltrace29700-21cut07:30:132
2846852130,1pltrace28697-21latency_hist07:30:005
2846852130,1pltrace0-21swapper/107:30:011
2612652130,8pltrace27100-21sh10:20:124
2568852130,0pltrace0-21swapper/707:27:417
2334152130,6pltrace0-21swapper/010:17:460
2334152130,5pltrace0-21swapper/510:17:485
2163152130,2pltrace1055-17auditd11:09:596
1992252130,2pltrace20066-21latency_hist12:05:007
1946652130,5pltrace0-21swapper/309:11:533
1662999139,2cyclictest0-21swapper/710:59:597
16629991312,1cyclictest0-21swapper/710:00:117
1662999130,1cyclictest0-21swapper/708:38:457
1662599133,8cyclictest0-21swapper/611:51:466
1662599133,8cyclictest0-21swapper/611:51:466
16625991310,2cyclictest1146-21snmpd12:23:026
1662599130,13cyclictest0-21swapper/612:10:176
1662599130,12cyclictest0-21swapper/609:36:576
1662099138,4cyclictest1055-17auditd10:00:005
1662099130,13cyclictest0-21swapper/511:28:105
1662099130,1cyclictest0-21swapper/510:52:045
1662099130,1cyclictest0-21swapper/510:09:295
1661799138,4cyclictest0-21swapper/409:26:494
1661799136,6cyclictest0-21swapper/407:51:474
1661799132,8cyclictest0-21swapper/407:46:294
1661799130,12cyclictest0-21swapper/412:21:204
1661799130,12cyclictest0-21swapper/408:06:154
1661299138,3cyclictest0-21swapper/312:15:153
16612991310,2cyclictest1146-21snmpd08:47:193
16612991310,2cyclictest1146-21snmpd08:47:193
1661299130,7cyclictest0-21swapper/311:33:593
1661299130,12cyclictest0-21swapper/310:19:023
1660999130,12cyclictest0-21swapper/211:45:502
1660999130,12cyclictest0-21swapper/211:45:502
1660999130,12cyclictest0-21swapper/210:14:502
1660999130,1cyclictest0-21swapper/209:25:092
16606991310,2cyclictest1146-21snmpd09:40:121
16606991310,2cyclictest1146-21snmpd08:24:371
16606991310,2cyclictest1065-17sedispatch11:25:001
1660199137,5cyclictest0-21swapper/010:31:110
1660199137,5cyclictest0-21swapper/007:37:210
1660199130,13cyclictest0-21swapper/007:20:030
1660199130,13cyclictest0-21swapper/007:15:210
1660199130,12cyclictest0-21swapper/010:50:110
1660199130,12cyclictest0-21swapper/009:20:080
1660199130,1cyclictest0-21swapper/010:06:570
1660199130,1cyclictest0-21swapper/007:47:440
1559752130,5pltrace0-21swapper/008:09:000
1279152130,5pltrace0-21swapper/108:00:191
1153152130,0pltrace0-21swapper/711:50:147
1153152130,0pltrace0-21swapper/711:50:147
766452120,6pltrace54-21ksoftirqd/410:45:144
550252120,5pltrace0-21swapper/008:46:480
550252120,5pltrace0-21swapper/008:46:480
550252120,0pltrace0-21swapper/708:45:177
550252120,0pltrace0-21swapper/708:45:177
379852120,9pltrace54-21ksoftirqd/409:40:234
3169852120,4pltrace0-21swapper/310:30:393
316852120,1pltrace0-21swapper/211:37:522
3106652120,6pltrace54-21ksoftirqd/412:28:384
2846852120,1pltrace28889-21systemd-cgroups07:30:011
2549352120,5pltrace0-21swapper/112:18:191
2396852120,5pltrace0-21swapper/508:21:055
2290252120,3pltrace24059-21grep07:20:126
2163152120,4pltrace0-21swapper/311:11:053
1662999126,5cyclictest0-21swapper/708:33:567
1662999120,11cyclictest0-21swapper/708:15:067
1662599129,2cyclictest16999-21gltestperf08:05:136
1662599126,5cyclictest0-21swapper/611:40:076
1662599126,5cyclictest0-21swapper/609:54:376
1662599126,5cyclictest0-21swapper/608:19:136
16625991211,1cyclictest0-21swapper/612:05:066
1662599120,2cyclictest0-21swapper/610:05:116
1662599120,11cyclictest0-21swapper/611:14:516
1662599120,11cyclictest0-21swapper/608:35:206
1662099128,3cyclictest14495-21cpuspeed_turbos09:00:115
1662099126,2cyclictest163952pltrace07:39:595
16620991211,1cyclictest0-21swapper/511:35:465
16620991211,1cyclictest0-21swapper/508:12:055
16620991211,1cyclictest0-21swapper/507:31:275
16620991211,1cyclictest0-21swapper/507:21:535
1662099120,12cyclictest0-21swapper/511:41:165
1662099120,12cyclictest0-21swapper/511:24:465
1662099120,12cyclictest0-21swapper/511:16:405
1662099120,12cyclictest0-21swapper/508:35:345
1662099120,1cyclictest0-21swapper/512:08:475
1662099120,1cyclictest0-21swapper/510:12:045
1661799126,5cyclictest0-21swapper/411:13:404
1661799123,8cyclictest0-21swapper/411:34:294
1661799122,8cyclictest0-21swapper/408:00:154
1661799120,11cyclictest0-21swapper/411:44:434
1661799120,11cyclictest0-21swapper/411:05:424
1661799120,11cyclictest0-21swapper/409:37:094
1661299129,2cyclictest1055-17auditd11:55:013
1661299129,2cyclictest1055-17auditd11:55:013
1661299126,5cyclictest0-21swapper/310:25:563
1661299126,5cyclictest0-21swapper/309:06:383
1661299120,11cyclictest17818-21turbostat.cron10:09:553
1661299120,11cyclictest0-21swapper/311:59:593
1661299120,11cyclictest0-21swapper/307:48:093
1661299120,1cyclictest0-21swapper/312:20:293
1661299120,1cyclictest0-21swapper/308:15:503
1661299120,1cyclictest0-21swapper/307:55:073
1661299120,1cyclictest0-21swapper/307:50:053
1661299120,1cyclictest0-21swapper/307:10:063
1660999128,3cyclictest855-21latency10:30:172
1660999127,4cyclictest0-21swapper/207:56:042
16609991210,1cyclictest0-21swapper/208:50:032
16609991210,1cyclictest0-21swapper/208:50:032
1660999121,1cyclictest0-21swapper/210:53:262
1660999120,5cyclictest0-21swapper/212:37:592
1660999120,11cyclictest0-21swapper/207:20:222
1660999120,1cyclictest0-21swapper/211:42:102
1660699129,2cyclictest0-21swapper/107:35:361
1660699128,3cyclictest22351-21fschecks_time08:15:141
16606991211,1cyclictest0-21swapper/110:51:081
1660699120,12cyclictest0-21swapper/108:50:301
1660699120,12cyclictest0-21swapper/108:50:291
1660699120,11cyclictest0-21swapper/110:30:041
1660699120,11cyclictest0-21swapper/109:10:531
1660699120,1cyclictest0-21swapper/112:20:301
1660699120,1cyclictest0-21swapper/109:55:051
1660199127,4cyclictest13523-21tr08:00:120
1660199126,5cyclictest0-21swapper/010:42:110
16601991210,1cyclictest0-21swapper/009:56:260
1660199120,2cyclictest0-21swapper/009:25:180
1660199120,12cyclictest0-21swapper/007:27:540
1660199120,11cyclictest0-21swapper/011:05:530
1660199120,11cyclictest0-21swapper/007:57:460
163952120,5pltrace0-21swapper/307:41:373
1495252120,3pltrace16825-21ntp_states10:00:176
144152120,3pltrace0-21swapper/712:31:017
1279152120,6pltrace14823-21smart_sda08:00:195
550252110,4pltrace0-21swapper/108:46:491
550252110,4pltrace0-21swapper/108:46:491
2846852110,6pltrace78-21ksoftirqd/707:30:117
2549352110,3pltrace54-21ksoftirqd/412:18:034
2396852110,1pltrace24511-21cpu08:20:112
208952110,8pltrace54-21ksoftirqd/410:35:134
2055452110,2pltrace22033-21if_err_eth010:10:137
1927652110,7pltrace54-21ksoftirqd/407:15:014
1662999116,4cyclictest0-21swapper/711:23:157
1662999116,4cyclictest0-21swapper/707:45:217
16629991110,1cyclictest0-21swapper/709:50:377
16629991110,1cyclictest0-21swapper/708:56:437
1662999110,11cyclictest0-21swapper/712:37:147
1662999110,11cyclictest0-21swapper/711:49:567
1662999110,11cyclictest0-21swapper/711:49:567
1662999110,11cyclictest0-21swapper/709:57:067
1662999110,11cyclictest0-21swapper/709:38:297
1662999110,11cyclictest0-21swapper/708:26:367
1662999110,1cyclictest0-21swapper/711:40:527
1662999110,1cyclictest0-21swapper/707:17:387
1662599118,2cyclictest404-21cat09:30:236
1662599118,2cyclictest26838-21cut09:20:186
1662599118,2cyclictest19170-21expr08:10:116
1662599118,2cyclictest1146-21snmpd09:01:396
1662599118,2cyclictest1065-17sedispatch11:20:066
1662599117,2cyclictest0-21swapper/612:31:426
1662599116,4cyclictest0-21swapper/611:46:586
1662599116,4cyclictest0-21swapper/611:46:586
1662599116,3cyclictest0-21swapper/609:43:046
1662599115,5cyclictest0-21swapper/609:11:036
16625991110,1cyclictest0-21swapper/611:27:136
16625991110,1cyclictest0-21swapper/610:36:336
16625991110,1cyclictest0-21swapper/608:30:366
16625991110,1cyclictest0-21swapper/607:13:216
1662599110,11cyclictest0-21swapper/612:02:316
1662599110,11cyclictest0-21swapper/609:19:206
1662599110,11cyclictest0-21swapper/607:15:086
1662599110,1cyclictest0-21swapper/612:27:276
1662599110,1cyclictest0-21swapper/608:22:206
1662599110,1cyclictest0-21swapper/607:54:586
1662599110,1cyclictest0-21swapper/607:38:376
1662099119,1cyclictest0-21swapper/510:20:105
1662099118,2cyclictest4799-21uniq09:40:145
16620991110,1cyclictest0-21swapper/512:13:295
16620991110,1cyclictest0-21swapper/510:35:425
16620991110,1cyclictest0-21swapper/510:30:415
16620991110,1cyclictest0-21swapper/510:02:315
16620991110,1cyclictest0-21swapper/509:31:065
16620991110,1cyclictest0-21swapper/509:16:325
16620991110,1cyclictest0-21swapper/508:50:575
16620991110,1cyclictest0-21swapper/508:50:575
1662099110,11cyclictest0-21swapper/510:43:385
1662099110,11cyclictest0-21swapper/508:32:405
1662099110,11cyclictest0-21swapper/508:09:395
1662099110,11cyclictest0-21swapper/507:14:465
1662099110,1cyclictest0-21swapper/512:28:235
1662099110,1cyclictest0-21swapper/509:08:465
1662099110,1cyclictest0-21swapper/508:27:385
1661799117,2cyclictest0-21swapper/408:43:554
1661799116,3cyclictest0-21swapper/411:56:324
1661799115,5cyclictest0-21swapper/411:02:374
1661799115,5cyclictest0-21swapper/409:33:494
1661799112,8cyclictest0-21swapper/410:55:274
16617991110,1cyclictest0-21swapper/410:00:574
16617991110,1cyclictest0-21swapper/408:21:504
16617991110,1cyclictest0-21swapper/408:17:184
1661799110,9cyclictest0-21swapper/411:51:054
1661799110,9cyclictest0-21swapper/411:51:054
1661799110,11cyclictest0-21swapper/410:31:034
1661799110,11cyclictest0-21swapper/410:28:574
1661799110,1cyclictest0-21swapper/412:32:094
1661799110,1cyclictest0-21swapper/411:17:224
1661799110,1cyclictest0-21swapper/409:11:534
1661299119,1cyclictest0-21swapper/308:55:133
1661299112,8cyclictest0-21swapper/309:55:273
16612991110,1cyclictest0-21swapper/312:35:233
16612991110,1cyclictest0-21swapper/311:46:003
16612991110,1cyclictest0-21swapper/311:46:003
16612991110,1cyclictest0-21swapper/310:01:153
16612991110,1cyclictest0-21swapper/307:37:373
16612991110,1cyclictest0-21swapper/307:34:523
1661299110,11cyclictest0-21swapper/312:10:373
1661299110,11cyclictest0-21swapper/310:35:543
1661299110,11cyclictest0-21swapper/309:30:393
1661299110,11cyclictest0-21swapper/308:05:283
1661299110,1cyclictest0-21swapper/309:25:483
1660999118,2cyclictest1146-21snmpd07:45:332
1660999118,2cyclictest0-21swapper/208:40:182
1660999117,3cyclictest8585-21sendmail_mailqu09:45:202
1660999116,3cyclictest0-21swapper/211:33:412
16609991110,1cyclictest0-21swapper/211:00:532
16609991110,1cyclictest0-21swapper/210:41:562
16609991110,1cyclictest0-21swapper/209:56:262
16609991110,1cyclictest0-21swapper/209:38:382
16609991110,1cyclictest0-21swapper/208:26:352
1660999110,11cyclictest0-21swapper/210:19:072
1660999110,1cyclictest0-21swapper/212:02:342
1660999110,1cyclictest0-21swapper/207:18:452
1660999110,1cyclictest0-21swapper/207:10:202
16606991110,1cyclictest0-21swapper/112:34:361
16606991110,1cyclictest0-21swapper/111:41:091
16606991110,1cyclictest0-21swapper/111:29:401
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional