You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-11 - 04:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Wed Mar 11, 2026 00:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5290521160,47pltrace0-21swapper/719:05:177
807452890,85pltrace0-21swapper/219:09:582
1888452870,0pltrace0-21swapper/623:19:346
529052810,77pltrace0-21swapper/319:05:203
782327561,10sleep60-21swapper/619:06:156
570327157,10sleep50-21swapper/519:05:105
569926147,10sleep10-21swapper/119:05:071
795626045,11sleep00-21swapper/019:08:110
787725945,10sleep40-21swapper/419:07:024
944952320,0pltrace0-21swapper/722:05:147
265852290,0sleep60-21swapper/622:35:106
212852290,0pltrace0-21swapper/722:50:137
1161352260,0pltrace0-21swapper/600:04:356
827899254,13cyclictest0-21swapper/622:52:166
1842352250,3pltrace78-21ksoftirqd/720:27:407
827399241,15cyclictest0-21swapper/522:58:355
825999241,22cyclictest0-21swapper/121:12:081
825999230,16cyclictest0-21swapper/122:22:241
827899190,18cyclictest0-21swapper/621:55:206
827899190,14cyclictest0-21swapper/619:30:196
726452190,2pltrace0-21swapper/720:05:207
35052190,5pltrace0-21swapper/723:48:157
2678352190,11pltrace27431-21expr20:40:127
827899180,5cyclictest0-21swapper/622:00:196
827899180,5cyclictest0-21swapper/622:00:196
827899180,1cyclictest0-21swapper/623:20:136
827899180,1cyclictest0-21swapper/621:54:356
827899180,1cyclictest0-21swapper/600:35:226
8282991711,5cyclictest0-21swapper/722:57:017
827899171,15cyclictest0-21swapper/623:14:086
827899171,15cyclictest0-21swapper/622:44:016
827899170,9cyclictest14586-21taskset19:19:526
827899170,1cyclictest0-21swapper/619:46:206
8273991711,5cyclictest0-21swapper/523:17:265
8270991714,2cyclictest0-21swapper/421:55:034
827099170,15cyclictest7415-21flock21:00:164
8265991711,5cyclictest0-21swapper/321:53:093
8263991711,5cyclictest0-21swapper/220:02:122
826399171,15cyclictest0-21swapper/220:56:312
8259991714,2cyclictest0-21swapper/119:45:011
825999171,2cyclictest0-21swapper/119:35:221
3235552170,11pltrace1109-21grep20:50:141
1609852170,11pltrace18727-21chrt23:17:372
1052452170,0pltrace0-21swapper/723:07:387
8282991610,5cyclictest0-21swapper/719:44:337
828299161,4cyclictest0-21swapper/721:39:247
828299161,4cyclictest0-21swapper/721:07:357
828299161,14cyclictest0-21swapper/721:50:017
828299161,14cyclictest0-21swapper/721:50:017
828299161,14cyclictest0-21swapper/719:30:287
827899162,7cyclictest13644-21hostname22:10:146
8278991610,5cyclictest0-21swapper/622:23:446
8278991610,3cyclictest0-21swapper/620:26:276
827899161,14cyclictest0-21swapper/620:55:076
827899160,15cyclictest0-21swapper/600:23:326
8273991610,3cyclictest0-21swapper/523:04:595
826599161,8cyclictest0-21swapper/319:57:423
826599161,8cyclictest0-21swapper/319:30:593
826599161,14cyclictest0-21swapper/321:05:013
826599160,15cyclictest0-21swapper/320:47:313
8263991611,3cyclictest0-21swapper/219:32:142
825999161,8cyclictest0-21swapper/122:02:531
825999161,8cyclictest0-21swapper/122:02:531
825999160,8cyclictest0-21swapper/120:33:431
825999160,15cyclictest0-21swapper/123:54:071
35052160,8pltrace2894-21taskset23:45:261
3235552160,10pltrace1075-21fschecks_time20:50:145
3128052160,1pltrace31284-21pltrace-run19:49:341
8282991513,1cyclictest0-21swapper/722:43:357
8282991510,3cyclictest0-21swapper/723:38:397
828299150,7cyclictest0-21swapper/722:03:007
828299150,7cyclictest0-21swapper/722:03:007
828299150,14cyclictest0-21swapper/721:52:157
828299150,14cyclictest0-21swapper/720:19:597
827899159,5cyclictest0-21swapper/620:23:146
827899150,8cyclictest0-21swapper/600:10:346
827899150,14cyclictest0-21swapper/622:27:076
827899150,14cyclictest0-21swapper/621:36:146
827899150,14cyclictest0-21swapper/619:23:076
827899150,1cyclictest0-21swapper/621:44:046
827899150,1cyclictest0-21swapper/621:25:276
827899150,1cyclictest0-21swapper/621:01:296
827899150,1cyclictest0-21swapper/620:18:536
8273991510,3cyclictest0-21swapper/523:44:545
827399151,3cyclictest0-21swapper/520:57:075
827399150,8cyclictest0-21swapper/520:29:595
827399150,7cyclictest0-21swapper/522:00:215
827399150,7cyclictest0-21swapper/522:00:215
827399150,4cyclictest0-21swapper/522:37:325
827399150,4cyclictest0-21swapper/522:31:055
827399150,14cyclictest0-21swapper/523:21:355
827399150,14cyclictest0-21swapper/521:02:265
8265991513,1cyclictest0-21swapper/320:15:143
8265991510,3cyclictest0-21swapper/321:37:383
826599151,3cyclictest0-21swapper/322:10:043
826599150,8cyclictest0-21swapper/321:20:163
826599150,7cyclictest0-21swapper/321:31:373
826599150,14cyclictest0-21swapper/300:12:183
826399159,5cyclictest0-21swapper/219:27:132
826399150,14cyclictest0-21swapper/200:34:492
826399150,14cyclictest0-21swapper/200:15:492
825999159,5cyclictest0-21swapper/123:11:151
825999159,5cyclictest0-21swapper/121:19:551
8259991510,3cyclictest0-21swapper/119:50:441
825999150,8cyclictest0-21swapper/123:32:541
825999150,8cyclictest0-21swapper/100:32:441
825999150,7cyclictest0-21swapper/100:04:161
825999150,14cyclictest0-21swapper/122:11:061
825999150,14cyclictest0-21swapper/121:46:321
825999150,14cyclictest0-21swapper/121:46:321
825999150,14cyclictest0-21swapper/120:21:391
825999150,14cyclictest0-21swapper/120:01:241
3235552150,3pltrace390-21/usr/sbin/munin20:50:112
3235552150,3pltrace191rcu_preempt20:50:180
2849452150,2pltrace28535-21latency_hist19:45:015
2678352150,10pltrace27508-21cut20:40:115
828299140,6cyclictest0-21swapper/720:37:497
827899149,4cyclictest0-21swapper/619:56:036
827899149,4cyclictest0-21swapper/619:13:436
827899148,5cyclictest0-21swapper/620:36:076
827899148,4cyclictest0-21swapper/620:30:286
827899142,10cyclictest6141-21cut22:55:146
827899142,10cyclictest16058-21grep22:15:146
827899141,7cyclictest0-21swapper/620:45:206
827899140,8cyclictest0-21swapper/623:04:386
827899140,7cyclictest0-21swapper/622:47:496
827899140,13cyclictest0-21swapper/623:55:086
827899140,13cyclictest0-21swapper/619:25:036
827899140,1cyclictest0-21swapper/620:00:456
8273991412,1cyclictest0-21swapper/519:35:165
827399140,7cyclictest0-21swapper/500:28:085
827399140,14cyclictest0-21swapper/520:45:135
8270991413,1cyclictest0-21swapper/423:10:184
8270991411,2cyclictest0-21swapper/421:44:034
826599149,3cyclictest0-21swapper/322:22:583
826599141,12cyclictest0-21swapper/323:48:423
826599140,14cyclictest0-21swapper/319:20:213
8263991411,2cyclictest0-21swapper/219:37:022
826399140,8cyclictest0-21swapper/222:04:032
826399140,8cyclictest0-21swapper/222:04:022
826399140,7cyclictest0-21swapper/223:07:512
825999140,7cyclictest0-21swapper/123:01:561
825999140,7cyclictest0-21swapper/121:51:031
825999140,7cyclictest0-21swapper/121:06:171
825999140,7cyclictest0-21swapper/121:04:031
825999140,13cyclictest0-21swapper/123:15:221
825999140,13cyclictest0-21swapper/122:36:231
825999140,12cyclictest0-21swapper/122:25:031
35052140,1pltrace0-21swapper/523:45:205
3235552140,6pltrace0-21swapper/720:50:157
2787852140,2pltrace27944-21wc21:40:001
2678352140,9pltrace27392-21cpuspeed_turbos20:40:121
2678352140,2pltrace27700-21expr20:40:132
2445652140,2pltrace27039-21chrt23:31:552
828299139,3cyclictest0-21swapper/723:02:287
828299137,5cyclictest0-21swapper/700:20:027
828299136,6cyclictest4521-21cpuspeed_turbos21:55:127
8282991312,1cyclictest0-21swapper/723:50:157
828299130,6cyclictest0-21swapper/723:34:077
828299130,12cyclictest0-21swapper/722:11:217
828299130,12cyclictest0-21swapper/721:42:127
828299130,12cyclictest0-21swapper/719:20:317
827899136,6cyclictest0-21swapper/621:30:566
827899135,7cyclictest1146-21snmpd19:36:016
827899133,9cyclictest1369-21sshd19:50:446
8278991311,1cyclictest0-21swapper/621:10:046
827899130,8cyclictest0-21swapper/600:30:176
827899130,4cyclictest5202-21sendmail_mailtr23:50:196
827899130,4cyclictest18239-21grep21:20:146
827899130,3cyclictest169071latency_hist21:20:016
827899130,12cyclictest0-21swapper/623:49:376
827899130,12cyclictest0-21swapper/623:31:206
827899130,11cyclictest12083-21smart_sda20:10:206
827899130,11cyclictest1146-21snmpd00:05:196
827399130,12cyclictest0-21swapper/500:34:475
8270991311,1cyclictest0-21swapper/419:20:044
8270991310,2cyclictest0-21swapper/423:32:364
8270991310,2cyclictest0-21swapper/420:31:274
826599138,3cyclictest0-21swapper/300:17:063
826599130,12cyclictest0-21swapper/321:04:133
826399136,6cyclictest1055-13auditd00:00:002
8263991312,1cyclictest0-21swapper/223:45:142
8263991310,2cyclictest1478-21lldpd23:44:072
826399130,12cyclictest0-21swapper/221:42:022
8254991311,1cyclictest0-21swapper/023:03:200
8254991310,2cyclictest1667-21sed19:56:420
825499130,6cyclictest21714-21fschecks_count22:25:110
600352130,5pltrace0-21swapper/123:58:421
2849452130,2pltrace0-21swapper/519:45:055
2787852130,7pltrace28379-21/usr/sbin/munin21:40:111
2787852130,5pltrace0-21swapper/521:40:115
2167252130,0pltrace0-21swapper/723:26:457
2059752130,5pltrace0-21swapper/222:24:392
166652130,2pltrace4190-21chrt19:56:021
1223652130,1pltrace0-21swapper/522:10:165
1161352130,8pltrace0-21swapper/700:07:467
1113752130,2pltrace13894-21chrt21:14:052
1052452130,6pltrace0-21swapper/223:04:392
828299120,11cyclictest0-21swapper/719:19:317
827899128,2cyclictest0-21swapper/600:16:136
827899122,8cyclictest26449-21cut19:40:116
827899120,5cyclictest8089-21expr20:05:126
827899120,5cyclictest336-21/usr/sbin/munin20:50:126
827899120,5cyclictest30887-21expr23:40:126
827899120,5cyclictest27661-21aten_r4power_cu23:35:126
827899120,5cyclictest27478-21cut20:40:126
827899120,5cyclictest23856-21basename22:30:116
827899120,5cyclictest22136-21cut23:25:106
827899120,5cyclictest1178-21runrttasks21:07:236
827899120,5cyclictest1146-21snmpd00:25:566
827899120,5cyclictest11174-21cpuspeed_turbos23:05:126
827899120,4cyclictest10071-21grep22:05:116
827899120,10cyclictest31376-21cut21:45:116
827899120,10cyclictest31376-21cut21:45:116
827399127,3cyclictest0-21swapper/522:06:575
827399126,5cyclictest0-21swapper/500:20:565
827399126,4cyclictest0-21swapper/523:50:155
827399120,1cyclictest0-21swapper/520:36:375
827399120,1cyclictest0-21swapper/500:00:275
827099129,2cyclictest18226-21/usr/sbin/munin22:20:164
827099129,2cyclictest0-21swapper/423:49:594
827099125,2cyclictest1502452pltrace22:15:164
827099123,4cyclictest32683-21hwlatdetect19:50:154
8270991210,1cyclictest0-21swapper/421:15:014
8270991210,1cyclictest0-21swapper/420:45:034
8270991210,1cyclictest0-21swapper/419:35:084
827099120,12cyclictest54-21ksoftirqd/400:39:404
827099120,1cyclictest0-21swapper/421:30:244
826599129,2cyclictest20108-21tune2fs23:20:133
826599129,2cyclictest13589-21grep00:05:203
826599126,5cyclictest0-21swapper/319:37:083
826599126,5cyclictest0-21swapper/319:27:583
826599124,4cyclictest1055-17auditd20:39:593
826599122,8cyclictest0-21swapper/323:06:243
8265991211,1cyclictest0-21swapper/320:59:553
826599120,11cyclictest0-21swapper/323:41:213
826599120,11cyclictest0-21swapper/322:39:053
826399126,5cyclictest0-21swapper/222:25:492
826399123,8cyclictest0-21swapper/222:16:052
826399120,4cyclictest3627-21sshd19:55:192
826399120,12cyclictest0-21swapper/219:47:042
826399120,1cyclictest0-21swapper/222:31:532
826399120,1cyclictest0-21swapper/221:59:582
826399120,1cyclictest0-21swapper/221:05:052
825999127,3cyclictest0-21swapper/120:47:221
825999127,3cyclictest0-21swapper/120:11:121
825999126,5cyclictest0-21swapper/100:39:111
825999120,11cyclictest0-21swapper/119:21:151
825999120,11cyclictest0-21swapper/119:13:221
825499129,2cyclictest1146-21snmpd22:30:180
825499128,3cyclictest3505-21gltestperf22:50:150
8254991211,1cyclictest0-21swapper/022:05:120
8254991211,1cyclictest0-21swapper/020:35:220
825499120,11cyclictest0-21swapper/019:53:550
726452120,8pltrace54-21ksoftirqd/420:06:584
726452120,4pltrace1146-21snmpd20:07:060
553352120,9pltrace78-21ksoftirqd/721:00:297
2833652120,6pltrace0-21swapper/000:36:070
2678352120,5pltrace0-21swapper/020:40:140
2617052120,2pltrace1146-21snmpd22:37:382
2121052120,4pltrace0-21swapper/220:29:432
1997352120,5pltrace0-21swapper/000:23:470
1952152120,7pltrace1-21systemd21:26:197
1780952120,0pltrace0-21swapper/722:22:227
1440052120,5pltrace0-21swapper/100:12:001
1285052120,5pltrace0-21swapper/120:18:491
828299115,5cyclictest0-21swapper/723:11:037
828299115,5cyclictest0-21swapper/700:31:117
828299115,3cyclictest0-21swapper/722:46:497
8282991110,1cyclictest0-21swapper/723:41:317
8282991110,1cyclictest0-21swapper/700:37:127
828299110,11cyclictest0-21swapper/721:11:167
828299110,11cyclictest0-21swapper/720:32:247
828299110,11cyclictest0-21swapper/720:23:197
828299110,11cyclictest0-21swapper/719:50:567
828299110,11cyclictest0-21swapper/700:29:267
828299110,1cyclictest0-21swapper/723:18:217
828299110,1cyclictest0-21swapper/719:47:037
828299110,1cyclictest0-21swapper/700:13:537
827399119,1cyclictest0-21swapper/521:15:105
8273991110,1cyclictest0-21swapper/522:43:535
8273991110,1cyclictest0-21swapper/519:20:135
827399110,11cyclictest0-21swapper/523:37:375
827399110,11cyclictest0-21swapper/523:28:245
827399110,11cyclictest0-21swapper/522:19:365
827399110,11cyclictest0-21swapper/521:30:335
827399110,11cyclictest0-21swapper/520:17:215
827399110,11cyclictest0-21swapper/520:13:475
827399110,1cyclictest0-21swapper/523:30:305
827399110,1cyclictest0-21swapper/522:49:435
827399110,1cyclictest0-21swapper/522:27:515
827399110,1cyclictest0-21swapper/520:31:555
827399110,1cyclictest0-21swapper/519:51:475
827399110,1cyclictest0-21swapper/500:12:265
827099119,2cyclictest0-21swapper/419:56:204
827099117,3cyclictest1146-21snmpd19:49:354
827099117,1cyclictest54-21ksoftirqd/400:02:134
827099116,2cyclictest54-21ksoftirqd/423:29:594
827099116,2cyclictest54-21ksoftirqd/423:00:104
8270991110,1cyclictest0-21swapper/423:53:404
8270991110,1cyclictest0-21swapper/422:52:294
8270991110,1cyclictest0-21swapper/422:07:004
8270991110,1cyclictest0-21swapper/421:46:454
8270991110,1cyclictest0-21swapper/421:46:454
8270991110,1cyclictest0-21swapper/421:29:364
8270991110,1cyclictest0-21swapper/420:23:324
8270991110,1cyclictest0-21swapper/420:17:134
8270991110,1cyclictest0-21swapper/420:13:404
8270991110,1cyclictest0-21swapper/420:01:024
8270991110,1cyclictest0-21swapper/419:28:584
8270991110,1cyclictest0-21swapper/419:13:264
827099110,7cyclictest212852pltrace22:49:354
827099110,11cyclictest0-21swapper/422:27:434
827099110,11cyclictest0-21swapper/421:35:454
827099110,11cyclictest0-21swapper/421:05:384
827099110,11cyclictest0-21swapper/420:57:514
827099110,11cyclictest0-21swapper/420:43:074
827099110,1cyclictest0-21swapper/423:37:294
827099110,1cyclictest0-21swapper/422:59:084
827099110,1cyclictest0-21swapper/422:31:054
827099110,1cyclictest0-21swapper/421:13:244
827099110,1cyclictest0-21swapper/419:43:334
826599118,2cyclictest1478-21lldpd23:36:073
826599116,3cyclictest0-21swapper/323:28:153
8265991110,1cyclictest0-21swapper/323:54:273
8265991110,1cyclictest0-21swapper/320:52:283
8265991110,1cyclictest0-21swapper/320:25:073
8265991110,1cyclictest0-21swapper/319:41:343
826599111,8cyclictest0-21swapper/322:27:403
826599110,11cyclictest0-21swapper/323:15:073
826599110,11cyclictest0-21swapper/323:11:243
826599110,11cyclictest0-21swapper/321:11:243
826599110,11cyclictest0-21swapper/319:50:483
826599110,11cyclictest0-21swapper/300:34:463
826599110,11cyclictest0-21swapper/300:04:003
826599110,1cyclictest0-21swapper/320:40:483
826599110,1cyclictest0-21swapper/300:26:593
826399117,3cyclictest1146-21snmpd22:52:502
826399116,4cyclictest0-21swapper/200:25:462
8263991110,1cyclictest0-21swapper/222:10:022
8263991110,1cyclictest0-21swapper/222:07:072
8263991110,1cyclictest0-21swapper/221:31:482
8263991110,1cyclictest0-21swapper/220:45:022
8263991110,1cyclictest0-21swapper/200:04:392
826399110,9cyclictest0-21swapper/221:24:552
826399110,9cyclictest0-21swapper/219:11:252
826399110,11cyclictest0-21swapper/220:10:322
826399110,11cyclictest0-21swapper/200:08:232
826399110,1cyclictest0-21swapper/223:23:322
826399110,1cyclictest0-21swapper/219:19:522
825999115,5cyclictest0-21swapper/121:30:401
825999112,8cyclictest0-21swapper/122:53:261
8259991110,1cyclictest0-21swapper/123:25:261
8259991110,1cyclictest0-21swapper/123:05:501
8259991110,1cyclictest0-21swapper/119:30:201
8259991110,1cyclictest0-21swapper/119:25:191
8259991110,1cyclictest0-21swapper/100:17:241
8259991110,1cyclictest0-21swapper/100:09:381
825999110,11cyclictest0-21swapper/121:25:071
825999110,11cyclictest0-21swapper/121:24:181
825999110,1cyclictest0-21swapper/122:55:281
825999110,1cyclictest0-21swapper/122:33:551
825999110,1cyclictest0-21swapper/121:56:021
825499119,1cyclictest0-21swapper/019:44:110
825499118,2cyclictest1478-21lldpd21:09:030
825499118,2cyclictest11145-21munin-node22:17:380
825499118,2cyclictest1065-17sedispatch19:31:180
825499118,2cyclictest0-21swapper/020:30:150
8254991110,1cyclictest0-21swapper/023:32:060
8254991110,1cyclictest0-21swapper/023:25:020
8254991110,1cyclictest0-21swapper/000:25:160
825499110,7cyclictest13735-21/usr/sbin/munin19:15:180
825499110,4cyclictest0-21swapper/022:36:220
825499110,11cyclictest0-21swapper/020:11:160
825499110,11cyclictest0-21swapper/019:10:010
825499110,1cyclictest0-21swapper/023:16:370
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional