You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-30 - 11:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Mon Mar 30, 2026 00:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22945521260,117pltrace0-21swapper/119:08:381
20159521070,100pltrace0-21swapper/519:05:145
2015952860,56pltrace0-21swapper/719:05:027
970952850,1pltrace0-21swapper/023:31:430
2015952770,73pltrace0-21swapper/319:05:123
2315126652,10sleep60-21swapper/619:09:366
2312926551,10sleep20-21swapper/219:09:172
2303525945,10sleep00-21swapper/019:07:550
2039725742,10sleep40-21swapper/419:05:014
2085552310,1pltrace0-21swapper/623:51:436
1249652290,4pltrace0-21swapper/723:40:177
925452270,6pltrace78-21ksoftirqd/720:36:427
2256852190,0pltrace0-21swapper/722:57:197
2334799180,1cyclictest0-21swapper/722:20:197
2149452180,0pltrace0-21swapper/722:00:507
1375252180,4pltrace0-21swapper/719:51:367
2538652170,3pltrace0-21swapper/723:01:597
2334099170,3cyclictest2477-21/usr/sbin/munin22:20:195
23317991715,1cyclictest0-21swapper/020:02:020
1249652170,6pltrace1146-21snmpd23:39:061
2334799161,7cyclictest0-21swapper/720:30:007
2334799160,7cyclictest6475-21sort00:25:127
2085552160,0pltrace0-21swapper/723:55:277
198352160,12pltrace54-21ksoftirqd/421:25:224
1761752160,1pltrace0-21swapper/320:53:393
863252150,3pltrace0-21swapper/722:32:157
413452150,11pltrace54-21ksoftirqd/423:25:204
3221852150,10pltrace54-21ksoftirqd/419:25:164
2880952150,0pltrace0-21swapper/721:15:077
2817452150,1pltrace29317-21cstates23:10:117
2771952150,11pltrace54-21ksoftirqd/420:14:184
2580252150,6pltrace54-21ksoftirqd/419:12:184
2580252150,3pltrace26495-21gltestperf19:15:000
2538652150,10pltrace54-21ksoftirqd/423:03:364
2334799157,2cyclictest1146-21snmpd20:45:167
2334799157,2cyclictest1146-21snmpd00:36:247
2334799156,1cyclictest1034552pltrace21:38:297
2334799155,9cyclictest0-21swapper/719:40:137
2334799150,1cyclictest0-21swapper/719:23:407
2333599150,14cyclictest0-21swapper/400:32:014
23331991513,1cyclictest0-21swapper/300:20:173
2333199150,14cyclictest0-21swapper/321:10:023
2333199150,14cyclictest0-21swapper/319:55:153
1807152150,3pltrace20687-21awk23:50:200
1807152150,10pltrace54-21ksoftirqd/423:50:274
1249652150,5pltrace54-21ksoftirqd/423:37:344
755952140,5pltrace54-21ksoftirqd/421:36:274
3221852140,5pltrace54-21ksoftirqd/419:23:514
3096152140,4pltrace54-21ksoftirqd/423:14:364
306052140,5pltrace54-21ksoftirqd/422:25:194
2925752140,12pltrace54-21ksoftirqd/400:06:554
2880952140,5pltrace54-21ksoftirqd/421:12:394
2334799146,2cyclictest20422-21expr20:00:127
2334799146,2cyclictest0-21swapper/721:00:167
2334799145,3cyclictest1146-21snmpd19:37:587
2334799145,2cyclictest1146-21snmpd20:06:527
2334799143,4cyclictest12207-21cut19:45:137
2334799140,8cyclictest17155-21/usr/sbin/munin19:55:177
2334799140,5cyclictest2606-21tee19:26:407
2334799140,4cyclictest31672-21/usr/sbin/munin23:15:127
2334799140,4cyclictest24854-21fschecks_count00:00:117
2334799140,2cyclictest0-21swapper/722:49:577
2334799140,13cyclictest0-21swapper/721:10:137
2334499140,1cyclictest0-21swapper/623:05:206
23340991410,3cyclictest29259-21gltestperf20:15:145
2333599148,2cyclictest1761752pltrace20:55:124
23335991413,1cyclictest0-21swapper/421:23:174
2333599140,13cyclictest0-21swapper/419:35:144
23331991412,1cyclictest0-21swapper/323:10:103
23331991411,2cyclictest0-21swapper/322:25:253
23331991411,2cyclictest0-21swapper/319:27:013
2333199140,13cyclictest0-21swapper/321:25:443
2333199140,13cyclictest0-21swapper/321:07:363
2333199140,1cyclictest0-21swapper/320:35:233
23326991413,1cyclictest0-21swapper/221:20:112
23326991411,2cyclictest0-21swapper/200:30:172
2332699140,14cyclictest0-21swapper/223:01:432
2332699140,14cyclictest0-21swapper/222:00:112
2332699140,1cyclictest0-21swapper/220:10:162
23323991411,2cyclictest1146-21snmpd19:45:201
23323991411,2cyclictest0-21swapper/122:55:191
23323991411,2cyclictest0-21swapper/121:22:581
2331799140,14cyclictest0-21swapper/022:25:130
1204152140,7pltrace0-21swapper/020:42:360
692152130,6pltrace0-21swapper/123:27:431
521752130,1pltrace1178-21runrttasks00:25:325
3204352130,3pltrace0-21swapper/000:13:410
3096152130,4pltrace0-21swapper/623:15:586
3096152130,2pltrace32126-21diskstats23:15:125
2771952130,0pltrace0-21swapper/720:12:597
2647452130,5pltrace0-21swapper/300:01:523
2580252130,8pltrace54-21ksoftirqd/419:15:024
2431152130,1pltrace0-21swapper/022:02:590
2334799134,4cyclictest17274-21grep21:50:147
2334799134,1cyclictest2580252pltrace19:15:177
2334799133,5cyclictest0-21swapper/722:10:527
2334799133,5cyclictest0-21swapper/722:10:527
2334799131,5cyclictest2410-21date21:25:017
2334799130,6cyclictest0-21swapper/720:42:407
2334799130,5cyclictest1146-21snmpd00:11:167
2334799130,13cyclictest0-21swapper/720:30:247
2334499139,3cyclictest1146-21snmpd20:05:406
23344991312,1cyclictest0-21swapper/623:30:176
23344991312,1cyclictest0-21swapper/623:10:226
2334499130,1cyclictest198352pltrace21:23:416
23340991312,1cyclictest0-21swapper/519:16:055
23340991312,1cyclictest0-21swapper/519:10:155
23340991310,2cyclictest28301-21sed00:05:175
23340991310,2cyclictest28018-21sed23:05:205
23340991310,2cyclictest1146-21snmpd21:22:595
23340991310,2cyclictest0-21swapper/519:45:195
2333599130,1cyclictest0-21swapper/423:30:194
23331991311,1cyclictest0-21swapper/323:05:093
2333199130,13cyclictest0-21swapper/319:12:403
2333199130,12cyclictest0-21swapper/320:45:153
2333199130,12cyclictest0-21swapper/319:41:393
23326991312,1cyclictest0-21swapper/219:56:402
23326991312,1cyclictest0-21swapper/200:17:582
2332699130,13cyclictest0-21swapper/223:09:392
2332699130,13cyclictest0-21swapper/221:55:392
23323991312,1cyclictest0-21swapper/123:40:191
2331799130,12cyclictest0-21swapper/022:41:450
2331799130,12cyclictest0-21swapper/020:23:290
2321052130,8pltrace78-21ksoftirqd/721:05:127
2149452130,3pltrace22569-21cat22:00:125
2149452130,0pltrace0-21swapper/721:57:127
198352130,7pltrace1146-21snmpd21:25:431
198352130,6pltrace0-21swapper/021:25:430
1978452130,0pltrace0-21swapper/722:52:197
1761752130,7pltrace0-21swapper/620:52:036
1654152130,5pltrace54-21ksoftirqd/419:52:534
1654152130,5pltrace0-21swapper/119:54:461
1482752130,5pltrace54-21ksoftirqd/420:50:004
1141852130,4pltrace12312-21cpuspeed_turbos22:40:132
755952120,10pltrace0-21swapper/321:35:143
539152120,9pltrace1146-21snmpd19:34:035
3096152120,6pltrace0-21swapper/123:15:571
2880952120,4pltrace0-21swapper/621:14:536
260452120,5pltrace0-21swapper/519:27:555
260452120,3pltrace0-21swapper/019:27:450
2538652120,3pltrace25496-21chrt23:03:123
2492852120,3pltrace25894-21cstates20:10:141
2492852120,2pltrace0-21swapper/320:06:503
2334799128,1cyclictest0-21swapper/722:39:157
2334799126,3cyclictest1681-21awk00:15:197
2334799123,4cyclictest28558-21cat00:05:187
2334799120,6cyclictest0-21swapper/722:27:357
2334799120,4cyclictest0-21swapper/700:24:597
2334499129,2cyclictest28937-21fschecks_count20:15:136
2334499129,2cyclictest28709-21cat22:10:146
2334499129,2cyclictest28709-21cat22:10:146
2334499129,2cyclictest20669-21grep20:00:136
2334499129,2cyclictest14828-21sed20:46:426
2334499128,3cyclictest1146-21snmpd19:13:336
23344991210,1cyclictest0-21swapper/623:46:396
2334099128,2cyclictest0-21swapper/521:44:045
2334099120,11cyclictest0-21swapper/521:08:175
2334099120,1cyclictest0-21swapper/521:26:545
2333599129,2cyclictest1146-21snmpd21:47:274
2333599124,5cyclictest54-21ksoftirqd/423:50:004
2333599120,11cyclictest0-21swapper/419:59:404
2333599120,1cyclictest0-21swapper/422:17:384
23331991211,1cyclictest0-21swapper/322:20:193
23331991211,1cyclictest0-21swapper/320:10:283
23331991210,1cyclictest0-21swapper/319:53:323
2333199120,12cyclictest0-21swapper/322:14:063
2333199120,12cyclictest0-21swapper/322:14:063
2333199120,12cyclictest0-21swapper/300:37:073
2333199120,11cyclictest0-21swapper/300:12:503
2333199120,11cyclictest0-21swapper/300:06:123
2333199120,1cyclictest0-21swapper/322:53:013
2332699129,2cyclictest10025-21cpu20:40:112
23326991211,1cyclictest0-21swapper/223:29:042
23326991211,1cyclictest0-21swapper/223:17:052
23326991211,1cyclictest0-21swapper/219:46:182
23326991211,1cyclictest0-21swapper/219:20:242
23326991211,1cyclictest0-21swapper/200:10:312
23326991211,1cyclictest0-21swapper/200:06:472
2332699120,12cyclictest0-21swapper/222:24:482
2332699120,12cyclictest0-21swapper/222:10:532
2332699120,12cyclictest0-21swapper/222:10:532
2332699120,12cyclictest0-21swapper/220:19:592
2332699120,12cyclictest0-21swapper/219:38:412
2332699120,1cyclictest0-21swapper/223:40:342
2332699120,1cyclictest0-21swapper/223:34:252
2332399129,2cyclictest1478-21lldpd21:44:031
2332399128,3cyclictest1146-21snmpd22:20:371
2332399120,11cyclictest0-21swapper/122:00:051
2331799129,2cyclictest5460-21crond00:24:590
23317991211,1cyclictest0-21swapper/023:41:380
23317991211,1cyclictest0-21swapper/000:19:120
2331799120,12cyclictest0-21swapper/020:30:070
2331799120,12cyclictest0-21swapper/019:44:560
2331799120,11cyclictest0-21swapper/021:20:470
2331799120,11cyclictest0-21swapper/021:02:100
2331799120,11cyclictest0-21swapper/020:06:190
2331799120,1cyclictest0-21swapper/023:08:080
2294552120,5pltrace0-21swapper/119:11:391
2213152120,9pltrace54-21ksoftirqd/420:04:034
1699452120,5pltrace54-21ksoftirqd/422:49:164
1592052120,4pltrace0-21swapper/521:51:015
1592052120,2pltrace18606-21taskset21:50:312
1357952120,8pltrace13587-21taskset00:36:455
1249652120,7pltrace13116-21/usr/sbin/munin23:40:153
1249652120,5pltrace0-21swapper/523:39:105
1204152120,5pltrace0-21swapper/520:42:365
1141852120,5pltrace54-21ksoftirqd/422:37:014
1141852120,1pltrace0-21swapper/122:38:041
1096552120,4pltrace0-21swapper/519:42:465
863252110,7pltrace11291-21vmstat22:35:215
800252110,0pltrace0-21swapper/100:28:141
306052110,1pltrace0-21swapper/222:26:292
2880952110,4pltrace0-21swapper/021:14:470
2771952110,6pltrace0-21swapper/020:14:240
2538652110,5pltrace0-21swapper/123:03:431
2334799118,2cyclictest25249-21cut22:05:117
2334799118,2cyclictest25249-21cut22:05:117
2334799110,9cyclictest0-21swapper/720:20:007
2334799110,11cyclictest0-21swapper/723:49:137
2334799110,11cyclictest0-21swapper/722:41:227
2334799110,11cyclictest0-21swapper/722:15:477
2334799110,11cyclictest0-21swapper/721:46:007
2334799110,11cyclictest0-21swapper/719:10:247
2334799110,1cyclictest0-21swapper/723:23:387
2334799110,1cyclictest0-21swapper/720:23:457
2334799110,1cyclictest0-21swapper/719:32:157
2334499119,1cyclictest0-21swapper/622:17:056
2334499119,1cyclictest0-21swapper/600:16:066
2334499118,2cyclictest5549-21tune2fs23:25:136
2334499118,2cyclictest31680-21sed00:10:226
2334499118,2cyclictest27987-21grep19:15:136
2334499118,2cyclictest23300-21cat23:55:216
2334499118,2cyclictest11245-21cpuspeed_turbos21:40:126
2334499118,2cyclictest0-21swapper/622:47:186
2334499115,5cyclictest26168-21missed_timers22:05:166
2334499115,5cyclictest26168-21missed_timers22:05:156
2334499114,4cyclictest0-21swapper/622:50:156
23344991110,1cyclictest0-21swapper/622:34:446
23344991110,1cyclictest0-21swapper/621:05:036
23344991110,1cyclictest0-21swapper/619:26:176
23344991110,1cyclictest0-21swapper/600:06:336
2334499110,11cyclictest0-21swapper/621:31:076
2334499110,11cyclictest0-21swapper/620:28:566
2334499110,11cyclictest0-21swapper/620:22:186
2334499110,11cyclictest0-21swapper/619:58:306
2334499110,11cyclictest0-21swapper/619:54:566
2334499110,11cyclictest0-21swapper/619:47:206
2334499110,11cyclictest0-21swapper/600:28:046
2334499110,10cyclictest0-21swapper/623:22:506
2334499110,10cyclictest0-21swapper/620:37:326
2334499110,1cyclictest0-21swapper/623:43:056
2334499110,1cyclictest0-21swapper/623:38:336
2334499110,1cyclictest0-21swapper/622:27:466
2334499110,1cyclictest0-21swapper/600:37:576
2334499110,1cyclictest0-21swapper/600:02:506
23340991110,1cyclictest0-21swapper/520:53:125
23340991110,1cyclictest0-21swapper/520:46:055
23340991110,1cyclictest0-21swapper/520:21:095
23340991110,1cyclictest0-21swapper/500:19:395
2334099110,11cyclictest0-21swapper/523:58:075
2334099110,11cyclictest0-21swapper/523:11:285
2334099110,11cyclictest0-21swapper/500:13:015
2334099110,11cyclictest0-21swapper/500:03:285
2334099110,1cyclictest0-21swapper/520:27:475
2334099110,1cyclictest0-21swapper/520:12:345
2334099110,1cyclictest0-21swapper/519:53:475
2334099110,1cyclictest0-21swapper/500:23:225
2333599118,2cyclictest1474-21lldpd20:30:324
2333599115,2cyclictest2040052pltrace21:00:144
2333599113,5cyclictest54-21ksoftirqd/422:00:014
23335991110,1cyclictest0-21swapper/423:40:224
23335991110,1cyclictest0-21swapper/423:20:554
23335991110,1cyclictest0-21swapper/421:05:054
23335991110,1cyclictest0-21swapper/400:27:294
2333599110,6cyclictest18711-21sed21:51:424
2333599110,1cyclictest0-21swapper/422:13:064
2333599110,1cyclictest0-21swapper/422:13:064
2333599110,1cyclictest0-21swapper/422:04:504
2333599110,1cyclictest0-21swapper/421:42:004
2333199117,3cyclictest1146-21snmpd20:02:293
2333199112,8cyclictest0-21swapper/321:33:253
2333199112,8cyclictest0-21swapper/300:17:093
23331991110,1cyclictest0-21swapper/323:38:393
23331991110,1cyclictest0-21swapper/322:40:043
23331991110,1cyclictest0-21swapper/321:56:023
23331991110,1cyclictest0-21swapper/320:16:183
23331991110,1cyclictest0-21swapper/300:25:383
2333199110,11cyclictest0-21swapper/323:49:213
2333199110,11cyclictest0-21swapper/323:33:193
2333199110,11cyclictest0-21swapper/323:20:313
2333199110,11cyclictest0-21swapper/323:16:483
2333199110,11cyclictest0-21swapper/322:04:173
2333199110,11cyclictest0-21swapper/321:03:333
2333199110,11cyclictest0-21swapper/320:22:553
2333199110,11cyclictest0-21swapper/319:20:073
2333199110,1cyclictest0-21swapper/323:27:583
2333199110,1cyclictest0-21swapper/322:19:303
2333199110,1cyclictest0-21swapper/320:41:133
2332699118,2cyclictest6990-21smart_sda21:30:202
2332699118,2cyclictest32228-21irqstats_TLB20:20:162
2332699118,1cyclictest191rcu_preempt19:26:312
23326991110,1cyclictest0-21swapper/223:35:132
23326991110,1cyclictest0-21swapper/223:24:322
23326991110,1cyclictest0-21swapper/223:13:232
23326991110,1cyclictest0-21swapper/222:17:512
23326991110,1cyclictest0-21swapper/220:47:102
23326991110,1cyclictest0-21swapper/219:15:522
23326991110,1cyclictest0-21swapper/200:37:152
23326991110,1cyclictest0-21swapper/200:02:152
2332699110,11cyclictest0-21swapper/223:47:312
2332699110,11cyclictest0-21swapper/222:56:422
2332699110,11cyclictest0-21swapper/222:45:512
2332699110,11cyclictest0-21swapper/221:40:452
2332699110,11cyclictest0-21swapper/219:52:172
2332399119,1cyclictest0-21swapper/120:20:031
2332399118,2cyclictest0-21swapper/100:30:091
2332399117,3cyclictest1146-21snmpd22:28:431
23323991110,1cyclictest0-21swapper/122:14:591
23323991110,1cyclictest0-21swapper/122:14:591
23323991110,1cyclictest0-21swapper/121:50:321
23323991110,1cyclictest0-21swapper/120:45:281
23323991110,1cyclictest0-21swapper/120:32:111
23323991110,1cyclictest0-21swapper/119:59:191
23323991110,1cyclictest0-21swapper/119:29:321
23323991110,1cyclictest0-21swapper/100:16:441
2332399110,11cyclictest0-21swapper/123:53:061
2332399110,11cyclictest0-21swapper/123:48:341
2332399110,11cyclictest0-21swapper/122:41:531
2332399110,11cyclictest0-21swapper/121:01:101
2332399110,11cyclictest0-21swapper/120:38:501
2332399110,11cyclictest0-21swapper/120:04:011
2332399110,1cyclictest0-21swapper/123:32:031
2332399110,1cyclictest0-21swapper/122:34:451
2332399110,1cyclictest0-21swapper/121:38:531
2332399110,1cyclictest0-21swapper/119:18:501
2332399110,1cyclictest0-21swapper/100:02:101
2331799119,1cyclictest0-21swapper/019:51:450
2331799118,2cyclictest12119-21fschecks_time00:35:130
2331799118,2cyclictest1146-21snmpd21:52:230
2331799118,2cyclictest1146-21snmpd21:42:320
23317991110,1cyclictest0-21swapper/022:05:280
23317991110,1cyclictest0-21swapper/022:05:280
2331799110,11cyclictest0-21swapper/023:13:580
2331799110,11cyclictest0-21swapper/023:03:070
2331799110,11cyclictest0-21swapper/019:20:580
2331799110,11cyclictest0-21swapper/000:34:250
2331799110,1cyclictest0-21swapper/021:46:500
2331799110,1cyclictest0-21swapper/021:37:170
2331799110,1cyclictest0-21swapper/020:16:500
2331799110,1cyclictest0-21swapper/000:29:040
2040052110,1pltrace20643-21latency_hist21:00:010
1761752110,1pltrace0-21swapper/220:52:012
1204152110,7pltrace54-21ksoftirqd/420:43:114
3050352100,3pltrace1141-21polkitd20:20:001
2431152100,6pltrace54-21ksoftirqd/422:05:174
2431152100,6pltrace54-21ksoftirqd/422:05:174
2334799109,1cyclictest0-21swapper/721:31:267
2334799107,2cyclictest0-21swapper/723:31:437
2334799106,3cyclictest12295-21unixbench_multi23:35:227
2334799104,5cyclictest0-21swapper/723:50:117
2334799100,7cyclictest11203-21tr21:40:127
2334799100,5cyclictest10796-21tail00:31:427
2334799100,3cyclictest28416-21crond23:10:017
2334799100,10cyclictest0-21swapper/723:27:227
2334499109,1cyclictest0-21swapper/622:00:356
2334499109,1cyclictest0-21swapper/621:46:306
2334499109,1cyclictest0-21swapper/621:15:356
2334499108,1cyclictest4669-21awk19:30:156
2334499108,1cyclictest22481-21sshd22:55:446
2334499108,1cyclictest10434-21switchtime19:40:226
2334499107,2cyclictest4729-21expr20:30:136
2334499107,2cyclictest23373-21cat23:00:096
2334499107,2cyclictest19326-21/usr/sbin/munin21:55:206
2334499107,2cyclictest1146-21snmpd22:22:216
2334499107,2cyclictest10643-21unixbench_singl00:30:226
2334499107,2cyclictest0-21swapper/620:40:136
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional