You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-22 - 02:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Wed Apr 22, 2026 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18620521450,90pltrace0-21swapper/719:05:227
18620521190,93pltrace0-21swapper/519:05:125
18620521160,102pltrace0-21swapper/319:05:183
1862052990,90pltrace0-21swapper/119:05:121
1862052990,83pltrace0-21swapper/619:05:156
2140952950,87pltrace0-21swapper/219:10:012
194282630,0sleep70-21swapper/721:00:007
2149525844,10sleep00-21swapper/019:07:370
1925525743,10sleep40-21swapper/419:05:094
2186699412,7cyclictest1302-21kworker/u16:0+xprtiod@
xs_stream_data_receive_workfn
00:11:453
2185499380,1cyclictest0-21swapper/022:50:050
101952330,0pltrace0-21swapper/719:30:227
2772452300,0pltrace0-21swapper/700:10:237
2426652290,1pltrace0-21swapper/519:11:275
323252280,1pltrace3236-21pltrace-run21:26:273
2834852270,1pltrace28352-21pltrace-run22:11:277
21880992624,1cyclictest0-21swapper/622:50:056
3006052210,6pltrace0-21swapper/721:20:147
2772452210,8pltrace0-21swapper/700:09:107
2727352210,15pltrace27294-21chrt21:11:401
2103252210,0pltrace0-21swapper/723:00:217
926152190,3pltrace9692-21sed00:35:007
2186699190,1cyclictest0-21swapper/323:10:083
21854991910,8cyclictest0-21swapper/023:56:360
2185499190,5cyclictest0-21swapper/020:11:300
942852180,0pltrace0-21swapper/719:45:117
2188099183,7cyclictest191rcu_preempt19:35:366
2185499188,4cyclictest15-21ksoftirqd/019:40:200
2185499180,3cyclictest0-21swapper/023:33:480
1437752180,4pltrace0-21swapper/721:49:537
1437752180,4pltrace0-21swapper/721:49:527
647452170,4pltrace0-21swapper/700:27:057
2188299172,8cyclictest0-21swapper/721:28:307
2188099170,16cyclictest24890-21sshd00:01:046
2187599171,8cyclictest0-21swapper/520:38:275
2187599171,15cyclictest0-21swapper/520:31:215
21871991711,5cyclictest0-21swapper/419:43:264
2186699174,12cyclictest0-21swapper/323:44:343
2186699171,8cyclictest0-21swapper/300:19:323
2186699171,4cyclictest0-21swapper/319:22:103
2186699171,15cyclictest0-21swapper/319:18:433
2186699170,16cyclictest0-21swapper/323:17:263
2186699170,11cyclictest7588-21sed20:35:233
21863991714,2cyclictest0-21swapper/219:41:382
2186399171,15cyclictest0-21swapper/223:01:202
2186399171,15cyclictest0-21swapper/219:20:012
2185499179,4cyclictest15-21ksoftirqd/022:05:230
2185499179,4cyclictest15-21ksoftirqd/000:35:240
2185499173,7cyclictest0-21swapper/022:38:110
1886552170,12pltrace0-21swapper/521:00:185
1824552170,0pltrace0-21swapper/722:52:187
880552160,3pltrace0-21swapper/721:37:557
880552160,3pltrace0-21swapper/721:37:557
369152160,2pltrace0-21swapper/200:24:442
21882991610,5cyclictest0-21swapper/721:30:027
2188299160,4cyclictest0-21swapper/721:57:327
21880991610,5cyclictest0-21swapper/623:46:406
2187599161,8cyclictest0-21swapper/522:54:085
2187599161,7cyclictest0-21swapper/520:10:535
2187599161,4cyclictest0-21swapper/521:13:305
2187599161,14cyclictest0-21swapper/522:33:495
2187599161,14cyclictest0-21swapper/520:27:395
2187599160,15cyclictest0-21swapper/522:25:405
2187199161,4cyclictest0-21swapper/422:21:314
2186699164,5cyclictest0-21swapper/320:30:203
21866991611,3cyclictest0-21swapper/322:31:583
21866991611,3cyclictest0-21swapper/320:11:063
21866991610,5cyclictest0-21swapper/323:06:063
2186699161,8cyclictest0-21swapper/319:50:203
2186699161,4cyclictest0-21swapper/300:34:383
2186699161,14cyclictest0-21swapper/320:45:483
2186699161,14cyclictest0-21swapper/300:08:253
21863991611,3cyclictest0-21swapper/200:20:002
2186399161,8cyclictest0-21swapper/220:41:032
21858991611,2cyclictest0-21swapper/123:57:061
21858991610,5cyclictest0-21swapper/121:22:111
21858991610,3cyclictest0-21swapper/122:44:381
2185899160,8cyclictest0-21swapper/121:25:311
2185899160,15cyclictest0-21swapper/122:22:011
2185499169,5cyclictest15-21ksoftirqd/022:45:110
2185499169,5cyclictest15-21ksoftirqd/000:30:100
2185499169,4cyclictest15-21ksoftirqd/022:25:130
2185499168,4cyclictest15-21ksoftirqd/022:30:110
2185499168,4cyclictest15-21ksoftirqd/021:45:180
2185499168,4cyclictest15-21ksoftirqd/021:45:180
2185499168,4cyclictest15-21ksoftirqd/020:45:200
2185499168,4cyclictest15-21ksoftirqd/019:30:130
2185499167,5cyclictest15-21ksoftirqd/023:10:200
2185499167,5cyclictest15-21ksoftirqd/023:05:170
2185499167,5cyclictest15-21ksoftirqd/022:40:170
2185499167,5cyclictest15-21ksoftirqd/021:30:210
2185499165,7cyclictest15-21ksoftirqd/020:30:120
21854991613,2cyclictest30688-21taskset00:13:520
21854991611,1cyclictest191rcu_preempt00:00:130
21854991610,5cyclictest0-21swapper/021:40:050
21854991610,5cyclictest0-21swapper/021:20:410
21854991610,2cyclictest15-21ksoftirqd/020:55:190
21854991610,2cyclictest15-21ksoftirqd/020:50:180
21854991610,2cyclictest15-21ksoftirqd/019:35:120
21854991610,2cyclictest15-21ksoftirqd/019:10:180
21854991610,1cyclictest191rcu_preempt00:27:370
2185499160,15cyclictest0-21swapper/000:17:050
2059852160,1pltrace21646-21cstates20:05:147
2188299150,4cyclictest0-21swapper/700:15:357
2188299150,14cyclictest0-21swapper/722:15:377
2188299150,14cyclictest0-21swapper/719:43:117
2188299150,13cyclictest0-21swapper/719:15:227
2188099151,3cyclictest0-21swapper/623:22:246
2188099150,8cyclictest0-21swapper/600:39:356
2188099150,14cyclictest0-21swapper/623:04:246
2188099150,14cyclictest0-21swapper/621:39:246
2188099150,14cyclictest0-21swapper/621:39:246
2188099150,14cyclictest0-21swapper/600:13:016
21875991510,3cyclictest0-21swapper/523:55:585
21875991510,3cyclictest0-21swapper/522:23:255
2187599151,3cyclictest0-21swapper/500:16:565
2187599150,8cyclictest0-21swapper/500:32:055
2187599150,8cyclictest0-21swapper/500:08:585
2187599150,14cyclictest0-21swapper/520:47:315
2187599150,14cyclictest0-21swapper/520:08:585
2187199150,14cyclictest0-21swapper/422:14:494
2187199150,14cyclictest0-21swapper/421:49:124
2187199150,14cyclictest0-21swapper/421:49:124
2187199150,14cyclictest0-21swapper/421:38:324
2187199150,14cyclictest0-21swapper/421:38:324
2187199150,14cyclictest0-21swapper/419:12:554
2186699156,8cyclictest1146-21snmpd21:10:533
21866991510,4cyclictest0-21swapper/321:45:193
21866991510,4cyclictest0-21swapper/321:45:193
2186699151,7cyclictest0-21swapper/321:04:393
2186699150,7cyclictest0-21swapper/321:20:353
2186699150,6cyclictest15014-21/usr/sbin/munin21:50:203
2186699150,6cyclictest15014-21/usr/sbin/munin21:50:203
2186699150,14cyclictest0-21swapper/323:55:093
2186699150,14cyclictest0-21swapper/323:45:073
2186699150,14cyclictest0-21swapper/323:04:483
2186699150,14cyclictest0-21swapper/321:31:323
2186699150,14cyclictest0-21swapper/321:16:293
2186699150,13cyclictest23285-21head21:05:153
2186699150,11cyclictest0-21swapper/319:41:373
2186699150,1cyclictest0-21swapper/320:19:013
2186699150,1cyclictest0-21swapper/319:32:253
2186399151,13cyclictest0-21swapper/200:40:002
2186399150,8cyclictest0-21swapper/222:09:342
2186399150,4cyclictest0-21swapper/222:47:032
2186399150,14cyclictest0-21swapper/223:38:162
2186399150,13cyclictest0-21swapper/200:03:052
2185899150,8cyclictest0-21swapper/122:05:241
2185899150,8cyclictest0-21swapper/121:06:281
2185499158,4cyclictest15-21ksoftirqd/022:20:130
2185499158,4cyclictest15-21ksoftirqd/019:55:120
2185499158,2cyclictest15-21ksoftirqd/021:55:120
2185499156,5cyclictest15-21ksoftirqd/023:35:220
2185499156,5cyclictest15-21ksoftirqd/021:05:120
2185499155,6cyclictest15-21ksoftirqd/020:20:140
21854991512,2cyclictest13557-21fschecks_time19:50:140
21854991510,2cyclictest15-21ksoftirqd/019:45:150
21854991510,2cyclictest15-21ksoftirqd/000:20:120
2185499150,8cyclictest0-21swapper/000:08:070
2185499150,14cyclictest0-21swapper/020:25:180
2185499150,14cyclictest0-21swapper/020:02:410
1653352150,11pltrace54-21ksoftirqd/423:49:374
2789452140,0pltrace0-21swapper/719:20:127
2188299140,1cyclictest0-21swapper/721:10:067
2188099149,3cyclictest0-21swapper/621:47:456
2188099149,3cyclictest0-21swapper/621:47:456
2188099140,3cyclictest0-21swapper/623:58:376
2188099140,14cyclictest0-21swapper/622:05:206
2188099140,14cyclictest0-21swapper/621:20:206
2188099140,13cyclictest0-21swapper/619:50:566
2187599149,3cyclictest0-21swapper/519:20:585
21875991412,1cyclictest0-21swapper/520:21:295
2187599140,7cyclictest0-21swapper/521:21:265
2187599140,13cyclictest0-21swapper/519:30:195
2187199147,6cyclictest1478-21lldpd23:05:044
21871991412,1cyclictest0-21swapper/422:53:054
2186699143,9cyclictest29879-21tr20:20:123
2186699142,10cyclictest13644-21expr22:45:123
21866991410,3cyclictest1064-13audispd19:30:013
21866991410,3cyclictest0-21swapper/322:11:253
21866991410,3cyclictest0-21swapper/320:43:363
2186699140,13cyclictest0-21swapper/323:55:003
2186399149,3cyclictest0-21swapper/200:30:052
2186399149,2cyclictest0-21swapper/219:13:462
2186399148,5cyclictest0-21swapper/220:49:462
2186399140,1cyclictest0-21swapper/223:20:182
2185899143,9cyclictest0-21swapper/121:39:031
2185899143,9cyclictest0-21swapper/121:39:021
21858991411,2cyclictest0-21swapper/123:30:131
2185899140,13cyclictest0-21swapper/120:33:271
2185499148,2cyclictest15-21ksoftirqd/023:25:000
2185499148,2cyclictest15-21ksoftirqd/021:10:140
2185499146,5cyclictest15-21ksoftirqd/023:15:130
2185499146,4cyclictest15-21ksoftirqd/021:40:010
2185499146,4cyclictest15-21ksoftirqd/021:40:010
2185499146,4cyclictest15-21ksoftirqd/019:20:200
2185499145,5cyclictest15-21ksoftirqd/023:45:120
2185499145,5cyclictest15-21ksoftirqd/021:17:530
2185499144,6cyclictest15-21ksoftirqd/022:55:220
21854991411,2cyclictest21870-21grep20:05:150
21854991411,2cyclictest11835-21cut23:40:130
1886552140,4pltrace0-21swapper/221:00:002
1886552140,3pltrace20769-21sed21:00:161
1716852140,6pltrace19873-21taskset21:55:351
1716852140,5pltrace0-21swapper/521:55:175
771552130,5pltrace0-21swapper/220:39:102
709552130,5pltrace1055-17auditd22:36:042
3113452130,3pltrace1022-21switchtime22:20:227
2188299138,3cyclictest0-21swapper/723:31:187
2188299130,13cyclictest0-21swapper/721:50:257
2188299130,13cyclictest0-21swapper/721:50:257
2188299130,12cyclictest0-21swapper/722:25:227
2188299130,12cyclictest0-21swapper/720:30:187
2188299130,12cyclictest0-21swapper/720:03:277
2188299130,1cyclictest0-21swapper/723:15:057
2188099139,3cyclictest0-21swapper/619:48:056
2188099138,3cyclictest0-21swapper/621:58:336
2188099137,3cyclictest0-21swapper/623:53:556
2188099137,3cyclictest0-21swapper/621:19:446
2188099131,5cyclictest0-21swapper/600:09:356
2188099130,12cyclictest0-21swapper/621:03:016
2188099130,12cyclictest0-21swapper/620:01:386
2187599133,8cyclictest0-21swapper/521:08:585
2187599131,9cyclictest5266-21sed00:25:145
2187599130,12cyclictest0-21swapper/519:54:055
2187199138,3cyclictest0-21swapper/421:12:594
2187199138,3cyclictest0-21swapper/420:23:544
2187199138,2cyclictest0-21swapper/422:19:254
2187199131,11cyclictest0-21swapper/423:00:314
2187199130,6cyclictest0-21swapper/419:49:584
2187199130,12cyclictest0-21swapper/421:50:024
2187199130,12cyclictest0-21swapper/421:50:024
2186699138,4cyclictest0-21swapper/323:29:153
2186699137,5cyclictest0-21swapper/322:43:033
2186699133,8cyclictest30074-21sh22:15:153
2186699132,9cyclictest3554-21unixbench_singl00:20:213
2186699132,9cyclictest17206-21expr20:55:123
2186699132,10cyclictest8462-21sed21:35:223
2186699132,10cyclictest8462-21sed21:35:223
21866991312,1cyclictest0-21swapper/320:50:153
2186699131,10cyclictest20672-21wget22:00:123
2186699130,5cyclictest643-21grep20:25:143
2186699130,5cyclictest30569-21chrt00:12:093
2186699130,5cyclictest12154-21chrt19:45:533
2186699130,5cyclictest11105-21switchtime21:40:213
2186699130,4cyclictest2672-21chrt23:22:263
2186699130,12cyclictest0-21swapper/300:05:003
21863991310,2cyclictest0-21swapper/220:12:272
2186399130,2cyclictest0-21swapper/223:48:312
2186399130,12cyclictest0-21swapper/223:17:272
2185899138,3cyclictest0-21swapper/119:19:551
2185899136,6cyclictest0-21swapper/123:25:001
21858991310,2cyclictest0-21swapper/119:50:211
2185899130,12cyclictest7973-21crond20:40:001
2185899130,12cyclictest0-21swapper/121:42:011
2185899130,12cyclictest0-21swapper/121:15:301
2185899130,12cyclictest0-21swapper/119:26:571
2185499136,4cyclictest15-21ksoftirqd/023:00:130
2185499135,4cyclictest15-21ksoftirqd/023:25:150
21854991310,2cyclictest6791-21sed20:35:170
21854991310,2cyclictest28763-21unixbench_multi20:15:220
21854991310,2cyclictest21230-21fschecks_count22:00:140
21854991310,2cyclictest19389-21taskset23:52:200
21854991310,2cyclictest1293-21grep21:25:120
2185499131,11cyclictest0-21swapper/019:28:070
214352130,1pltrace0-21swapper/720:29:287
37952120,4pltrace0-21swapper/221:22:592
2897052120,4pltrace0-21swapper/720:19:417
260052120,8pltrace54-21ksoftirqd/423:24:474
2188299129,2cyclictest23860-21iostat_ios00:00:167
2188299129,2cyclictest0-21swapper/719:15:017
2188299120,12cyclictest0-21swapper/722:36:337
2188299120,11cyclictest0-21swapper/719:58:577
2188299120,1cyclictest0-21swapper/719:50:207
2188099129,2cyclictest1146-21snmpd22:25:016
2188099128,3cyclictest0-21swapper/619:17:406
2188099126,5cyclictest0-21swapper/623:30:066
2188099126,5cyclictest0-21swapper/622:15:346
2188099126,5cyclictest0-21swapper/621:13:536
2188099126,5cyclictest0-21swapper/620:50:376
2188099126,3cyclictest0-21swapper/621:53:026
2188099126,3cyclictest0-21swapper/621:53:026
2188099125,1cyclictest191rcu_preempt20:21:246
21880991210,1cyclictest0-21swapper/622:00:096
2188099120,6cyclictest0-21swapper/619:22:046
2188099120,12cyclictest0-21swapper/619:34:566
2187599128,3cyclictest0-21swapper/523:20:005
2187599127,4cyclictest0-21swapper/520:56:495
2187599126,5cyclictest0-21swapper/520:42:375
2187599126,5cyclictest0-21swapper/500:21:505
21875991210,1cyclictest0-21swapper/519:45:235
2187599120,11cyclictest0-21swapper/523:30:545
2187599120,11cyclictest0-21swapper/522:01:095
2187599120,11cyclictest0-21swapper/521:35:095
2187599120,11cyclictest0-21swapper/521:35:095
2187199129,2cyclictest0-21swapper/421:05:014
2187199128,3cyclictest0-21swapper/420:57:464
2187199127,4cyclictest0-21swapper/421:19:174
2187199127,3cyclictest0-21swapper/423:53:464
2187199127,3cyclictest0-21swapper/423:15:454
21871991210,1cyclictest0-21swapper/420:10:034
2187199120,12cyclictest0-21swapper/420:15:214
2186699123,7cyclictest20307-21cat22:55:193
2186699122,9cyclictest15941-21tr19:55:123
2186699122,9cyclictest1478-21lldpd23:30:043
2186699122,8cyclictest4432-21tr00:25:113
21866991211,1cyclictest0-21swapper/320:00:043
2186699120,5cyclictest8309-21cut22:35:143
2186699120,5cyclictest4650-21cpuspeed_turbos19:35:133
2186699120,5cyclictest32271-21expr22:20:133
2186699120,5cyclictest23976-21uniq22:05:153
2186699120,5cyclictest22416-21cut19:10:113
2186699120,5cyclictest21888-21fschecks_count20:05:153
2186699120,5cyclictest10286-21pluginstate23:35:193
2186699120,4cyclictest17825-21cut21:55:123
2186699120,4cyclictest1146-21snmpd22:27:523
2186399128,3cyclictest0-21swapper/220:05:282
2186399126,5cyclictest0-21swapper/220:04:232
2186399125,6cyclictest0-21swapper/221:14:592
21863991211,1cyclictest0-21swapper/223:40:132
21863991211,1cyclictest0-21swapper/200:10:202
2185899127,2cyclictest0-21swapper/120:28:151
2185899126,3cyclictest0-21swapper/100:31:081
2185899123,8cyclictest0-21swapper/121:32:301
21858991211,1cyclictest0-21swapper/121:50:251
21858991211,1cyclictest0-21swapper/121:50:251
2185899120,5cyclictest0-21swapper/122:00:321
2185899120,1cyclictest0-21swapper/123:26:201
2185499129,2cyclictest8436-21aten_r4power_vo20:40:110
2185499129,2cyclictest29318-21tr22:15:120
2185499129,2cyclictest26225-21aten_r4power_en22:10:110
2185499129,2cyclictest20277-21fschecks_time21:00:130
2185499129,2cyclictest15623-21grep21:50:140
2185499129,2cyclictest15623-21grep21:50:140
2185499120,7cyclictest25630-21sed19:15:010
2140952120,4pltrace0-21swapper/119:11:261
1886552120,4pltrace0-21swapper/721:00:207
1778852120,9pltrace54-21ksoftirqd/419:59:324
1778852120,6pltrace0-21swapper/519:59:585
1778852120,5pltrace0-21swapper/119:59:381
1328952120,2pltrace13927-21/usr/sbin/munin20:50:125
1266752120,3pltrace1178-21runrttasks22:44:142
1159252120,0pltrace0-21swapper/521:44:555
709552110,4pltrace0-21swapper/222:32:552
602052110,4pltrace0-21swapper/521:34:145
2663652110,1pltrace0-21swapper/523:10:165
2277252110,9pltrace0-21swapper/722:06:077
2213052110,3pltrace24228-21pltrace00:00:181
2188299117,3cyclictest1146-21snmpd21:08:167
2188299116,4cyclictest4717-21grep19:35:137
21882991110,1cyclictest0-21swapper/723:35:497
21882991110,1cyclictest0-21swapper/723:20:167
21882991110,1cyclictest0-21swapper/722:55:307
21882991110,1cyclictest0-21swapper/722:48:037
21882991110,1cyclictest0-21swapper/700:23:357
2188299110,5cyclictest14834-21tail20:50:147
2188299110,11cyclictest0-21swapper/723:46:597
2188299110,11cyclictest0-21swapper/722:33:097
2188299110,11cyclictest0-21swapper/721:42:587
2188299110,11cyclictest0-21swapper/720:48:347
2188299110,1cyclictest0-21swapper/722:00:377
2188299110,1cyclictest0-21swapper/700:36:127
2188099119,1cyclictest0-21swapper/620:40:576
2188099119,1cyclictest0-21swapper/620:15:546
2188099118,2cyclictest7483-21unixbench-2d20:35:236
2188099118,2cyclictest5038-21aten_r4power_vo22:30:116
2188099118,2cyclictest4937-21fschecks_count00:25:136
2188099118,2cyclictest30589-21expr23:15:136
2188099118,2cyclictest22445-21tr19:10:116
2188099117,3cyclictest0-21swapper/623:07:126
2188099115,2cyclictest0-21swapper/600:15:216
2188099112,8cyclictest0-21swapper/620:57:166
21880991110,1cyclictest0-21swapper/621:30:226
2188099110,4cyclictest0-21swapper/623:28:346
2188099110,11cyclictest0-21swapper/619:44:576
2188099110,1cyclictest0-21swapper/623:13:116
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional