You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-02 - 11:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Thu Jul 02, 2026 00:55:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32359970427,126cyclictest0-21swapper/722:14:347
323199703107,84cyclictest0-21swapper/323:07:123
32319965823,466cyclictest0-21swapper/322:13:353
323299654147,254cyclictest0-21swapper/422:46:424
32349965257,126cyclictest0-21swapper/623:29:196
322899652145,84cyclictest0-21swapper/022:12:530
32309965116,3cyclictest0-21swapper/200:31:322
32319964913,296cyclictest0-21swapper/321:57:433
32339964613,2cyclictest0-21swapper/500:31:325
3234996416,383cyclictest0-21swapper/600:31:336
3233996350,84cyclictest0-21swapper/523:30:205
32299962936,126cyclictest0-21swapper/100:34:371
32289962832,465cyclictest0-21swapper/023:00:090
323599626158,295cyclictest0-21swapper/722:39:567
323599626158,295cyclictest0-21swapper/722:39:567
323599626158,295cyclictest0-21swapper/722:39:557
323599626158,295cyclictest0-21swapper/722:39:557
323199625202,256cyclictest19382-21kworker/u16:000:27:323
323299624285,84cyclictest64450irq/122-eth000:28:384
32319962472,550cyclictest3226-21cyclictest22:47:103
32359962229,338cyclictest0-21swapper/721:19:287
32309962029,42cyclictest0-21swapper/222:14:082
32309961970,84cyclictest121rcu_preempt22:49:592
323499616233,380cyclictest25394-21kworker/u16:321:17:416
323499615528,3cyclictest631rcuc/600:26:506
32299961524,253cyclictest0-21swapper/123:09:041
32319961417,84cyclictest0-21swapper/300:08:563
322999614106,126cyclictest0-21swapper/122:38:171
322999614106,126cyclictest0-21swapper/122:38:171
322999614106,126cyclictest0-21swapper/122:38:161
322999614106,126cyclictest0-21swapper/122:38:161
322999610100,211cyclictest25-21ksoftirqd/123:37:561
32289961019,384cyclictest0-21swapper/000:31:330
32319960918,507cyclictest0-21swapper/323:20:193
32319960853,381cyclictest0-21swapper/321:19:223
32309960657,83cyclictest121rcu_preempt23:07:282
323499605180,210cyclictest0-21swapper/622:14:466
3231996046,127cyclictest0-21swapper/319:24:513
3231996046,127cyclictest0-21swapper/319:24:503
32349960092,126cyclictest0-21swapper/622:38:176
32349960092,126cyclictest0-21swapper/622:38:166
32349960092,126cyclictest0-21swapper/622:38:166
32349960092,126cyclictest0-21swapper/622:38:166
32339959688,126cyclictest0-21swapper/522:38:175
32339959688,126cyclictest0-21swapper/522:38:175
32339959688,126cyclictest0-21swapper/522:38:165
32339959688,126cyclictest0-21swapper/522:38:165
32319959482,338cyclictest1651-21ntpd23:28:003
322899594338,126cyclictest0-21swapper/023:57:460
32359959382,295cyclictest0-21swapper/700:29:317
323399592123,338cyclictest0-21swapper/522:49:215
3232995921,337cyclictest0-21swapper/422:59:444
323199591122,127cyclictest20496-21latency_hist22:40:043
323199591122,127cyclictest20496-21latency_hist22:40:033
3234995904,36cyclictest0-21swapper/623:09:296
32319958834,466cyclictest0-21swapper/322:40:183
32349958778,84cyclictest10664-21kworker/u16:121:59:256
32319958779,126cyclictest0-21swapper/322:38:163
32319958779,126cyclictest0-21swapper/322:38:163
32319958577,84cyclictest121rcu_preempt00:33:273
32319958434,339cyclictest0-21swapper/323:57:183
32309958433,126cyclictest0-21swapper/200:10:152
32299958434,126cyclictest0-21swapper/123:57:451
323299583242,338cyclictest7848-21kworker/u16:223:37:184
32319958233,423cyclictest0-21swapper/323:37:443
323099582285,84cyclictest0-21swapper/222:58:242
32339958170,508cyclictest0-21swapper/521:17:415
32349958030,126cyclictest0-21swapper/622:58:326
32289957926,338cyclictest10150-21awk21:05:180
32289957463,296cyclictest0-21swapper/023:38:480
32309956899,338cyclictest0-21swapper/222:15:142
32349956617,3cyclictest0-21swapper/623:37:566
32339956655,337cyclictest0-21swapper/500:44:245
32299956616,126cyclictest0-21swapper/119:25:291
32329956596,296cyclictest0-21swapper/423:28:524
32289956512,211cyclictest0-21swapper/021:19:130
32309956352,212cyclictest0-21swapper/221:59:392
32329956151,295cyclictest0-21swapper/419:25:294
32309955991,465cyclictest0-21swapper/223:29:002
32289955948,338cyclictest0-21swapper/021:59:240
322899559134,296cyclictest0-21swapper/023:09:210
3228995585,341cyclictest0-21swapper/000:42:560
32309955387,126cyclictest0-21swapper/222:39:482
32309955387,126cyclictest0-21swapper/222:39:482
32309955387,126cyclictest0-21swapper/222:39:472
32309955387,126cyclictest0-21swapper/222:39:472
323099553254,127cyclictest0-21swapper/219:25:042
3235995511,384cyclictest0-21swapper/723:37:557
323299550123,296cyclictest0-21swapper/400:07:444
3229995501,338cyclictest0-21swapper/123:18:081
32309954839,8cyclictest0-21swapper/221:19:562
32309954735,84cyclictest121rcu_preempt23:17:212
32339954638,83cyclictest121rcu_preempt00:08:015
322999546290,254cyclictest241ktimersoftd/122:00:181
32349954576,338cyclictest0-21swapper/622:46:546
32339954335,42cyclictest0-21swapper/523:39:565
32319954373,297cyclictest0-21swapper/323:30:283
32289954381,124cyclictest121rcu_preempt00:29:020
32289954333,507cyclictest0-21swapper/022:38:170
32289954333,507cyclictest0-21swapper/022:38:170
32289954333,507cyclictest0-21swapper/022:38:160
32289954333,507cyclictest0-21swapper/022:38:160
323399542247,83cyclictest0-21swapper/521:56:235
32299954234,126cyclictest0-21swapper/123:46:461
32299954071,211cyclictest0-21swapper/100:09:251
32299954028,210cyclictest241ktimersoftd/122:12:151
32339953972,295cyclictest0-21swapper/523:40:165
32309953928,211cyclictest0-21swapper/223:58:572
32329953828,126cyclictest0-21swapper/422:11:594
32289953872,211cyclictest0-21swapper/022:59:280
323399536283,84cyclictest0-21swapper/522:58:365
32309953628,125cyclictest121rcu_preempt00:07:032
32309953627,84cyclictest0-21swapper/223:39:312
32319953524,508cyclictest0-21swapper/300:22:203
32299953427,211cyclictest0-21swapper/122:47:521
32289953428,84cyclictest0-21swapper/000:09:300
32289953426,126cyclictest0-21swapper/023:27:580
32349953365,295cyclictest0-21swapper/619:25:316
32299953367,126cyclictest0-21swapper/122:59:211
32349952822,84cyclictest121rcu_preempt23:30:196
32319952818,507cyclictest0-21swapper/323:18:123
323399527444,3cyclictest551rcuc/522:14:085
32319952717,507cyclictest0-21swapper/319:25:203
323199527100,211cyclictest0-21swapper/323:46:453
32319952616,507cyclictest0-21swapper/300:42:553
32299952658,296cyclictest0-21swapper/100:29:071
32359952513,211cyclictest0-21swapper/723:18:387
32349952517,126cyclictest121rcu_preempt00:22:146
32329952557,254cyclictest121rcu_preempt23:00:084
32319952513,381cyclictest0-21swapper/322:58:393
32289952559,84cyclictest121rcu_preempt00:21:530
322899523309,84cyclictest0-21swapper/019:25:280
32339952216,2cyclictest0-21swapper/523:09:295
32329952013,339cyclictest0-21swapper/400:34:374
3230995178,84cyclictest0-21swapper/200:00:222
32299951752,212cyclictest0-21swapper/123:30:261
323599515131,126cyclictest121rcu_preempt00:09:117
32309951486,211cyclictest24159-21apt-get23:00:172
322999512391,38cyclictest241ktimersoftd/121:20:041
3232995101,127cyclictest0-21swapper/422:38:174
3232995101,127cyclictest0-21swapper/422:38:174
3232995101,127cyclictest0-21swapper/422:38:164
3232995101,127cyclictest0-21swapper/422:38:164
3235995091,257cyclictest0-21swapper/700:31:337
3230995090,84cyclictest0-21swapper/223:30:202
323599508125,381cyclictest0-21swapper/723:08:507
3230995081,84cyclictest0-21swapper/200:44:212
3232995070,83cyclictest0-21swapper/423:30:204
32329950638,295cyclictest0-21swapper/421:58:504
32339950578,43cyclictest121rcu_preempt23:59:195
323399504335,42cyclictest10272-21ssh23:29:195
32309950481,126cyclictest121rcu_preempt19:24:322
32309950481,126cyclictest121rcu_preempt19:24:312
32349950338,380cyclictest0-21swapper/600:43:376
32329950377,423cyclictest0-21swapper/421:18:394
32299950280,338cyclictest19431-21ssh00:10:041
32289950238,380cyclictest0-21swapper/022:48:240
323599501246,253cyclictest721ktimersoftd/723:57:457
32309950035,42cyclictest0-21swapper/200:27:332
32289950032,253cyclictest0-21swapper/022:15:030
32329949935,254cyclictest0-21swapper/423:57:214
32319949832,211cyclictest3226-21cyclictest00:00:083
322999498370,126cyclictest241ktimersoftd/121:57:441
32299949833,84cyclictest0-21swapper/123:27:391
32349949772,295cyclictest0-21swapper/619:24:446
32349949772,295cyclictest0-21swapper/619:24:436
32349949771,253cyclictest0-21swapper/622:40:196
32329949731,126cyclictest5960-21ssh22:15:144
322999497112,212cyclictest0-21swapper/121:20:121
32289949733,298cyclictest0-21swapper/000:35:100
323299496115,84cyclictest121rcu_preempt00:22:014
32329949527,126cyclictest25543-21ssh23:19:234
32309949529,84cyclictest0-21swapper/223:46:522
32349949471,126cyclictest0-21swapper/623:20:186
32349949424,345cyclictest0-21swapper/623:59:516
32299949328,47cyclictest0-21swapper/100:43:191
32359949126,254cyclictest3226-21cyclictest22:15:177
32349949167,126cyclictest18560-21seq00:09:256
323499490151,336cyclictest704-21nscd21:20:096
32299949022,126cyclictest1553-21runrttasks00:22:371
32359948862,254cyclictest0-21swapper/722:49:077
32359948820,296cyclictest0-21swapper/721:59:397
323599488146,126cyclictest121rcu_preempt23:29:277
32339948822,84cyclictest0-21swapper/500:22:385
32309948723,84cyclictest0-21swapper/223:10:062
32359948621,84cyclictest0-21swapper/722:50:187
322899486104,379cyclictest19436-21runrttasks00:10:050
32289948520,126cyclictest0-21swapper/022:40:230
32339948463,338cyclictest0-21swapper/500:10:035
32359948260,338cyclictest0-21swapper/700:10:037
32339948256,295cyclictest0-21swapper/500:27:525
32339948112,296cyclictest0-21swapper/521:20:235
32329948015,126cyclictest12766-21chrt19:23:144
32329948015,126cyclictest12766-21chrt19:23:144
32329947955,126cyclictest0-21swapper/423:08:504
32319947915,386cyclictest0-21swapper/300:35:103
32299947813,84cyclictest0-21swapper/119:23:291
32299947813,84cyclictest0-21swapper/119:23:281
3235994766,211cyclictest0-21swapper/722:57:217
3233994746,295cyclictest0-21swapper/519:21:055
3233994746,295cyclictest0-21swapper/519:21:045
3228994739,84cyclictest0-21swapper/023:17:530
3233994717,168cyclictest0-21swapper/519:43:035
3232994712,466cyclictest14822-21cron00:44:594
3231994712,338cyclictest0-21swapper/321:20:183
3231994691,465cyclictest0-21swapper/323:00:183
323099467212,253cyclictest0-21swapper/222:00:182
323399466126,338cyclictest3226-21cyclictest23:00:145
322899465124,338cyclictest0-21swapper/019:24:230
322899465124,338cyclictest0-21swapper/019:24:220
32359946240,255cyclictest12782-21runrttasks19:23:307
32359946240,255cyclictest12782-21runrttasks19:23:307
32349946240,256cyclictest0-21swapper/623:19:306
323299462122,338cyclictest0-21swapper/400:10:274
32289946239,168cyclictest30800-21sh21:20:170
323299461120,338cyclictest7610-21ssh22:50:184
323299461120,338cyclictest0-21swapper/423:46:514
32319946180,85cyclictest11395-21ssh22:00:203
323399460292,41cyclictest0-21swapper/523:10:065
323499459121,296cyclictest20349-21/usr/sbin/munin00:10:156
32339945975,211cyclictest0-21swapper/523:18:085
323499458118,338cyclictest0-21swapper/623:40:166
32289945834,84cyclictest0-21swapper/023:30:180
322899458117,126cyclictest11618-21ssh23:47:290
32309945733,169cyclictest0-21swapper/221:20:092
3228994571,118cyclictest121rcu_preempt23:10:050
32359945634,256cyclictest0-21swapper/719:25:197
32359945430,256cyclictest0-21swapper/700:35:057
32299945431,256cyclictest0-21swapper/100:35:041
32319945372,84cyclictest0-21swapper/300:10:153
32309945372,126cyclictest0-21swapper/200:21:462
32359945230,256cyclictest0-21swapper/700:44:127
32349945227,84cyclictest0-21swapper/623:00:176
32339945229,219cyclictest0-21swapper/523:20:035
32339945028,84cyclictest0-21swapper/523:47:175
323599449111,253cyclictest0-21swapper/721:05:147
323599449107,339cyclictest30142-21taskset23:40:157
323399449234,84cyclictest22058-21nscd22:00:105
32359944862,211cyclictest0-21swapper/721:20:177
323299448105,296cyclictest3427-21ntp_kernel_err00:00:224
32309944725,256cyclictest0-21swapper/222:40:112
32299944624,126cyclictest21739-21hddtemp_smartct22:40:201
32339944417,296cyclictest0-21swapper/519:25:285
323099444227,126cyclictest0-21swapper/223:20:112
32359944219,43cyclictest0-21swapper/722:40:227
32329944119,210cyclictest0-21swapper/422:00:144
32309944156,84cyclictest121rcu_preempt22:50:032
32359943955,338cyclictest0-21swapper/700:21:267
32299943715,3cyclictest0-21swapper/123:00:081
32299943715,2cyclictest0-21swapper/122:15:141
32329943412,3cyclictest0-21swapper/422:40:124
32289943395,336cyclictest0-21swapper/022:00:100
32339943210,42cyclictest0-21swapper/500:00:115
32359943189,339cyclictest0-21swapper/700:00:227
3230994296,126cyclictest0-21swapper/223:40:162
3229994296,169cyclictest0-21swapper/123:20:231
32359942887,338cyclictest0-21swapper/723:30:227
3232994281,126cyclictest0-21swapper/423:40:024
3232994262,211cyclictest0-21swapper/423:10:074
323099426126,169cyclictest0-21swapper/200:35:162
3229994261,253cyclictest0-21swapper/100:00:151
323599425126,126cyclictest73-21ksoftirqd/723:00:087
3231994243,126cyclictest6216-21/usr/sbin/munin22:15:173
32289942445,214cyclictest26665-21/usr/sbin/munin23:20:200
32339942382,338cyclictest0-21swapper/522:40:265
32319942337,45cyclictest28580-21ssh23:40:033
32349942180,338cyclictest0-21swapper/622:00:176
323399421210,41cyclictest0-21swapper/521:05:175
32299942180,338cyclictest0-21swapper/123:40:151
32319941934,382cyclictest0-21swapper/323:10:053
32299941934,126cyclictest9574-21runrttasks21:05:131
32289941940,295cyclictest0-21swapper/000:00:030
323399416289,42cyclictest561ktimersoftd/522:15:095
32299941632,253cyclictest0-21swapper/123:10:071
32329941575,84cyclictest0-21swapper/423:20:244
32299941473,338cyclictest0-21swapper/122:50:181
32319941227,126cyclictest0-21swapper/322:50:213
32349941131,214cyclictest5966-21gltestperf22:15:156
32329941172,84cyclictest0-21swapper/400:35:104
32359941070,338cyclictest0-21swapper/723:10:107
32339941071,337cyclictest0-21swapper/500:35:185
32289941070,338cyclictest0-21swapper/023:40:020
32359940968,338cyclictest0-21swapper/723:46:527
32349940766,338cyclictest0-21swapper/622:50:206
32349940665,338cyclictest0-21swapper/600:00:176
32349940564,338cyclictest0-21swapper/623:47:326
32349940527,3cyclictest0-21swapper/621:05:146
32329940566,84cyclictest0-21swapper/421:20:114
32349940362,338cyclictest0-21swapper/600:35:116
32289940261,338cyclictest0-21swapper/000:16:100
32349940160,338cyclictest0-21swapper/623:10:106
323499400144,126cyclictest121rcu_preempt00:16:096
32309940061,84cyclictest28274-1kworker/u17:100:16:092
32359939251,338cyclictest0-21swapper/722:00:237
3233993842,84cyclictest0-21swapper/522:50:185
32309937840,177cyclictest0-21swapper/221:05:162
32299937434,126cyclictest0-21swapper/100:16:161
32359937235,212cyclictest0-21swapper/723:20:197
32289937134,168cyclictest0-21swapper/019:42:570
32339937032,84cyclictest0-21swapper/500:16:105
32329936931,84cyclictest0-21swapper/400:16:104
322899357102,253cyclictest7613-21memory22:50:190
3231993529,84cyclictest0-21swapper/321:05:203
32319934443,85cyclictest0-21swapper/319:42:573
32319934042,295cyclictest0-21swapper/300:16:093
323299333116,86cyclictest0-21swapper/421:05:194
32309933136,3cyclictest0-21swapper/219:43:042
32299932934,175cyclictest0-21swapper/119:43:031
32329932226,84cyclictest0-21swapper/419:43:044
32359931718,296cyclictest11243-21diskmemload00:16:097
32349928834,42cyclictest0-21swapper/619:42:566
32359928630,83cyclictest73-21ksoftirqd/719:42:567
75172910,0sleep70-21swapper/721:40:247
250528555,27sleep30-21swapper/319:05:493
257328455,26sleep50-21swapper/519:06:465
267928252,27sleep70-21swapper/719:08:177
254228253,26sleep20-21swapper/219:06:202
258328051,26sleep60-21swapper/619:06:556
270827950,26sleep00-21swapper/019:08:410
261627950,7sleep10-21swapper/119:07:231
253527947,28sleep40-21swapper/419:06:134
283122760,0sleep50-21swapper/521:50:395
196442720,0sleep00-21swapper/019:35:130
275352690,0sleep00-21swapper/022:08:440
275352690,0sleep00-21swapper/022:08:430
133482670,0sleep50-21swapper/521:27:565
23812510,0sleep20-21swapper/220:55:002
3231993410,23cyclictest0-21swapper/321:52:473
3231993410,17cyclictest0-21swapper/321:33:213
3231993210,17cyclictest0-21swapper/322:26:353
3231993210,0cyclictest0-21swapper/319:48:583
3231993126,4cyclictest0-21swapper/321:04:573
3235992828,0cyclictest0-21swapper/721:52:427
3235992810,18cyclictest0-21swapper/720:47:117
3235992810,18cyclictest0-21swapper/720:30:437
3235992810,18cyclictest0-21swapper/720:11:497
3235992810,18cyclictest0-21swapper/720:03:397
3235992810,18cyclictest0-21swapper/719:13:307
3235992810,0cyclictest0-21swapper/721:04:447
3235992810,0cyclictest0-21swapper/720:54:537
3235992810,0cyclictest0-21swapper/720:39:337
3234992810,18cyclictest0-21swapper/621:43:446
3234992810,18cyclictest0-21swapper/619:31:436
3231992810,18cyclictest0-21swapper/320:04:073
3231992810,0cyclictest0-21swapper/321:44:123
3231992810,0cyclictest0-21swapper/319:13:073
3230992828,0cyclictest0-21swapper/220:11:222
3230992810,18cyclictest0-21swapper/221:52:422
3230992810,18cyclictest0-21swapper/221:33:222
3230992810,0cyclictest0-21swapper/219:13:062
3229992810,18cyclictest0-21swapper/122:26:121
3229992810,18cyclictest0-21swapper/121:32:521
3229992810,0cyclictest0-21swapper/121:53:171
3228992810,18cyclictest0-21swapper/019:13:120
3235992727,0cyclictest0-21swapper/720:21:037
3235992710,17cyclictest0-21swapper/721:32:537
3235992710,17cyclictest0-21swapper/719:56:207
3235992710,0cyclictest0-21swapper/722:26:027
3235992710,0cyclictest0-21swapper/719:48:557
3235992710,0cyclictest0-21swapper/719:38:157
3235992710,0cyclictest0-21swapper/719:31:457
3234992727,0cyclictest0-21swapper/622:26:086
3234992710,17cyclictest0-21swapper/621:52:396
3234992710,17cyclictest0-21swapper/621:04:316
3234992710,17cyclictest0-21swapper/620:46:546
3234992710,17cyclictest0-21swapper/620:21:056
3234992710,17cyclictest0-21swapper/620:03:496
3234992710,17cyclictest0-21swapper/619:56:566
3234992710,17cyclictest0-21swapper/619:49:126
3234992710,17cyclictest0-21swapper/619:38:086
3234992710,17cyclictest0-21swapper/619:13:066
3234992710,0cyclictest0-21swapper/621:32:556
3234992710,0cyclictest0-21swapper/620:54:506
3234992710,0cyclictest0-21swapper/620:39:086
3234992710,0cyclictest0-21swapper/620:30:536
3234992710,0cyclictest0-21swapper/620:11:256
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional