You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-29 - 21:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sat Aug 29, 2026 12:55:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21620998030,84cyclictest121rcu_preempt09:52:530
21620996790,84cyclictest0-21swapper/009:48:570
216209965664,126cyclictest0-21swapper/010:11:030
216249964449,421cyclictest0-21swapper/409:13:444
21624996427,3cyclictest0-21swapper/411:21:294
21620996330,84cyclictest0-21swapper/011:04:490
216209962733,591cyclictest0-21swapper/011:23:350
21623996261,2cyclictest0-21swapper/311:21:303
216249962430,591cyclictest64450irq/122-eth012:34:154
216229960714,3cyclictest0-21swapper/211:21:302
2162199605561,42cyclictest241ktimersoftd/112:26:301
21627995942,466cyclictest0-21swapper/711:42:117
21626995942,3cyclictest0-21swapper/611:21:306
21621995921,2cyclictest0-21swapper/111:16:071
216209959240,422cyclictest0-21swapper/011:15:090
2162699588548,37cyclictest631rcuc/611:18:216
216209958877,84cyclictest121rcu_preempt08:00:210
216209958877,84cyclictest121rcu_preempt08:00:200
216209958734,550cyclictest0-21swapper/011:25:410
216209958734,550cyclictest0-21swapper/011:25:410
2162499585245,126cyclictest29210-21diskmemload09:49:174
216219958535,84cyclictest0-21swapper/109:19:491
216209958070,507cyclictest0-21swapper/010:52:130
216229957362,126cyclictest121rcu_preempt12:03:582
216259957121,383cyclictest0-21swapper/511:21:295
216219956915,296cyclictest0-21swapper/110:54:081
2162699566267,126cyclictest0-21swapper/610:13:356
216219956612,380cyclictest0-21swapper/109:08:471
2162599561261,127cyclictest713-21in:imuxsock07:50:205
216219955848,252cyclictest0-21swapper/111:45:141
21621995568,134cyclictest0-21swapper/109:47:451
21620995531,84cyclictest1553-21runrttasks11:45:040
21627995522,424cyclictest0-21swapper/711:21:307
21623995522,384cyclictest0-21swapper/311:16:073
21622995521,84cyclictest0-21swapper/210:54:502
216239954334,126cyclictest0-21swapper/309:13:303
2162099543121,84cyclictest121rcu_preempt09:22:440
216219954234,124cyclictest21618-21cyclictest10:40:511
216209954132,507cyclictest0-21swapper/011:13:570
216209954130,338cyclictest0-21swapper/011:43:480
2162199538196,84cyclictest0-21swapper/111:36:311
216209953831,470cyclictest0-21swapper/007:45:200
216279953768,296cyclictest0-21swapper/711:37:497
216269953567,465cyclictest0-21swapper/609:12:376
2162499529104,126cyclictest49-21ksoftirqd/410:53:584
216229952960,295cyclictest0-21swapper/211:16:422
216269952621,41cyclictest0-21swapper/610:51:566
216229952615,84cyclictest0-21swapper/209:50:422
216229952416,84cyclictest121rcu_preempt11:36:282
2162599523183,126cyclictest121rcu_preempt10:30:115
2162599523183,126cyclictest121rcu_preempt10:30:115
216219952355,295cyclictest0-21swapper/111:02:431
2162099523224,296cyclictest10990-21rm09:17:580
216259952013,85cyclictest0-21swapper/510:39:165
216259951812,126cyclictest0-21swapper/511:04:085
2162399515297,169cyclictest0-21swapper/311:44:263
216229951320,3cyclictest0-21swapper/209:13:332
216209951349,427cyclictest0-21swapper/010:30:180
216209951349,427cyclictest0-21swapper/010:30:180
21626995124,262cyclictest0-21swapper/611:13:036
21627995114,340cyclictest721ktimersoftd/710:55:077
216209951148,426cyclictest0-21swapper/012:13:550
216209950983,337cyclictest22425-21sh12:04:490
216269950739,41cyclictest121rcu_preempt07:42:296
2162399504206,125cyclictest121rcu_preempt10:38:513
2162199504124,84cyclictest0-21swapper/111:22:171
216279950376,211cyclictest73-21ksoftirqd/711:16:067
216269950338,298cyclictest0-21swapper/611:36:176
216259950377,210cyclictest57-21ksoftirqd/511:54:155
216229950381,126cyclictest0-21swapper/212:13:372
2162299503162,338cyclictest30280-21unixbench_multi10:55:282
216209950334,465cyclictest0-21swapper/007:51:560
216209950334,253cyclictest0-21swapper/010:42:320
216229950275,126cyclictest704-21nscd09:55:302
216229950233,84cyclictest0-21swapper/209:24:102
216209950234,465cyclictest0-21swapper/010:38:520
216279950179,257cyclictest1553-21runrttasks07:51:367
216259950137,340cyclictest0-21swapper/511:16:075
2162599501120,84cyclictest0-21swapper/509:23:495
216249950132,296cyclictest0-21swapper/411:03:204
2162499500205,293cyclictest26783-21kworker/u16:310:42:284
216229949977,256cyclictest30152-21nscd11:26:232
216229949977,256cyclictest30152-21nscd11:26:232
216209949834,380cyclictest0-21swapper/012:43:580
216209949834,210cyclictest0-21swapper/012:26:140
216219949731,84cyclictest0-21swapper/111:25:211
216219949731,84cyclictest0-21swapper/111:25:211
2162799496110,169cyclictest31363-21ssh11:14:557
2162699495280,85cyclictest13089-21ssh09:19:486
216209949328,126cyclictest4786-21ssh09:14:570
216279949226,299cyclictest0-21swapper/710:40:137
216229949227,42cyclictest0-21swapper/209:16:142
216209949224,465cyclictest0-21swapper/009:08:200
216239949165,211cyclictest0-21swapper/309:15:423
2162299491108,125cyclictest1651-21ntpd10:41:152
2162599490403,4cyclictest561ktimersoftd/510:44:345
216249949026,2cyclictest0-21swapper/409:20:294
2162499490106,254cyclictest0-21swapper/411:11:124
216219949065,211cyclictest0-21swapper/111:43:191
216249948863,422cyclictest0-21swapper/411:35:344
216229948617,296cyclictest0-21swapper/210:04:582
2162799485399,84cyclictest711rcuc/709:24:507
216239948217,127cyclictest8887-21runrttasks12:14:543
216209948117,84cyclictest0-21swapper/010:15:180
216209948116,255cyclictest0-21swapper/010:29:320
216249948016,44cyclictest0-21swapper/409:16:024
216239948015,302cyclictest0-21swapper/310:44:143
2162699479148,203cyclictest30270-21unixbench-2d10:55:266
216269947914,3cyclictest0-21swapper/610:30:186
216269947914,3cyclictest0-21swapper/610:30:186
216279947851,338cyclictest0-21swapper/709:13:307
216229947893,126cyclictest0-21swapper/211:55:442
216219947751,253cyclictest3764-21sh09:13:521
216209947711,126cyclictest0-21swapper/010:05:080
21624994758,464cyclictest0-21swapper/410:31:154
21624994758,464cyclictest0-21swapper/410:31:154
21620994738,385cyclictest30251-21/usr/sbin/munin10:55:250
21622994728,7cyclictest0-21swapper/211:02:332
21622994715,211cyclictest0-21swapper/210:14:502
216219947143,127cyclictest0-21swapper/109:53:551
21620994714,131cyclictest4412-21ssh11:36:290
21622994701,84cyclictest0-21swapper/207:40:192
216279946945,296cyclictest73-21ksoftirqd/711:54:337
2162699469383,84cyclictest631rcuc/609:22:536
216279946882,211cyclictest3992-21ssh09:49:557
216239946884,381cyclictest29210-21diskmemload12:03:593
216249946740,295cyclictest0-21swapper/412:14:054
21623994671,126cyclictest0-21swapper/311:26:573
21623994671,126cyclictest0-21swapper/311:26:573
216229946740,295cyclictest0-21swapper/210:30:222
216229946740,295cyclictest0-21swapper/210:30:222
216279946640,296cyclictest0-21swapper/710:12:117
21627994661,2cyclictest0-21swapper/710:30:187
21627994661,2cyclictest0-21swapper/710:30:187
216269946685,84cyclictest1651-21ntpd11:44:406
2162599466166,169cyclictest17147-21cat11:25:215
2162599466166,169cyclictest17147-21cat11:25:215
216249946641,295cyclictest0-21swapper/407:52:074
21624994661,256cyclictest0-21swapper/411:16:074
216269946479,169cyclictest65-21ksoftirqd/609:48:276
216259946479,169cyclictest57-21ksoftirqd/509:54:375
216209946438,210cyclictest0-21swapper/012:34:430
216259946341,2cyclictest0-21swapper/509:19:045
216269946233,84cyclictest0-21swapper/610:42:496
2162699462120,126cyclictest65-21ksoftirqd/611:26:266
2162699462120,126cyclictest65-21ksoftirqd/611:26:266
216259946240,256cyclictest0-21swapper/510:12:465
216249946240,2cyclictest0-21swapper/411:25:394
216249946240,2cyclictest0-21swapper/411:25:394
216239946240,85cyclictest0-21swapper/309:53:263
216239946240,7cyclictest3231950kworker/u16:209:49:073
2162199462207,253cyclictest241ktimersoftd/110:14:501
2162599461119,339cyclictest13319-21nscd11:44:215
216209946138,254cyclictest0-21swapper/011:54:290
216269945936,84cyclictest121rcu_preempt07:50:236
216279945874,169cyclictest0-21swapper/709:09:467
216239945836,256cyclictest0-21swapper/310:12:473
2162799457118,84cyclictest0-21swapper/712:03:597
216229945735,42cyclictest121rcu_preempt11:45:122
216219945731,211cyclictest241ktimersoftd/111:55:041
216279945634,3cyclictest0-21swapper/711:02:357
216279945634,176cyclictest0-21swapper/712:05:157
216269945633,257cyclictest0-21swapper/609:55:016
2162699456242,84cyclictest0-21swapper/608:00:156
2162699456242,84cyclictest0-21swapper/608:00:156
216229945634,84cyclictest1553-21runrttasks09:49:382
216219945634,84cyclictest0-21swapper/112:13:471
216209945631,422cyclictest0-21swapper/007:43:120
216279945528,130cyclictest19049-21sed11:45:197
216229945575,214cyclictest21618-21cyclictest11:14:242
216279945474,296cyclictest0-21swapper/709:18:507
216249945479,372cyclictest0-21swapper/409:53:314
216249945432,256cyclictest0-21swapper/411:42:534
2162499454200,84cyclictest64450irq/122-eth010:14:444
216209945432,2cyclictest0-21swapper/011:55:100
216279945330,257cyclictest0-21swapper/707:55:047
216259945331,2cyclictest0-21swapper/509:49:085
216259945331,256cyclictest0-21swapper/512:04:345
216249945329,84cyclictest0-21swapper/408:00:164
216249945329,84cyclictest0-21swapper/408:00:154
2162399453113,337cyclictest0-21swapper/311:35:453
216279945230,256cyclictest0-21swapper/711:55:447
216259945228,84cyclictest0-21swapper/510:54:085
216239945228,257cyclictest0-21swapper/310:51:563
216219945264,126cyclictest25-21ksoftirqd/111:54:541
2162799451109,339cyclictest0-21swapper/708:00:217
2162799451109,339cyclictest0-21swapper/708:00:207
216219945129,211cyclictest0-21swapper/112:04:201
216279945028,256cyclictest0-21swapper/709:55:287
216259945071,84cyclictest0-21swapper/511:35:465
216259945027,3cyclictest0-21swapper/507:40:205
216269944927,2cyclictest0-21swapper/611:02:216
216249944966,210cyclictest12908-21ssh09:55:114
216209944927,338cyclictest0-21swapper/009:25:120
216249944826,255cyclictest0-21swapper/411:55:104
216279944724,256cyclictest0-21swapper/711:27:277
216279944724,256cyclictest0-21swapper/711:27:277
216259944725,2cyclictest0-21swapper/512:33:595
216239944775,203cyclictest41-21ksoftirqd/307:50:183
216239944725,256cyclictest0-21swapper/311:12:333
2162399447109,126cyclictest41-21ksoftirqd/311:03:103
216229944767,169cyclictest0-21swapper/211:43:452
2162599446108,212cyclictest704-21nscd11:11:225
2162199446362,4cyclictest231rcuc/111:14:241
216219944624,8cyclictest0-21swapper/109:21:561
216279944522,256cyclictest0-21swapper/707:45:217
216269944422,255cyclictest0-21swapper/611:55:096
216279944362,126cyclictest121rcu_preempt09:25:127
2162399443103,253cyclictest0-21swapper/309:09:103
2162799442355,84cyclictest721ktimersoftd/710:54:077
216279944219,339cyclictest0-21swapper/710:15:197
216269944220,2cyclictest0-21swapper/610:15:166
216249944220,256cyclictest0-21swapper/411:54:494
216239944219,127cyclictest0-21swapper/309:21:483
216239944211,84cyclictest0-21swapper/310:31:063
216239944211,84cyclictest0-21swapper/310:31:063
216239944160,169cyclictest41-21ksoftirqd/308:00:163
216239944160,169cyclictest41-21ksoftirqd/308:00:163
216279943996,211cyclictest73-21ksoftirqd/710:45:067
216219943811,254cyclictest0-21swapper/110:30:501
216219943811,254cyclictest0-21swapper/110:30:501
216209943812,423cyclictest0-21swapper/009:55:090
216209943798,84cyclictest0-21swapper/010:45:060
216269943513,2cyclictest0-21swapper/611:54:336
216219943513,84cyclictest0-21swapper/110:38:411
216249943310,254cyclictest0-21swapper/407:40:184
216209943312,253cyclictest0-21swapper/011:05:190
216219943193,84cyclictest0-21swapper/112:24:081
216219943193,84cyclictest0-21swapper/112:24:081
21625994308,2cyclictest0-21swapper/510:29:315
21622994308,256cyclictest0-21swapper/211:54:482
216259942795,121cyclictest698-21ptp4l12:26:105
216279942582,211cyclictest0-21swapper/712:34:387
21626994253,2cyclictest0-21swapper/612:34:156
216249942584,131cyclictest0-21swapper/412:26:314
216279942483,338cyclictest0-21swapper/709:52:097
21626994241,256cyclictest0-21swapper/612:04:346
21625994241,256cyclictest0-21swapper/510:55:085
21622994240,41cyclictest0-21swapper/210:38:442
216209942440,177cyclictest0-21swapper/007:55:030
21624994231,256cyclictest0-21swapper/412:04:354
2162199423212,84cyclictest121rcu_preempt10:55:131
21621994231,211cyclictest0-21swapper/108:00:201
21621994231,211cyclictest0-21swapper/108:00:201
216259942282,337cyclictest0-21swapper/510:05:135
216259942281,338cyclictest0-21swapper/509:12:525
216279942142,83cyclictest121rcu_preempt10:38:457
216269942179,339cyclictest0-21swapper/610:39:516
216239942182,84cyclictest0-21swapper/312:26:223
216279941978,338cyclictest0-21swapper/712:26:227
216249941934,211cyclictest0-21swapper/410:55:264
2162299419120,296cyclictest0-21swapper/207:50:232
216259941876,126cyclictest7698-21kworker/5:111:55:055
216259941838,84cyclictest121rcu_preempt12:13:285
216229941880,172cyclictest0-21swapper/210:29:312
216219941838,46cyclictest0-21swapper/107:54:151
2162199418123,84cyclictest32496-21munin-node10:05:131
216269941776,338cyclictest0-21swapper/612:05:146
2162499417202,125cyclictest0-21swapper/410:39:414
2162399417119,211cyclictest4956-21df_abs11:55:143
216269941636,3cyclictest0-21swapper/609:55:136
216219941637,41cyclictest121rcu_preempt09:25:111
2162199416117,126cyclictest0-21swapper/111:05:191
216269941573,339cyclictest0-21swapper/610:45:066
216269941535,2cyclictest0-21swapper/611:05:126
2162299415199,127cyclictest29195-21cron09:10:002
216259941473,126cyclictest57-21ksoftirqd/509:55:135
216219941430,211cyclictest0-21swapper/107:40:201
216239941374,84cyclictest0-21swapper/312:34:293
216259941271,338cyclictest0-21swapper/510:15:195
216229941272,84cyclictest0-21swapper/210:15:162
2162299412113,126cyclictest0-21swapper/212:34:212
216249941175,333cyclictest0-21swapper/411:45:144
216219941134,42cyclictest121rcu_preempt12:34:391
216279941069,338cyclictest0-21swapper/710:05:147
216259941029,84cyclictest0-21swapper/511:45:055
216209941071,84cyclictest0-21swapper/012:05:150
216269940968,337cyclictest0-21swapper/609:09:106
216219940971,84cyclictest0-21swapper/110:15:161
216269940828,85cyclictest0-21swapper/612:26:216
216239940865,211cyclictest41-21ksoftirqd/307:42:273
216249940769,84cyclictest32497-21ssh10:05:134
216249940768,84cyclictest0-21swapper/410:15:174
216239940666,84cyclictest0-21swapper/310:05:143
216219940627,41cyclictest121rcu_preempt10:28:431
216279940564,338cyclictest0-21swapper/710:28:447
216269940524,86cyclictest0-21swapper/610:04:586
2162099405244,77cyclictest111rcuc/012:22:390
2162099405244,77cyclictest111rcuc/012:22:390
216239940424,84cyclictest0-21swapper/310:15:183
216239940264,171cyclictest0-21swapper/309:55:113
216279940159,339cyclictest1651-21ntpd07:42:547
216249940118,169cyclictest0-21swapper/412:15:284
216239940162,84cyclictest0-21swapper/311:54:143
216259940021,2cyclictest0-21swapper/507:45:215
216239940061,84cyclictest0-21swapper/310:28:453
216239940019,299cyclictest0-21swapper/310:55:043
216269939917,2cyclictest0-21swapper/612:13:546
216229939960,84cyclictest0-21swapper/208:00:212
216229939960,84cyclictest0-21swapper/208:00:212
216229939819,255cyclictest0-21swapper/207:55:042
216229939818,2cyclictest0-21swapper/207:45:182
216219939859,84cyclictest0-21swapper/110:45:071
216279939717,126cyclictest0-21swapper/711:05:177
216239939758,84cyclictest0-21swapper/311:45:143
216239939354,84cyclictest0-21swapper/312:05:153
216229939252,84cyclictest0-21swapper/210:05:142
21627993862,169cyclictest8619-21chrt12:14:367
216239938445,84cyclictest0-21swapper/312:24:083
216239938445,84cyclictest0-21swapper/312:24:073
216269938344,84cyclictest0-21swapper/612:24:076
216269938344,84cyclictest0-21swapper/612:24:076
2162199382211,46cyclictest0-21swapper/112:15:271
21621993811,42cyclictest0-21swapper/112:43:581
216229937841,3cyclictest15403-21load11:05:242
216219937841,8cyclictest0-21swapper/109:55:111
216269937638,3cyclictest0-21swapper/611:45:146
216249937676,168cyclictest0-21swapper/410:45:164
216249937637,256cyclictest21980-21sh09:25:144
216249937536,84cyclictest0-21swapper/412:24:084
216249937536,84cyclictest0-21swapper/412:24:084
216239937573,127cyclictest0-21swapper/312:43:583
2162399374331,41cyclictest391rcuc/311:05:113
216259937134,2cyclictest0-21swapper/509:08:045
216259937133,3cyclictest9381-21ssh10:45:075
2162499371114,127cyclictest0-21swapper/409:09:474
216259937032,83cyclictest0-21swapper/511:05:265
216259936970,127cyclictest0-21swapper/509:25:145
216259936969,127cyclictest0-21swapper/512:05:155
216209936931,83cyclictest0-21swapper/010:04:560
216279936730,171cyclictest0-21swapper/712:43:567
216259936670,169cyclictest0-21swapper/510:04:515
216229936629,7cyclictest0-21swapper/212:26:042
216219936627,211cyclictest25-21ksoftirqd/107:45:191
216229936523,177cyclictest0-21swapper/212:15:272
216269936325,3cyclictest0-21swapper/609:25:106
2162299363107,253cyclictest0-21swapper/209:25:122
216279936225,170cyclictest0-21swapper/712:15:287
216269936225,2cyclictest0-21swapper/612:15:286
216259936022,3cyclictest0-21swapper/512:15:285
216249936064,84cyclictest0-21swapper/410:04:574
216249935921,84cyclictest0-21swapper/411:05:244
216229935964,210cyclictest0-21swapper/212:22:382
216229935964,210cyclictest0-21swapper/212:22:382
216269935821,2cyclictest0-21swapper/610:28:446
216219935660,84cyclictest0-21swapper/110:04:581
216269935518,2cyclictest0-21swapper/610:05:106
216239935517,85cyclictest0-21swapper/307:45:173
216269935113,3cyclictest0-21swapper/612:43:566
216229935114,210cyclictest0-21swapper/210:45:062
216249934997,50cyclictest0-21swapper/412:05:174
216239934911,87cyclictest1-21systemd10:45:073
21626993446,256cyclictest0-21swapper/607:45:196
21625993401,84cyclictest0-21swapper/512:24:085
21625993401,84cyclictest0-21swapper/512:24:085
21621993392,171cyclictest0-21swapper/112:05:151
216259933640,85cyclictest57-21ksoftirqd/508:00:195
216259933640,85cyclictest57-21ksoftirqd/508:00:195
216249933579,253cyclictest0-21swapper/410:28:454
2162399335124,48cyclictest121rcu_preempt10:04:563
2162399335124,131cyclictest401ktimersoftd/312:15:283
216259933439,3cyclictest0-21swapper/512:43:595
216239933439,85cyclictest0-21swapper/309:25:103
216209933334,210cyclictest0-21swapper/012:15:280
216269933236,214cyclictest0-21swapper/607:55:046
216249932834,2cyclictest0-21swapper/407:45:184
2162499328156,169cyclictest704-21nscd12:43:574
216259932529,3cyclictest0-21swapper/507:55:055
2162299324114,41cyclictest20167-1kworker/u17:012:05:152
216279932024,42cyclictest0-21swapper/712:22:387
216279932024,42cyclictest0-21swapper/712:22:387
216279931722,213cyclictest0-21swapper/710:04:577
216219931318,169cyclictest0-21swapper/107:55:031
216239929546,44cyclictest121rcu_preempt07:55:033
216279929485,206cyclictest15850irq/123-ahci[0012:35:017
216249929441,2cyclictest0-21swapper/412:35:014
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional