You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-18 - 05:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue Aug 18, 2026 00:55:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1590997660,127cyclictest3722-21ssh22:00:121
15969975936,720cyclictest0-21swapper/723:30:347
15969971783,508cyclictest0-21swapper/721:07:447
15969971030,677cyclictest0-21swapper/722:50:067
15969970568,634cyclictest0-21swapper/723:44:537
159699673119,171cyclictest0-21swapper/722:24:497
158999658103,338cyclictest0-21swapper/022:24:480
159199630290,338cyclictest7836-21kworker/u16:022:57:452
15899962732,380cyclictest0-21swapper/022:50:090
15909961970,211cyclictest25-21ksoftirqd/122:09:441
15969961721,593cyclictest30258-21irqstats21:55:227
15969961318,592cyclictest0-21swapper/722:38:357
15909961016,127cyclictest0-21swapper/121:54:381
15909961016,127cyclictest0-21swapper/121:54:371
15969960712,592cyclictest0-21swapper/722:58:577
1590996069,126cyclictest0-21swapper/122:50:421
1596996049,592cyclictest0-21swapper/722:00:137
159699596297,125cyclictest30745-21apt-key23:10:017
159699596297,125cyclictest30745-21apt-key23:10:017
1593995940,84cyclictest0-21swapper/421:58:334
1592995940,84cyclictest0-21swapper/320:14:283
1595995930,84cyclictest0-21swapper/620:15:126
1594995930,84cyclictest0-21swapper/520:15:135
1593995930,84cyclictest0-21swapper/420:15:134
15899959343,126cyclictest28537-21sh22:14:080
15959959041,344cyclictest0-21swapper/622:00:176
15969958978,84cyclictest27972-21fschecks_count20:45:157
15939958879,126cyclictest0-21swapper/423:45:234
15909958574,295cyclictest0-21swapper/121:56:191
15959958434,383cyclictest0-21swapper/623:53:376
15969958373,507cyclictest0-21swapper/721:14:137
15919958334,126cyclictest121rcu_preempt22:51:372
159299577150,260cyclictest121rcu_preempt21:53:053
159299577150,260cyclictest121rcu_preempt21:53:053
159199577109,465cyclictest0-21swapper/223:10:042
159199577109,465cyclictest0-21swapper/223:10:042
15919957567,126cyclictest0-21swapper/222:10:162
15969957220,549cyclictest0-21swapper/720:14:237
158999572103,295cyclictest0-21swapper/023:31:120
15919957018,127cyclictest0-21swapper/222:37:512
15969956411,550cyclictest0-21swapper/722:09:467
15909956498,126cyclictest0-21swapper/121:35:461
15909956498,126cyclictest0-21swapper/121:35:451
15939956213,338cyclictest704-21nscd00:16:184
15929955850,126cyclictest0-21swapper/321:16:043
15959955040,127cyclictest121rcu_preempt20:42:086
158999550463,84cyclictest101ktimersoftd/022:35:160
15909954983,84cyclictest121rcu_preempt22:24:441
159099548122,295cyclictest0-21swapper/100:23:571
159399547167,215cyclictest121rcu_preempt00:07:524
15929954778,84cyclictest0-21swapper/300:44:373
15899954575,338cyclictest121rcu_preempt21:53:390
15899954575,338cyclictest121rcu_preempt21:53:390
15959954475,211cyclictest65-21ksoftirqd/623:42:176
15899954437,84cyclictest0-21swapper/021:59:570
15949954336,341cyclictest0-21swapper/522:14:485
159499543122,124cyclictest121rcu_preempt21:39:415
159499543122,124cyclictest121rcu_preempt21:39:415
159099543119,126cyclictest0-21swapper/122:11:561
15949954231,338cyclictest0-21swapper/522:53:315
159499542120,87cyclictest121rcu_preempt21:56:255
15939954172,296cyclictest0-21swapper/422:52:444
15899954172,338cyclictest0-21swapper/023:29:390
15959954072,465cyclictest1587-21cyclictest21:13:316
15899954033,338cyclictest0-21swapper/000:16:260
15969953830,3cyclictest0-21swapper/721:53:287
15969953830,3cyclictest0-21swapper/721:53:287
15969953726,338cyclictest0-21swapper/722:12:227
15949953672,253cyclictest0-21swapper/522:35:575
15939953669,127cyclictest0-21swapper/423:29:394
15919953629,129cyclictest9426-21taskset21:07:452
159499535491,41cyclictest551rcuc/521:07:045
159099533276,126cyclictest0-21swapper/119:42:201
15919953122,84cyclictest9596-21diskmemload22:09:132
159299529106,212cyclictest28535-21rm22:14:083
15949952656,380cyclictest0-21swapper/523:28:555
15969952517,471cyclictest9596-21diskmemload00:07:387
159399525107,120cyclictest49-21ksoftirqd/422:38:404
159099525183,253cyclictest0-21swapper/122:37:511
15909952517,126cyclictest0-21swapper/123:31:121
15949952317,84cyclictest0-21swapper/500:35:465
15899952315,8cyclictest0-21swapper/021:06:420
15959952214,42cyclictest0-21swapper/621:59:026
15959952054,126cyclictest0-21swapper/622:24:176
15939952013,86cyclictest1587-21cyclictest00:35:294
1589995198,84cyclictest0-21swapper/021:15:220
15939951894,84cyclictest0-21swapper/422:59:524
1589995156,218cyclictest836-21sh21:40:140
15899951547,253cyclictest0-21swapper/021:10:440
1589995151,88cyclictest0-21swapper/023:08:380
1589995151,88cyclictest0-21swapper/023:08:380
1596995141,508cyclictest0-21swapper/723:10:157
159099514430,3cyclictest231rcuc/120:44:351
15939951345,295cyclictest0-21swapper/423:44:184
1593995132,338cyclictest0-21swapper/423:17:484
1590995132,338cyclictest0-21swapper/123:42:501
1591995125,42cyclictest0-21swapper/223:31:222
1596995111,507cyclictest0-21swapper/721:40:037
1596995111,507cyclictest0-21swapper/721:40:037
15919951145,126cyclictest0-21swapper/221:38:502
15919951145,126cyclictest0-21swapper/221:38:502
15949950983,211cyclictest57-21ksoftirqd/523:19:445
1594995090,84cyclictest8472-21chrt20:14:295
1594995080,83cyclictest0-21swapper/521:11:175
1593995080,84cyclictest0-21swapper/422:10:414
15909950882,211cyclictest25-21ksoftirqd/121:06:421
159499506123,296cyclictest0-21swapper/521:53:195
159499506123,296cyclictest0-21swapper/521:53:195
15939950681,422cyclictest0-21swapper/421:38:004
15939950681,422cyclictest0-21swapper/421:38:004
159399506122,169cyclictest121rcu_preempt21:15:574
15919950534,423cyclictest0-21swapper/223:28:542
159199505164,338cyclictest704-21nscd21:53:052
159199505164,338cyclictest704-21nscd21:53:052
159599504123,254cyclictest24616-21nscd22:36:496
15939950482,84cyclictest64450irq/122-eth020:40:334
159199504166,212cyclictest20562-21kworker/u16:100:08:452
15899950483,255cyclictest32004-21perf21:40:070
15899950483,255cyclictest32004-21perf21:40:070
158999504123,378cyclictest11396-21ssh22:59:580
15969950338,299cyclictest0-21swapper/723:29:487
15949950339,298cyclictest0-21swapper/522:56:565
15969950234,465cyclictest0-21swapper/720:42:447
15969950233,466cyclictest0-21swapper/720:15:127
159599502162,338cyclictest10226-21kworker/u16:221:15:306
159499502121,84cyclictest121rcu_preempt23:44:175
15929950179,338cyclictest0-21swapper/321:40:043
15929950179,338cyclictest0-21swapper/321:40:043
15929950136,299cyclictest0-21swapper/323:53:333
15959950036,380cyclictest0-21swapper/600:43:236
15959950034,212cyclictest629-21chrt22:33:356
15939950034,83cyclictest0-21swapper/421:13:014
15929949976,338cyclictest0-21swapper/321:40:143
15899949935,253cyclictest1587-21cyclictest23:45:020
15969949771,423cyclictest0-21swapper/721:16:047
15969949771,423cyclictest0-21swapper/719:41:097
15969949728,466cyclictest0-21swapper/700:44:497
159299497198,126cyclictest121rcu_preempt23:45:063
15919949630,126cyclictest22723-21runrttasks19:41:002
15919949629,127cyclictest15705-21ssh21:13:432
159099496113,380cyclictest0-21swapper/121:13:041
15959949530,298cyclictest0-21swapper/622:13:076
15919949570,126cyclictest0-21swapper/200:24:092
15939949429,126cyclictest0-21swapper/400:44:554
15909949126,126cyclictest121rcu_preempt00:44:041
15949949025,211cyclictest0-21swapper/522:33:535
15919949068,338cyclictest0-21swapper/221:40:142
159199490106,381cyclictest0-21swapper/223:44:542
15899949022,295cyclictest0-21swapper/000:44:550
15969948823,385cyclictest0-21swapper/723:39:417
159199488147,126cyclictest121rcu_preempt20:41:572
15939948766,84cyclictest0-21swapper/419:40:174
158999487404,3cyclictest111rcuc/020:41:470
159299486146,84cyclictest1587-21cyclictest21:56:143
15929948518,127cyclictest0-21swapper/321:11:393
15899948520,256cyclictest0-21swapper/023:00:080
159099484147,169cyclictest472-1kworker/u17:022:58:041
15959948218,211cyclictest0-21swapper/623:00:046
15939948218,2cyclictest0-21swapper/422:33:524
15929948115,84cyclictest0-21swapper/323:43:283
15919947914,126cyclictest32649-21rm00:35:582
15909947810,211cyclictest0-21swapper/100:07:401
15939947715,378cyclictest0-21swapper/422:49:304
1595994726,211cyclictest0-21swapper/620:12:166
15959947249,126cyclictest0-21swapper/600:35:446
15909947250,84cyclictest0-21swapper/123:10:031
15909947250,84cyclictest0-21swapper/123:10:031
1590994723,338cyclictest0-21swapper/122:49:031
1591994701,211cyclictest33-21ksoftirqd/221:59:082
1592994694,2cyclictest0-21swapper/322:57:373
1593994672,168cyclictest0-21swapper/423:09:444
1593994672,168cyclictest0-21swapper/423:09:444
159499466123,211cyclictest30933-21latency_hist23:10:045
159499466123,211cyclictest30933-21latency_hist23:10:045
15909946686,295cyclictest0-21swapper/100:16:121
15899946683,168cyclictest9-21ksoftirqd/023:45:230
159599465124,338cyclictest0-21swapper/622:50:426
159599465123,339cyclictest29378-21sh22:49:556
1593994651,84cyclictest9596-21diskmemload22:24:264
159299465122,210cyclictest41-21ksoftirqd/322:36:493
15959946485,296cyclictest0-21swapper/600:08:466
15959946441,256cyclictest0-21swapper/622:09:286
159599464123,338cyclictest0-21swapper/622:56:596
159199464123,338cyclictest0-21swapper/222:49:142
159099464124,337cyclictest0-21swapper/100:35:541
15959946382,214cyclictest7015-21ssh23:30:476
159599463120,340cyclictest27468-21ssh00:16:196
159299463123,338cyclictest472-1kworker/u17:022:54:223
15899946341,255cyclictest0-21swapper/020:13:230
15959946239,256cyclictest0-21swapper/623:29:046
15899946239,168cyclictest0-21swapper/022:49:470
15929946139,257cyclictest0-21swapper/322:00:243
15929946139,255cyclictest0-21swapper/320:42:153
15969946038,2cyclictest0-21swapper/723:56:467
15969946038,2cyclictest0-21swapper/723:56:467
15929946080,169cyclictest0-21swapper/300:35:593
15899946080,84cyclictest0-21swapper/023:53:070
159399459118,338cyclictest0-21swapper/421:54:054
159399459118,338cyclictest0-21swapper/421:54:054
15899945934,379cyclictest0-21swapper/000:07:590
158999459118,338cyclictest0-21swapper/019:40:220
15939945836,45cyclictest0-21swapper/421:06:434
15899945837,302cyclictest0-21swapper/023:20:020
159499457116,338cyclictest0-21swapper/523:53:245
15939945774,380cyclictest0-21swapper/423:20:114
15929945772,211cyclictest41-21ksoftirqd/319:44:433
15919945735,84cyclictest0-21swapper/223:18:592
15959945675,296cyclictest0-21swapper/621:53:386
15959945675,296cyclictest0-21swapper/621:53:386
15959945634,256cyclictest0-21swapper/619:42:186
15949945672,338cyclictest0-21swapper/523:57:045
15949945672,338cyclictest0-21swapper/523:57:045
15949945635,255cyclictest0-21swapper/500:43:565
15949945634,169cyclictest1651-21ntpd23:31:315
159499456116,338cyclictest0-21swapper/522:00:165
15919945634,256cyclictest0-21swapper/223:45:222
159499455115,338cyclictest0-21swapper/500:07:525
159199455116,84cyclictest0-21swapper/222:24:532
15969945474,42cyclictest121rcu_preempt21:40:267
15929945432,256cyclictest0-21swapper/300:07:463
15969945327,423cyclictest0-21swapper/722:49:287
15929945369,338cyclictest0-21swapper/323:57:033
15929945369,338cyclictest0-21swapper/323:57:033
158999453114,84cyclictest0-21swapper/020:15:130
15949945231,2cyclictest0-21swapper/522:09:455
15929945230,338cyclictest0-21swapper/322:24:583
15929945229,257cyclictest0-21swapper/322:09:463
159199452111,338cyclictest0-21swapper/222:33:252
15899945230,256cyclictest0-21swapper/000:35:310
15929945171,296cyclictest0-21swapper/300:16:123
15959945066,338cyclictest0-21swapper/623:57:046
15959945066,338cyclictest0-21swapper/623:57:046
15949945028,83cyclictest0-21swapper/519:40:185
159399450109,338cyclictest0-21swapper/400:23:244
15929945028,338cyclictest303-21systemd-journal00:35:013
15939944965,80cyclictest0-21swapper/421:40:154
15929944969,296cyclictest0-21swapper/322:34:583
15929944927,256cyclictest0-21swapper/300:23:233
15949944869,295cyclictest0-21swapper/500:35:005
15939944826,84cyclictest0-21swapper/423:30:264
15929944824,84cyclictest0-21swapper/323:09:023
15929944824,84cyclictest0-21swapper/323:09:023
15909944724,211cyclictest1587-21cyclictest00:02:401
15969944620,126cyclictest0-21swapper/700:23:047
159499446105,338cyclictest0-21swapper/522:49:055
159299446193,84cyclictest401ktimersoftd/323:00:043
15899944623,127cyclictest0-21swapper/022:25:050
15969944565,296cyclictest0-21swapper/700:16:117
15899944523,2cyclictest0-21swapper/022:33:340
15899944523,255cyclictest0-21swapper/023:10:090
15949944421,256cyclictest0-21swapper/521:16:045
15929944418,211cyclictest121rcu_preempt23:29:023
159299444102,126cyclictest121rcu_preempt23:31:093
15909944461,211cyclictest0-21swapper/123:00:041
15899944461,211cyclictest0-21swapper/022:00:280
159699443103,338cyclictest0-21swapper/723:52:497
15919944315,211cyclictest0-21swapper/220:14:002
159199443100,340cyclictest0-21swapper/221:15:162
15969944220,256cyclictest0-21swapper/723:45:207
15919944219,256cyclictest0-21swapper/222:00:062
15909944218,84cyclictest0-21swapper/123:28:551
15899944221,127cyclictest9-21ksoftirqd/022:09:270
15959944161,296cyclictest0-21swapper/621:38:296
15959944161,296cyclictest0-21swapper/621:38:296
159399441101,337cyclictest0-21swapper/400:02:534
15939944059,84cyclictest0-21swapper/423:57:034
15939944059,84cyclictest0-21swapper/423:57:024
159199440100,338cyclictest0-21swapper/223:52:502
15909944018,4cyclictest0-21swapper/123:53:251
15949943817,257cyclictest0-21swapper/522:23:435
15939943858,84cyclictest0-21swapper/423:53:084
15939943816,255cyclictest0-21swapper/420:11:324
15919943816,256cyclictest0-21swapper/222:25:062
15959943797,338cyclictest0-21swapper/621:08:506
15939943716,2cyclictest0-21swapper/422:09:104
15929943754,210cyclictest0-21swapper/323:19:433
15919943796,338cyclictest0-21swapper/200:16:192
15939943454,84cyclictest0-21swapper/423:00:094
15939943354,42cyclictest0-21swapper/400:35:004
159099433394,3cyclictest231rcuc/120:45:161
1596994329,256cyclictest0-21swapper/700:34:297
15969943210,338cyclictest0-21swapper/722:34:147
1590994329,3cyclictest0-21swapper/122:33:531
15909943148,211cyclictest0-21swapper/123:19:441
159099428345,2cyclictest231rcuc/120:14:431
15949942642,211cyclictest57-21ksoftirqd/521:40:155
159099426169,84cyclictest121rcu_preempt23:45:071
1595994253,84cyclictest0-21swapper/623:19:106
1593994250,82cyclictest121rcu_preempt22:00:134
15969942483,338cyclictest0-21swapper/722:15:057
15929942483,339cyclictest0-21swapper/321:08:563
159199424167,84cyclictest121rcu_preempt00:44:482
15899942440,84cyclictest0-21swapper/000:02:390
15959942382,338cyclictest0-21swapper/623:09:316
15959942382,338cyclictest0-21swapper/623:09:306
1595994231,256cyclictest0-21swapper/600:02:396
15909942382,338cyclictest0-21swapper/121:15:221
1589994231,256cyclictest0-21swapper/000:34:290
15899942281,338cyclictest0-21swapper/000:23:340
15959942181,338cyclictest0-21swapper/600:34:366
15919942141,296cyclictest0-21swapper/220:45:112
15959942079,338cyclictest0-21swapper/622:25:036
15919942040,296cyclictest0-21swapper/223:56:472
15919942040,296cyclictest0-21swapper/223:56:472
15969941979,338cyclictest0-21swapper/722:25:037
15969941978,338cyclictest0-21swapper/700:35:457
15949941935,3cyclictest0-21swapper/500:17:075
15919941979,338cyclictest0-21swapper/223:00:052
15909941878,338cyclictest0-21swapper/121:40:151
15919941738,295cyclictest0-21swapper/223:10:072
15899941733,303cyclictest0-21swapper/023:57:040
15899941733,303cyclictest0-21swapper/023:57:030
15949941636,3cyclictest0-21swapper/523:10:165
15969941573,338cyclictest0-21swapper/723:19:287
15899941535,296cyclictest0-21swapper/020:45:100
15969941473,339cyclictest0-21swapper/723:00:047
15939941475,84cyclictest0-21swapper/423:10:154
15959941372,338cyclictest0-21swapper/623:10:146
15929941272,338cyclictest0-21swapper/320:15:143
15949941169,339cyclictest0-21swapper/523:00:065
15939941127,84cyclictest0-21swapper/422:25:154
15929941170,338cyclictest0-21swapper/322:49:043
15919941171,338cyclictest0-21swapper/200:34:272
15919941128,126cyclictest0-21swapper/220:15:032
15899941069,338cyclictest0-21swapper/022:40:030
15899941069,338cyclictest0-21swapper/022:40:020
15929940969,338cyclictest0-21swapper/322:25:033
15929940969,338cyclictest0-21swapper/320:45:073
15949940823,126cyclictest0-21swapper/520:44:255
159499408109,296cyclictest0-21swapper/522:25:055
15899940828,296cyclictest0-21swapper/020:30:070
15949940765,339cyclictest0-21swapper/522:40:025
15949940765,339cyclictest0-21swapper/522:40:025
159599406111,211cyclictest187-21md0_raid120:45:066
15949940564,126cyclictest0-21swapper/523:45:265
15949940526,168cyclictest57-21ksoftirqd/500:23:585
15909940525,42cyclictest121rcu_preempt23:20:161
15949940463,338cyclictest0-21swapper/523:39:425
15949940463,338cyclictest0-21swapper/520:45:165
15939940466,84cyclictest0-21swapper/420:45:124
15899940424,210cyclictest0-21swapper/023:39:430
15929940059,338cyclictest0-21swapper/322:40:023
15929940059,338cyclictest0-21swapper/322:40:023
15929939919,296cyclictest0-21swapper/323:10:083
15939939860,84cyclictest0-21swapper/422:40:024
15939939860,84cyclictest0-21swapper/422:40:024
15919939858,338cyclictest0-21swapper/223:39:412
15909939859,84cyclictest0-21swapper/100:34:371
15929939617,168cyclictest9596-21diskmemload23:39:413
15959939410,84cyclictest121rcu_preempt00:23:036
15909939453,168cyclictest0-21swapper/120:15:011
15959939251,338cyclictest0-21swapper/623:45:266
15939939253,84cyclictest0-21swapper/423:39:434
15909939215,82cyclictest0-21swapper/122:40:031
15909939215,82cyclictest0-21swapper/122:40:031
15929937877,169cyclictest41-21ksoftirqd/300:02:513
15959937638,256cyclictest0-21swapper/621:40:146
15959937634,339cyclictest0-21swapper/622:40:036
15959937634,339cyclictest0-21swapper/622:40:026
15919937432,296cyclictest0-21swapper/200:02:382
15909937437,3cyclictest0-21swapper/123:10:091
15969937337,333cyclictest0-21swapper/723:20:157
159699372200,84cyclictest0-21swapper/700:02:397
15909937233,84cyclictest0-21swapper/122:25:021
159599369112,84cyclictest121rcu_preempt23:20:156
15909936932,50cyclictest22142-21ssh23:56:471
15909936932,50cyclictest22142-21ssh23:56:471
15919936830,170cyclictest0-21swapper/223:20:152
159099365192,84cyclictest0-21swapper/123:39:471
15969936325,253cyclictest0-21swapper/722:40:027
15969936325,253cyclictest0-21swapper/722:40:027
15919936119,339cyclictest0-21swapper/222:40:032
15919936119,339cyclictest0-21swapper/222:40:022
15929935758,296cyclictest0-21swapper/323:20:143
15909935519,170cyclictest25-21ksoftirqd/120:30:061
15899935053,84cyclictest0-21swapper/023:20:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional