You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-03 - 22:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Mon Aug 03, 2026 12:55:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
323209971375,635cyclictest0-21swapper/710:29:187
323139971034,3cyclictest0-21swapper/009:21:130
3231499701190,295cyclictest0-21swapper/109:22:351
323209967681,592cyclictest24337-21taskset09:19:167
32320996731,669cyclictest0-21swapper/711:07:487
32320996731,669cyclictest0-21swapper/711:07:477
32313996350,84cyclictest0-21swapper/011:31:130
3231999630162,465cyclictest15273-21runrttasks07:34:256
323209962882,374cyclictest0-21swapper/711:30:077
323209962373,84cyclictest0-21swapper/712:42:197
323159962326,126cyclictest0-21swapper/207:55:262
323159962326,126cyclictest0-21swapper/207:55:252
3231699620109,508cyclictest0-21swapper/309:35:013
323149962069,126cyclictest0-21swapper/110:17:541
323139962068,295cyclictest0-21swapper/010:10:160
323169961667,126cyclictest0-21swapper/309:16:583
323209961015,592cyclictest0-21swapper/711:42:417
32320996038,592cyclictest0-21swapper/709:20:537
323159960292,507cyclictest0-21swapper/207:43:022
32317995940,85cyclictest0-21swapper/409:22:454
32320995930,84cyclictest0-21swapper/711:14:337
32317995930,84cyclictest23520-21ssh11:42:134
323139959080,211cyclictest21070-21sshd07:41:540
3231799589163,296cyclictest22176-21ssh10:27:204
323209958877,380cyclictest0-21swapper/710:37:357
323159958734,380cyclictest0-21swapper/211:13:412
323159958534,127cyclictest0-21swapper/211:23:392
323149958532,126cyclictest0-21swapper/110:50:351
3231399585121,253cyclictest0-21swapper/011:21:450
323159958473,338cyclictest0-21swapper/212:36:242
3231999583157,423cyclictest4623-21sh11:11:506
323209958027,126cyclictest0-21swapper/707:17:417
3231399577279,126cyclictest0-21swapper/008:20:460
3231399576192,211cyclictest9-21ksoftirqd/009:19:490
323199957521,339cyclictest0-21swapper/611:44:096
323159957523,127cyclictest0-21swapper/209:18:042
323199957425,338cyclictest0-21swapper/611:29:556
323159957363,507cyclictest0-21swapper/209:22:372
3231899572104,295cyclictest0-21swapper/510:54:355
323199957121,126cyclictest0-21swapper/611:57:336
323209956957,509cyclictest0-21swapper/711:35:177
3232099569101,465cyclictest0-21swapper/711:24:107
323199956514,84cyclictest0-21swapper/607:58:086
323199956514,84cyclictest0-21swapper/607:58:076
323159956557,84cyclictest0-21swapper/210:54:342
323199956410,380cyclictest0-21swapper/609:31:056
323169956395,296cyclictest20772-21ssh10:25:463
323149956355,126cyclictest121rcu_preempt07:57:091
323149956355,126cyclictest121rcu_preempt07:57:091
323209956253,126cyclictest0-21swapper/712:16:427
323179956213,338cyclictest0-21swapper/411:30:014
323159956213,43cyclictest20969-21ssh12:16:562
323149956251,380cyclictest0-21swapper/107:31:201
323139956112,127cyclictest0-21swapper/010:50:460
323199956090,381cyclictest7865-21diskmemload11:50:426
32315995599,126cyclictest0-21swapper/211:50:422
323139955446,126cyclictest0-21swapper/007:35:140
3231799553128,253cyclictest0-21swapper/407:32:314
323139955389,177cyclictest0-21swapper/008:30:230
323209955285,84cyclictest0-21swapper/712:11:127
323209955240,509cyclictest0-21swapper/711:45:347
323209955240,509cyclictest0-21swapper/711:45:347
323209955240,509cyclictest0-21swapper/711:45:347
32315995521,126cyclictest0-21swapper/208:20:502
32313995524,41cyclictest2911-21munin-node12:13:050
32317995510,84cyclictest64450irq/122-eth009:15:534
3231599551124,296cyclictest0-21swapper/212:13:442
32315995511,126cyclictest8449-21rm11:35:002
32314995510,84cyclictest0-21swapper/109:15:531
323199954937,338cyclictest0-21swapper/609:17:556
323189954880,299cyclictest0-21swapper/509:24:455
323209954780,127cyclictest0-21swapper/709:33:187
323149954679,295cyclictest32527-21apt-get09:25:111
323169954576,211cyclictest41-21ksoftirqd/310:52:423
323199954475,338cyclictest0-21swapper/609:25:006
323199954433,508cyclictest0-21swapper/607:43:016
323189954436,84cyclictest0-21swapper/508:30:195
323149954433,338cyclictest0-21swapper/110:26:471
323139954435,127cyclictest20870-21ssh10:25:540
3232099541455,84cyclictest73-21ksoftirqd/707:57:247
3232099541455,84cyclictest73-21ksoftirqd/707:57:247
3231999541118,381cyclictest0-21swapper/611:34:596
323189954071,380cyclictest7865-21diskmemload10:16:015
3231499540118,41cyclictest121rcu_preempt09:30:451
323179953974,211cyclictest0-21swapper/411:57:374
3231399539160,126cyclictest1553-21runrttasks10:15:450
3231899537281,126cyclictest0-21swapper/509:35:075
323159953728,126cyclictest0-21swapper/207:32:312
3232099536157,375cyclictest698-21ptp4l08:20:587
3231899535280,253cyclictest561ktimersoftd/511:12:475
323149953365,84cyclictest0-21swapper/111:30:281
323159953224,84cyclictest121rcu_preempt10:37:362
323209952918,508cyclictest0-21swapper/710:51:337
3231799525440,83cyclictest471rcuc/412:13:224
3231999524270,84cyclictest641ktimersoftd/610:17:246
323179952412,126cyclictest14296-21ssh09:32:174
323209952312,508cyclictest0-21swapper/707:34:267
323199952314,84cyclictest0-21swapper/610:26:566
323209952212,507cyclictest0-21swapper/707:43:017
323169952214,42cyclictest0-21swapper/311:21:453
323159952253,296cyclictest0-21swapper/212:24:222
323159952113,84cyclictest121rcu_preempt09:25:112
3231999520140,211cyclictest704-21nscd11:02:236
32314995209,295cyclictest0-21swapper/111:50:301
323149951910,85cyclictest0-21swapper/112:11:591
323159951548,126cyclictest0-21swapper/209:31:062
323149951488,254cyclictest121rcu_preempt11:24:581
323179951286,296cyclictest7865-21diskmemload12:15:594
323149951288,127cyclictest0-21swapper/112:24:441
3231399511127,211cyclictest0-21swapper/011:13:220
32317995102,126cyclictest0-21swapper/410:30:254
32317995090,84cyclictest0-21swapper/412:41:574
32315995090,84cyclictest0-21swapper/210:17:532
323169950882,211cyclictest0-21swapper/312:41:413
3231499507123,169cyclictest25306-21ssh11:25:081
32313995071,84cyclictest8288-21sh10:37:460
323209950583,84cyclictest0-21swapper/710:17:377
3231899505121,211cyclictest27329-21kworker/u16:111:30:085
323179950582,84cyclictest121rcu_preempt11:50:314
323159950536,296cyclictest0-21swapper/208:30:272
3231499505250,253cyclictest241ktimersoftd/110:38:371
3232099504123,169cyclictest0-21swapper/711:57:337
323189950476,211cyclictest0-21swapper/512:06:535
3231999503119,254cyclictest0-21swapper/607:35:036
323179950381,218cyclictest5415-21kworker/4:007:43:254
3231599503123,84cyclictest0-21swapper/209:35:102
323139950340,252cyclictest0-21swapper/009:33:030
323139950339,84cyclictest0-21swapper/011:58:180
323139950335,84cyclictest0-21swapper/007:56:590
323139950335,84cyclictest0-21swapper/007:56:580
323209950233,466cyclictest0-21swapper/712:25:147
323159950034,126cyclictest0-21swapper/212:06:502
323149950036,298cyclictest0-21swapper/107:40:501
323209949973,423cyclictest0-21swapper/710:10:167
323199949979,290cyclictest121rcu_preempt10:39:256
323149949828,211cyclictest27502-21ssh09:40:141
3231399498417,79cyclictest111rcuc/011:07:040
3231399498417,79cyclictest111rcuc/011:07:040
323189949774,126cyclictest28850-21ssh11:07:145
323189949774,126cyclictest28850-21ssh11:07:145
3231699497240,126cyclictest23081-21interrupts07:45:203
3231499497207,160cyclictest18012-21needreboot08:30:281
323209949429,255cyclictest0-21swapper/709:25:107
323199949427,84cyclictest0-21swapper/610:54:526
323179949430,84cyclictest0-21swapper/410:38:134
3231699494238,253cyclictest401ktimersoftd/310:10:163
323159949429,296cyclictest0-21swapper/210:29:172
323189949328,84cyclictest0-21swapper/507:35:165
323179949328,83cyclictest121rcu_preempt11:24:114
3231599493113,84cyclictest0-21swapper/211:06:482
3231599493113,84cyclictest0-21swapper/211:06:482
323179949227,83cyclictest121rcu_preempt07:45:214
323159949228,2cyclictest0-21swapper/210:10:212
323139949224,253cyclictest0-21swapper/007:15:570
323189949168,84cyclictest0-21swapper/511:23:405
323149949165,380cyclictest0-21swapper/107:45:211
323169948961,212cyclictest0-21swapper/312:06:513
3231699488145,126cyclictest121rcu_preempt09:24:473
323179948721,84cyclictest0-21swapper/410:15:374
323159948722,338cyclictest0-21swapper/211:49:542
323159948722,338cyclictest0-21swapper/211:49:542
323159948722,338cyclictest0-21swapper/211:49:542
323149948721,211cyclictest0-21swapper/111:11:041
323199948663,85cyclictest121rcu_preempt08:30:246
323199948617,339cyclictest0-21swapper/612:12:176
323189948663,84cyclictest0-21swapper/509:35:015
323179948662,338cyclictest0-21swapper/407:15:544
323139948515,262cyclictest0-21swapper/012:16:560
323209948416,465cyclictest0-21swapper/710:55:027
3231499484101,126cyclictest25-21ksoftirqd/111:43:521
323199948317,126cyclictest29072-21taskset11:07:296
323199948317,126cyclictest29072-21taskset11:07:296
323169948316,211cyclictest0-21swapper/311:50:003
323169948316,211cyclictest0-21swapper/311:50:003
323199948254,339cyclictest121rcu_preempt12:16:336
3231799481141,338cyclictest64450irq/122-eth008:20:584
323159948012,380cyclictest0-21swapper/211:44:092
323189947914,41cyclictest0-21swapper/509:17:455
323169947812,211cyclictest0-21swapper/311:13:503
32317994759,84cyclictest0-21swapper/411:11:504
32315994734,296cyclictest121rcu_preempt09:40:212
32315994712,338cyclictest0-21swapper/211:57:332
32315994705,3cyclictest0-21swapper/212:25:182
323179946846,84cyclictest0-21swapper/411:02:064
32317994683,126cyclictest0-21swapper/411:35:024
3231399468169,126cyclictest121rcu_preempt11:43:490
323189946745,84cyclictest0-21swapper/511:50:025
32313994671,84cyclictest0-21swapper/007:34:250
32320994661,168cyclictest0-21swapper/707:35:217
323169946684,127cyclictest0-21swapper/308:20:313
3232099465125,85cyclictest0-21swapper/712:24:217
3231899465124,338cyclictest2826-21cstates12:25:185
3231899465122,84cyclictest121rcu_preempt07:44:085
32317994651,92cyclictest0-21swapper/411:49:574
32317994651,92cyclictest0-21swapper/411:49:564
32317994651,92cyclictest0-21swapper/411:49:564
3231799465124,339cyclictest0-21swapper/411:07:354
3231799465124,339cyclictest0-21swapper/411:07:344
3231799465124,338cyclictest0-21swapper/407:55:394
3231799465124,338cyclictest0-21swapper/407:55:394
3231599465125,338cyclictest0-21swapper/211:35:172
32314994651,84cyclictest0-21swapper/111:49:551
32314994651,84cyclictest0-21swapper/111:49:551
32314994651,84cyclictest0-21swapper/111:49:551
3231899464124,126cyclictest7865-21diskmemload12:16:585
3231899464123,339cyclictest25070-21ssh11:43:375
32317994641,7cyclictest0-21swapper/408:30:244
3231699464168,84cyclictest5791-21nscd11:30:573
3231699464123,339cyclictest0-21swapper/310:16:123
323159946382,84cyclictest0-21swapper/207:15:332
323209946240,255cyclictest0-21swapper/708:30:237
323149946238,126cyclictest0-21swapper/112:16:561
3231399462124,126cyclictest0-21swapper/009:40:240
323169946177,381cyclictest0-21swapper/310:38:373
323139946177,253cyclictest0-21swapper/012:06:500
3231399461120,338cyclictest0-21swapper/011:29:550
323209946034,126cyclictest0-21swapper/711:29:327
323199946081,338cyclictest0-21swapper/612:24:466
323199946038,219cyclictest0-21swapper/611:21:526
3231699460164,84cyclictest704-21nscd11:07:433
3231699460164,84cyclictest704-21nscd11:07:423
3231599460120,338cyclictest0-21swapper/211:30:002
3231399460120,338cyclictest0-21swapper/011:02:580
323209945930,381cyclictest0-21swapper/707:45:187
323199945974,126cyclictest121rcu_preempt10:10:166
323179945977,380cyclictest0-21swapper/410:54:064
323169945979,296cyclictest0-21swapper/311:50:023
323149945937,256cyclictest0-21swapper/111:57:331
3231399459119,168cyclictest30087-21grep08:50:160
323169945873,211cyclictest0-21swapper/311:29:283
3231699458116,339cyclictest0-21swapper/312:00:173
323199945733,211cyclictest0-21swapper/607:15:296
3231999457117,338cyclictest0-21swapper/607:45:196
3231699457117,338cyclictest0-21swapper/309:25:143
323189945633,127cyclictest121rcu_preempt12:24:535
3231899456115,338cyclictest0-21swapper/511:57:305
3231699456114,339cyclictest303-21systemd-journal07:35:153
3231599456115,338cyclictest0-21swapper/212:00:142
3231399456115,126cyclictest9-21ksoftirqd/009:25:110
3231999455116,84cyclictest3891-21sh12:06:506
3231999455114,338cyclictest0-21swapper/611:50:006
3231999455114,338cyclictest0-21swapper/611:50:006
3231999455114,338cyclictest0-21swapper/611:50:006
3231899455324,84cyclictest0-21swapper/507:56:235
3231899455324,84cyclictest0-21swapper/507:56:225
323209945431,168cyclictest0-21swapper/709:35:047
3231999454115,84cyclictest0-21swapper/608:25:016
3231799454155,126cyclictest121rcu_preempt08:00:144
323159945431,256cyclictest0-21swapper/209:55:292
3231399454114,338cyclictest7838-21/usr/sbin/munin07:20:160
3231399454113,126cyclictest10152-21awk11:35:180
323159945332,83cyclictest0-21swapper/212:41:572
323149945329,85cyclictest0-21swapper/109:35:211
323139945331,84cyclictest0-21swapper/012:24:450
323199945230,256cyclictest0-21swapper/612:25:176
3231999452111,211cyclictest4079-21sh12:42:216
323189945268,84cyclictest121rcu_preempt07:17:535
3231699451111,338cyclictest0-21swapper/312:12:003
3231599451112,84cyclictest0-21swapper/211:02:332
3231499451152,126cyclictest121rcu_preempt08:21:441
323199945029,253cyclictest0-21swapper/609:40:246
3231999450113,335cyclictest0-21swapper/612:00:076
3231899448367,78cyclictest551rcuc/510:26:025
3231699448107,338cyclictest19501-21taskset11:58:163
323189944763,211cyclictest57-21ksoftirqd/508:25:085
323169944721,423cyclictest0-21swapper/309:35:103
323189944666,84cyclictest0-21swapper/512:12:335
323139944623,84cyclictest0-21swapper/012:25:160
323169944523,256cyclictest0-21swapper/311:49:373
3231599445105,338cyclictest0-21swapper/207:45:142
323169944421,256cyclictest0-21swapper/308:30:233
323149944418,211cyclictest0-21swapper/109:55:361
3231999443187,254cyclictest641ktimersoftd/609:35:046
323189944217,295cyclictest0-21swapper/511:25:165
323149944262,296cyclictest0-21swapper/111:02:071
323169944119,256cyclictest0-21swapper/307:40:193
323209943998,84cyclictest0-21swapper/709:13:367
323149943955,211cyclictest3861-21ssh12:42:061
323189943814,84cyclictest0-21swapper/507:34:255
323169943897,338cyclictest0-21swapper/309:40:213
323159943855,84cyclictest27001-21mailstats10:30:222
323159943815,219cyclictest0-21swapper/210:55:012
323149943816,255cyclictest0-21swapper/107:16:031
323149943815,257cyclictest0-21swapper/111:08:151
323149943815,257cyclictest0-21swapper/111:08:151
323189943796,338cyclictest0-21swapper/510:38:175
323189943756,84cyclictest0-21swapper/511:50:015
323169943796,338cyclictest12735-21/usr/sbin/munin07:30:213
323179943695,338cyclictest0-21swapper/410:10:224
323209943556,295cyclictest0-21swapper/711:50:027
32319994358,253cyclictest0-21swapper/610:30:236
323199943513,298cyclictest15864-21ssh09:13:436
323139943450,211cyclictest0-21swapper/009:35:100
323189943291,169cyclictest0-21swapper/511:49:575
323189943291,169cyclictest0-21swapper/511:49:575
32314994307,338cyclictest0-21swapper/112:25:151
3231499427254,84cyclictest121rcu_preempt12:06:471
32315994251,127cyclictest0-21swapper/207:35:032
323209942483,338cyclictest0-21swapper/708:51:187
323189942483,338cyclictest0-21swapper/512:00:275
32316994242,255cyclictest0-21swapper/312:25:173
323139942482,213cyclictest0-21swapper/012:00:270
323209942382,338cyclictest0-21swapper/712:06:527
323189942383,338cyclictest0-21swapper/512:32:115
323189942382,338cyclictest0-21swapper/508:50:165
323179942383,337cyclictest0-21swapper/412:24:224
323169942385,336cyclictest0-21swapper/312:17:123
323169942383,338cyclictest0-21swapper/311:42:563
32316994231,83cyclictest0-21swapper/307:58:503
32316994231,83cyclictest0-21swapper/307:58:503
323149942383,338cyclictest0-21swapper/108:51:181
32313994231,44cyclictest0-21swapper/012:41:580
323199942241,296cyclictest0-21swapper/611:35:196
323189942280,211cyclictest57-21ksoftirqd/511:35:095
323169942281,338cyclictest0-21swapper/312:32:113
3231699422124,169cyclictest1226-21ssh12:24:203
323159942282,85cyclictest0-21swapper/208:00:132
323139942281,338cyclictest0-21swapper/007:45:150
323209942140,297cyclictest0-21swapper/711:02:277
323189942180,338cyclictest0-21swapper/510:10:165
323169942181,338cyclictest0-21swapper/307:15:283
323209942081,84cyclictest0-21swapper/712:00:187
323199942079,338cyclictest0-21swapper/609:55:256
323189942079,338cyclictest0-21swapper/508:24:295
323199941979,338cyclictest0-21swapper/608:00:136
323179941979,338cyclictest0-21swapper/409:25:144
323169941978,338cyclictest0-21swapper/311:35:083
323209941833,382cyclictest0-21swapper/712:36:297
323209941833,127cyclictest0-21swapper/712:32:117
323179941877,338cyclictest0-21swapper/407:20:164
323179941876,339cyclictest0-21swapper/409:40:244
323169941877,338cyclictest0-21swapper/310:30:163
323209941734,126cyclictest0-21swapper/709:03:417
3231899417118,126cyclictest1551-21snmpd08:07:395
323179941776,338cyclictest0-21swapper/412:25:174
323169941777,338cyclictest0-21swapper/311:02:273
323149941776,338cyclictest0-21swapper/108:07:391
323179941676,338cyclictest0-21swapper/409:35:034
323149941676,338cyclictest0-21swapper/107:35:141
323209941574,338cyclictest0-21swapper/707:20:167
323189941573,211cyclictest57-21ksoftirqd/510:30:235
323189941429,211cyclictest0-21swapper/511:02:585
323139941472,126cyclictest9-21ksoftirqd/010:55:020
323209941332,254cyclictest0-21swapper/710:30:167
323199941375,84cyclictest0-21swapper/608:50:176
323139941333,7cyclictest121rcu_preempt11:49:290
323139941333,7cyclictest121rcu_preempt11:49:290
323139941333,7cyclictest121rcu_preempt11:49:290
323189941270,339cyclictest0-21swapper/507:20:175
323149941273,337cyclictest0-21swapper/112:36:241
323149941171,338cyclictest0-21swapper/107:20:161
323139941174,168cyclictest9-21ksoftirqd/008:56:580
323189941072,84cyclictest0-21swapper/512:42:235
323159941030,296cyclictest0-21swapper/208:50:172
323149940970,337cyclictest0-21swapper/110:10:221
323199940867,338cyclictest0-21swapper/612:32:116
323179940829,126cyclictest0-21swapper/407:35:074
323209940765,339cyclictest0-21swapper/709:55:367
323159940767,338cyclictest0-21swapper/209:13:362
323209940665,338cyclictest0-21swapper/708:07:397
323199940626,211cyclictest0-21swapper/609:25:106
323189940667,84cyclictest0-21swapper/509:25:125
323189940567,83cyclictest0-21swapper/509:40:145
323159940465,84cyclictest0-21swapper/209:03:402
323189940364,85cyclictest30833-21chrt08:00:135
323149940323,296cyclictest0-21swapper/111:35:191
323149940323,213cyclictest7865-21diskmemload12:00:141
323209940263,84cyclictest28947-21ntpq09:40:237
323189940264,84cyclictest0-21swapper/509:13:445
323159940263,84cyclictest0-21swapper/207:20:162
323139940223,212cyclictest0-21swapper/010:30:160
323189940162,84cyclictest0-21swapper/512:36:245
323179940160,338cyclictest0-21swapper/412:06:514
323179939857,338cyclictest0-21swapper/412:00:264
323179939857,338cyclictest0-21swapper/409:55:304
323169939857,210cyclictest0-21swapper/308:51:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional