You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-01 - 14:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue Sep 01, 2026 12:53:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
201899989083,804cyclictest0-21swapper/709:58:237
201899989083,804cyclictest0-21swapper/709:58:237
201899966570,592cyclictest0-21swapper/709:46:027
201899965197,296cyclictest0-21swapper/707:53:367
201899965197,296cyclictest0-21swapper/707:53:367
201829964853,126cyclictest21313-21ssh09:57:350
201829964853,126cyclictest21313-21ssh09:57:350
2018599643598,42cyclictest391rcuc/311:12:133
201899963034,593cyclictest0-21swapper/711:05:447
2018799622111,338cyclictest0-21swapper/509:24:355
201889961625,338cyclictest0-21swapper/610:54:516
201889961625,338cyclictest0-21swapper/610:54:516
201889961014,381cyclictest0-21swapper/610:55:366
20189995961,550cyclictest0-21swapper/711:13:147
20184995930,84cyclictest0-21swapper/211:12:412
201899958331,549cyclictest711rcuc/710:37:397
201849957824,211cyclictest33-21ksoftirqd/210:54:142
201849957824,211cyclictest33-21ksoftirqd/210:54:132
201869957765,380cyclictest0-21swapper/410:15:454
201869957565,261cyclictest121rcu_preempt10:49:394
2018399571272,127cyclictest0-21swapper/110:59:321
201839957123,337cyclictest0-21swapper/110:20:191
201839957123,337cyclictest0-21swapper/110:20:191
201899956956,381cyclictest0-21swapper/712:30:267
2018399568101,465cyclictest0-21swapper/110:49:041
201859956615,84cyclictest0-21swapper/309:40:213
2018699561478,4cyclictest481ktimersoftd/410:55:074
2018599560138,257cyclictest704-21nscd10:15:193
20189995587,41cyclictest0-21swapper/709:21:007
20189995551,42cyclictest0-21swapper/710:57:067
2018999552129,211cyclictest0-21swapper/712:18:387
201879954980,296cyclictest0-21swapper/511:04:595
2018499549211,84cyclictest121rcu_preempt10:16:442
2018699547248,126cyclictest0-21swapper/410:51:564
2018699547248,126cyclictest0-21swapper/410:51:564
201889954538,381cyclictest0-21swapper/610:17:046
2018299545287,127cyclictest12975-21kworker/u16:210:35:370
201879954478,126cyclictest0-21swapper/510:27:595
2018699543121,255cyclictest64450irq/122-eth010:20:144
2018699543121,255cyclictest64450irq/122-eth010:20:144
201849954374,296cyclictest0-21swapper/211:45:152
201829954172,338cyclictest0-21swapper/010:28:000
201899954033,423cyclictest13476-21ssh10:28:587
201869954035,303cyclictest0-21swapper/412:11:114
201889953928,380cyclictest0-21swapper/609:30:316
201879953933,84cyclictest121rcu_preempt10:19:485
2018399537118,122cyclictest516-21taskset09:45:461
201829953734,129cyclictest0-21swapper/011:11:440
201879953424,422cyclictest0-21swapper/509:58:455
201879953424,422cyclictest0-21swapper/509:58:445
201829953325,84cyclictest0-21swapper/011:05:450
201829953123,84cyclictest0-21swapper/010:17:190
201829953120,169cyclictest9-21ksoftirqd/010:00:140
201849953022,262cyclictest0-21swapper/209:33:492
201899952961,465cyclictest0-21swapper/710:49:047
201859952921,126cyclictest0-21swapper/309:57:353
201859952921,126cyclictest0-21swapper/309:57:353
201829952656,211cyclictest0-21swapper/009:47:520
201859952315,296cyclictest0-21swapper/309:53:293
201879952254,340cyclictest0-21swapper/512:09:545
201899952052,465cyclictest0-21swapper/711:01:127
20189995199,507cyclictest0-21swapper/711:30:067
2018699519179,338cyclictest64450irq/122-eth009:21:034
20185995179,256cyclictest0-21swapper/310:20:143
20185995179,256cyclictest0-21swapper/310:20:133
20189995143,42cyclictest0-21swapper/710:17:047
20189995111,507cyclictest0-21swapper/712:00:217
20188995111,253cyclictest0-21swapper/612:00:556
20186995113,84cyclictest0-21swapper/411:54:324
201839951041,338cyclictest0-21swapper/110:30:191
2018299510295,126cyclictest0-21swapper/012:19:340
20183995071,84cyclictest0-21swapper/111:01:511
201829950738,338cyclictest0-21swapper/010:54:470
201829950738,338cyclictest0-21swapper/010:54:470
2018799506123,84cyclictest0-21swapper/511:29:575
201849950680,211cyclictest33-21ksoftirqd/210:00:132
201879950535,338cyclictest27075-21ssh11:15:175
201859950480,42cyclictest0-21swapper/309:31:343
201839950478,126cyclictest0-21swapper/109:40:201
2018399504119,381cyclictest0-21swapper/111:54:321
201879950339,304cyclictest0-21swapper/510:58:285
201889950280,84cyclictest0-21swapper/610:29:186
201839950238,296cyclictest0-21swapper/110:28:331
2018799501117,211cyclictest23563-21ssh11:13:375
201869950178,126cyclictest0-21swapper/410:25:324
201869950176,423cyclictest0-21swapper/411:04:474
2018399501246,253cyclictest241ktimersoftd/109:32:361
2018399501121,84cyclictest0-21swapper/111:46:361
201859950073,211cyclictest401ktimersoftd/310:38:223
2018599500118,84cyclictest0-21swapper/307:53:363
2018599500118,84cyclictest0-21swapper/307:53:353
201839950032,169cyclictest25-21ksoftirqd/109:58:361
201839950032,169cyclictest25-21ksoftirqd/109:58:351
2018399500119,84cyclictest0-21swapper/111:29:571
201899949973,423cyclictest0-21swapper/709:31:137
201899949931,465cyclictest0-21swapper/710:50:327
201899949931,465cyclictest0-21swapper/710:50:327
2018499498114,127cyclictest0-21swapper/209:21:392
2018799496115,126cyclictest0-21swapper/511:45:315
201869949670,423cyclictest0-21swapper/411:08:114
201859949626,297cyclictest32019-21diskmemload10:57:413
201829949471,126cyclictest20180-21cyclictest10:14:590
201829949471,126cyclictest20180-21cyclictest10:14:590
201829949428,85cyclictest1346-21ssh12:09:540
2018299494108,341cyclictest121rcu_preempt09:32:140
201829949370,84cyclictest121rcu_preempt10:49:230
201889949223,300cyclictest0-21swapper/610:30:166
201849949268,211cyclictest0-21swapper/211:35:362
201849949068,84cyclictest0-21swapper/210:36:472
201829948963,211cyclictest0-21swapper/010:57:150
201889948822,211cyclictest0-21swapper/609:57:456
201889948822,211cyclictest0-21swapper/609:57:446
2018799488105,380cyclictest0-21swapper/510:49:045
201869948865,168cyclictest0-21swapper/409:32:314
201899948761,423cyclictest26992-1kworker/7:2H10:20:187
201899948761,423cyclictest26992-1kworker/7:2H10:20:187
2018799487146,338cyclictest20180-21cyclictest11:53:575
201869948762,422cyclictest0-21swapper/410:37:554
2018499487103,126cyclictest27993-21diskmemload12:30:252
201869948618,465cyclictest64450irq/122-eth009:59:354
201869948618,465cyclictest64450irq/122-eth009:59:354
201849948617,210cyclictest33-21ksoftirqd/210:14:002
201849948617,210cyclictest33-21ksoftirqd/210:13:592
201829948622,297cyclictest0-21swapper/011:04:350
201849948459,211cyclictest0-21swapper/210:58:172
201839948418,126cyclictest0-21swapper/111:15:171
201869948360,168cyclictest0-21swapper/411:47:044
201839948256,211cyclictest0-21swapper/110:13:551
201839948256,211cyclictest0-21swapper/110:13:541
201859948116,302cyclictest0-21swapper/310:47:053
2018399481142,84cyclictest20180-21cyclictest11:06:161
2018799480185,123cyclictest32438-21taskset08:20:215
201859947957,256cyclictest0-21swapper/310:28:343
201889947813,211cyclictest0-21swapper/611:46:356
201829947812,211cyclictest0-21swapper/009:40:160
201879947713,298cyclictest0-21swapper/509:31:205
20189994767,42cyclictest0-21swapper/712:09:567
201829947610,42cyclictest0-21swapper/012:11:220
20188994759,293cyclictest0-21swapper/611:06:156
2018699472174,295cyclictest64450irq/122-eth009:47:414
20189994701,42cyclictest0-21swapper/711:47:377
201849946947,84cyclictest0-21swapper/212:00:532
2018399469213,126cyclictest121rcu_preempt11:11:481
20184994683,219cyclictest0-21swapper/212:09:372
20188994671,126cyclictest0-21swapper/611:11:056
201879946741,295cyclictest0-21swapper/508:10:585
201839946743,255cyclictest20866-21sh09:22:171
201899946640,389cyclictest0-21swapper/708:14:137
201869946683,380cyclictest0-21swapper/407:52:084
201869946683,380cyclictest0-21swapper/407:52:074
2018499466126,126cyclictest121rcu_preempt11:00:262
20182994661,43cyclictest12216-21cron11:29:550
2018399465124,338cyclictest0-21swapper/112:40:251
2018799464166,126cyclictest121rcu_preempt12:18:105
2018799464124,84cyclictest0-21swapper/511:06:575
2018799464124,338cyclictest0-21swapper/509:46:015
2018799464123,338cyclictest0-21swapper/510:35:215
201849946479,211cyclictest33-21ksoftirqd/212:19:322
201839946440,296cyclictest0-21swapper/107:15:251
2018399464124,338cyclictest0-21swapper/110:50:521
2018399464124,338cyclictest0-21swapper/110:50:521
201889946382,296cyclictest25526-21kworker/u16:111:01:416
2018399463124,84cyclictest0-21swapper/112:19:341
2018399463124,84cyclictest0-21swapper/110:38:171
2018399463124,84cyclictest0-21swapper/110:18:171
2018399463122,338cyclictest0-21swapper/112:09:551
2018399463122,338cyclictest0-21swapper/111:35:281
2018799462124,83cyclictest0-21swapper/509:35:195
2018599462120,339cyclictest0-21swapper/311:00:423
2018499462123,84cyclictest121rcu_preempt09:56:072
2018499462123,84cyclictest121rcu_preempt09:56:072
201849946177,169cyclictest0-21swapper/211:08:542
2018399461124,253cyclictest0-21swapper/112:00:371
2018899459118,338cyclictest15050-21chrt07:50:426
2018899459118,338cyclictest15050-21chrt07:50:426
2018799459119,338cyclictest0-21swapper/510:52:135
2018799459119,338cyclictest0-21swapper/510:52:135
2018899458121,42cyclictest65-21ksoftirqd/609:24:366
201859945879,83cyclictest0-21swapper/309:20:543
201859945878,84cyclictest0-21swapper/311:54:473
2018399458116,339cyclictest0-21swapper/108:10:461
201879945733,85cyclictest121rcu_preempt12:30:255
201889945634,338cyclictest0-21swapper/609:35:206
2018799456116,337cyclictest0-21swapper/512:11:205
2018399456116,338cyclictest0-21swapper/108:15:171
201889945569,338cyclictest0-21swapper/608:10:496
201869945529,211cyclictest8737-21ssh12:30:154
201849945571,168cyclictest0-21swapper/210:30:002
201889945433,255cyclictest0-21swapper/610:20:136
201889945433,255cyclictest0-21swapper/610:20:136
2018399454113,339cyclictest0-21swapper/112:11:201
2018399454111,338cyclictest0-21swapper/112:30:271
2018699453114,84cyclictest704-21nscd11:14:104
201889945226,423cyclictest0-21swapper/612:18:486
201849945167,84cyclictest0-21swapper/209:25:042
2018399451110,338cyclictest0-21swapper/107:50:421
2018399451110,338cyclictest0-21swapper/107:50:421
2018699450108,338cyclictest0-21swapper/409:53:344
201859945067,380cyclictest0-21swapper/311:45:063
201859944923,211cyclictest14777-21ssh11:07:153
201839944826,211cyclictest0-21swapper/110:00:051
201899944767,296cyclictest0-21swapper/711:55:217
201899944721,169cyclictest0-21swapper/710:00:057
2018399447107,338cyclictest0-21swapper/112:38:471
201829944764,380cyclictest0-21swapper/011:45:060
201859944518,296cyclictest0-21swapper/310:54:323
201859944518,296cyclictest0-21swapper/310:54:323
2018799444104,338cyclictest0-21swapper/510:20:205
2018799444104,338cyclictest0-21swapper/510:20:205
2018599443188,253cyclictest401ktimersoftd/311:35:353
201849944321,253cyclictest0-21swapper/210:45:452
2018299443103,338cyclictest20180-21cyclictest09:21:340
201889944256,126cyclictest25526-21kworker/u16:110:37:156
201859944219,256cyclictest0-21swapper/308:15:183
201869944099,338cyclictest20119-21/usr/sbin/munin09:40:234
201869943856,338cyclictest0-21swapper/408:10:494
201869943816,301cyclictest0-21swapper/409:35:204
201829943716,255cyclictest0-21swapper/011:55:230
201879943519,78cyclictest0-21swapper/507:53:345
201879943519,78cyclictest0-21swapper/507:53:345
201859943594,338cyclictest0-21swapper/309:47:533
201899943496,302cyclictest0-21swapper/709:25:037
201889943411,256cyclictest0-21swapper/608:15:186
201869943396,83cyclictest0-21swapper/412:00:544
20189994326,42cyclictest0-21swapper/712:11:127
201899942986,340cyclictest704-21nscd09:53:347
20187994275,134cyclictest0-21swapper/509:53:485
201869942787,338cyclictest0-21swapper/408:20:224
201829942645,211cyclictest0-21swapper/007:52:080
201829942645,211cyclictest0-21swapper/007:52:080
201899942582,338cyclictest0-21swapper/708:15:197
201889942581,212cyclictest1553-21runrttasks09:47:446
201859942540,126cyclictest121rcu_preempt12:10:443
20188994241,257cyclictest0-21swapper/610:49:116
201859942482,339cyclictest0-21swapper/312:18:113
201829942483,338cyclictest0-21swapper/008:10:480
201899942383,126cyclictest73-21ksoftirqd/710:15:007
201899942383,126cyclictest73-21ksoftirqd/710:14:597
201859942382,338cyclictest0-21swapper/311:44:543
201829942383,338cyclictest0-21swapper/010:30:060
201829942382,338cyclictest0-21swapper/012:00:570
201899942281,338cyclictest0-21swapper/712:38:487
201889942282,338cyclictest0-21swapper/612:10:056
201879942282,338cyclictest0-21swapper/509:25:045
201859942242,296cyclictest0-21swapper/309:35:193
2018599422127,84cyclictest121rcu_preempt10:00:123
201899942180,338cyclictest0-21swapper/711:44:547
201889942180,338cyclictest0-21swapper/611:55:216
201889942179,339cyclictest0-21swapper/610:13:596
201889942179,339cyclictest0-21swapper/610:13:586
201869942180,338cyclictest0-21swapper/412:39:104
201869942180,338cyclictest0-21swapper/408:15:134
201859942182,84cyclictest0-21swapper/311:29:543
201859942179,339cyclictest0-21swapper/312:09:563
201859942141,296cyclictest1551-21snmpd10:30:173
201829942181,338cyclictest698-21ptp4l12:30:270
201829942181,338cyclictest0-21swapper/012:40:250
201829942180,338cyclictest0-21swapper/011:53:500
201889942078,339cyclictest1651-21ntpd12:39:016
201829942035,211cyclictest0-21swapper/009:53:390
201899941938,297cyclictest0-21swapper/709:35:197
201889941979,338cyclictest0-21swapper/612:09:566
201879941978,339cyclictest0-21swapper/512:39:105
201869941978,338cyclictest0-21swapper/411:35:274
2018499419120,126cyclictest0-21swapper/209:47:592
2018399419123,84cyclictest0-21swapper/109:53:391
201829941979,338cyclictest0-21swapper/010:20:140
201829941979,338cyclictest0-21swapper/010:20:140
201829941978,338cyclictest0-21swapper/011:44:540
201889941877,338cyclictest0-21swapper/611:53:566
201889941877,338cyclictest0-21swapper/608:20:166
201859941878,338cyclictest0-21swapper/308:20:213
201859941877,338cyclictest0-21swapper/312:30:283
201899941775,169cyclictest0-21swapper/712:29:537
201879941777,338cyclictest0-21swapper/512:40:255
201869941779,83cyclictest0-21swapper/410:00:054
201859941777,338cyclictest0-21swapper/312:00:573
201889941675,338cyclictest0-21swapper/609:25:046
201889941636,296cyclictest0-21swapper/611:29:566
20189994151,330cyclictest0-21swapper/707:55:107
201889941577,256cyclictest0-21swapper/612:30:326
201889941574,338cyclictest0-21swapper/611:44:546
201829941575,338cyclictest0-21swapper/008:20:210
201899941474,338cyclictest0-21swapper/709:40:257
201829941475,337cyclictest0-21swapper/012:38:470
201829941473,338cyclictest0-21swapper/008:15:190
201889941373,338cyclictest0-21swapper/609:40:176
201879941373,338cyclictest0-21swapper/512:00:555
201869941372,338cyclictest0-21swapper/411:29:554
201859941371,339cyclictest0-21swapper/309:25:053
201899941271,338cyclictest0-21swapper/708:20:167
201869941271,338cyclictest0-21swapper/412:19:344
201839941272,338cyclictest0-21swapper/111:55:261
201829941229,380cyclictest0-21swapper/011:30:060
201869941171,338cyclictest0-21swapper/410:14:004
201869941171,338cyclictest0-21swapper/410:13:594
201829941172,337cyclictest0-21swapper/009:25:040
201899941070,338cyclictest0-21swapper/710:30:077
201889941070,338cyclictest0-21swapper/612:40:256
201859941029,296cyclictest0-21swapper/308:10:583
201839941031,210cyclictest0-21swapper/109:35:181
201889940929,296cyclictest0-21swapper/609:53:446
201849940928,126cyclictest0-21swapper/211:55:462
2018499409110,126cyclictest121rcu_preempt11:53:492
201829940968,338cyclictest0-21swapper/011:35:340
201859940828,219cyclictest0-21swapper/311:15:103
201849940866,211cyclictest0-21swapper/207:54:302
201849940866,211cyclictest0-21swapper/207:54:302
2018399408364,42cyclictest241ktimersoftd/108:20:161
201879940728,295cyclictest0-21swapper/507:55:105
201869940666,338cyclictest0-21swapper/410:30:064
201859940665,339cyclictest0-21swapper/310:14:593
201859940665,339cyclictest0-21swapper/310:14:593
201879940564,338cyclictest0-21swapper/511:44:555
201869940565,338cyclictest0-21swapper/412:10:014
201869940565,338cyclictest0-21swapper/411:55:254
201859940565,338cyclictest0-21swapper/312:40:263
201859940563,339cyclictest0-21swapper/311:55:243
201899940464,338cyclictest0-21swapper/711:35:347
201889940463,338cyclictest0-21swapper/611:35:286
201849940425,84cyclictest0-21swapper/212:10:052
201879940362,338cyclictest0-21swapper/510:30:065
201849940364,84cyclictest0-21swapper/209:40:172
201889940262,338cyclictest0-21swapper/610:00:136
201849940263,84cyclictest0-21swapper/208:14:132
201839940260,339cyclictest0-21swapper/111:44:551
201899940160,338cyclictest0-21swapper/712:40:267
201829940122,295cyclictest0-21swapper/009:35:180
201849940061,84cyclictest0-21swapper/209:55:002
201889939818,296cyclictest0-21swapper/607:55:116
201849939758,84cyclictest0-21swapper/212:38:472
201849939758,84cyclictest0-21swapper/210:20:182
201849939758,84cyclictest0-21swapper/210:20:182
201879939655,338cyclictest0-21swapper/511:35:355
201849939555,84cyclictest0-21swapper/208:15:132
201869939454,338cyclictest64450irq/122-eth011:30:064
201869939352,338cyclictest0-21swapper/412:40:254
201899939252,338cyclictest0-21swapper/711:54:317
201879939211,41cyclictest0-21swapper/511:55:215
2018499391135,126cyclictest121rcu_preempt12:40:262
20189993906,42cyclictest0-21swapper/711:29:517
201849938847,211cyclictest0-21swapper/211:15:082
20184993884,169cyclictest0-21swapper/210:30:192
201839938647,337cyclictest0-21swapper/111:30:061
20186993856,295cyclictest0-21swapper/407:55:104
201879938343,337cyclictest0-21swapper/508:15:185
201899937739,260cyclictest0-21swapper/711:15:107
2018799377122,84cyclictest24425-21ssh10:00:145
2018799377121,253cyclictest0-21swapper/509:40:155
2018399377121,253cyclictest24493-21ssh09:25:041
201889937534,338cyclictest0-21swapper/611:30:076
201879937432,339cyclictest0-21swapper/510:13:595
201879937432,339cyclictest0-21swapper/510:13:585
201859937336,212cyclictest0-21swapper/312:39:123
201849936730,169cyclictest33-21ksoftirqd/209:35:182
201829936625,338cyclictest0-21swapper/012:29:530
201839936427,253cyclictest0-21swapper/111:20:521
201849936266,212cyclictest0-21swapper/207:55:102
201859935921,217cyclictest0-21swapper/312:29:543
201889935817,338cyclictest0-21swapper/611:15:176
201889935719,170cyclictest0-21swapper/612:29:546
201829935716,338cyclictest0-21swapper/011:15:170
201869935615,338cyclictest0-21swapper/411:15:094
201839935498,84cyclictest25-21ksoftirqd/112:29:521
201829935315,254cyclictest15734-21/usr/sbin/munin07:55:090
201889935215,253cyclictest0-21swapper/611:20:536
201849935255,84cyclictest0-21swapper/211:29:552
201849935211,84cyclictest0-21swapper/208:20:212
201859935110,338cyclictest0-21swapper/311:30:063
20187993499,337cyclictest0-21swapper/511:30:065
2018499347133,84cyclictest303-21systemd-journal11:45:012
20187993455,337cyclictest0-21swapper/512:29:535
201859933077,84cyclictest0-21swapper/307:55:103
201849932872,84cyclictest121rcu_preempt07:15:242
201849932626,127cyclictest27993-21diskmemload12:29:512
201869932470,84cyclictest0-21swapper/409:25:024
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional