You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-24 - 14:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Wed Jun 24, 2026 12:54:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22299997319,719cyclictest0-21swapper/712:14:347
222999969961,635cyclictest0-21swapper/710:45:107
22299996865,42cyclictest13652-21ssh12:24:127
22299996865,42cyclictest13652-21ssh12:24:127
22293996780,42cyclictest27247-21apt-get10:35:131
222939967781,380cyclictest0-21swapper/111:33:531
222989967477,380cyclictest0-21swapper/611:55:346
2229999665112,380cyclictest0-21swapper/711:34:567
222949964852,127cyclictest11224-1kworker/u17:012:14:582
222999964753,557cyclictest0-21swapper/709:58:017
22296996350,86cyclictest0-21swapper/410:24:104
222929963178,338cyclictest121rcu_preempt12:31:250
222929963178,338cyclictest121rcu_preempt12:31:240
222929963178,338cyclictest121rcu_preempt12:31:240
222929963178,338cyclictest121rcu_preempt12:31:240
2229599629288,339cyclictest12447-1kworker/u17:011:13:203
2229599629288,339cyclictest12447-1kworker/u17:011:13:203
222999962529,593cyclictest0-21swapper/710:44:527
222999962529,593cyclictest0-21swapper/710:44:527
2229499625113,127cyclictest0-21swapper/210:44:102
2229499625113,127cyclictest0-21swapper/210:44:102
2229499625113,127cyclictest0-21swapper/210:44:092
222939962532,169cyclictest0-21swapper/110:34:391
2229899617153,300cyclictest0-21swapper/610:34:026
222989961667,129cyclictest0-21swapper/611:34:516
222929961261,41cyclictest30753-21wc11:55:070
2229499611141,211cyclictest121rcu_preempt11:52:482
222989960912,127cyclictest0-21swapper/611:14:426
222989960912,127cyclictest0-21swapper/611:14:416
222979960657,84cyclictest121rcu_preempt11:54:435
222979960656,84cyclictest0-21swapper/510:44:485
222979960656,84cyclictest0-21swapper/510:44:475
222979960656,84cyclictest0-21swapper/510:44:475
2229499606437,3cyclictest321ktimersoftd/212:24:552
2229499606437,3cyclictest321ktimersoftd/212:24:542
22299995961,592cyclictest0-21swapper/712:42:417
222929959648,124cyclictest0-21swapper/009:58:140
2229499594124,127cyclictest33-21ksoftirqd/210:33:132
222949958981,126cyclictest121rcu_preempt11:55:182
222999958775,381cyclictest0-21swapper/712:33:027
222999958775,381cyclictest0-21swapper/712:33:017
222999958775,381cyclictest0-21swapper/712:33:017
222999958775,381cyclictest0-21swapper/712:33:017
222979958678,126cyclictest121rcu_preempt12:13:475
222959958632,381cyclictest26700-21sh10:34:373
222959958233,84cyclictest0-21swapper/312:32:043
222959958233,84cyclictest0-21swapper/312:32:033
222959958233,84cyclictest0-21swapper/312:32:033
222959958233,84cyclictest0-21swapper/312:32:033
222939958132,297cyclictest0-21swapper/109:55:591
222969957968,338cyclictest0-21swapper/412:32:494
222969957968,338cyclictest0-21swapper/412:32:484
222969957968,338cyclictest0-21swapper/412:32:484
222969957968,338cyclictest0-21swapper/412:32:484
222949957823,127cyclictest0-21swapper/211:05:382
222949957524,126cyclictest0-21swapper/211:34:022
2229499573147,126cyclictest121rcu_preempt11:25:032
222999956815,550cyclictest0-21swapper/711:02:467
222979956458,124cyclictest121rcu_preempt12:01:055
222989956111,126cyclictest0-21swapper/612:34:336
222989956111,126cyclictest0-21swapper/612:34:326
222989956111,126cyclictest0-21swapper/612:34:326
222989956111,126cyclictest0-21swapper/612:34:326
222999955950,126cyclictest0-21swapper/710:34:517
22299995562,551cyclictest0-21swapper/711:54:137
2229399555130,260cyclictest0-21swapper/110:20:521
222949955445,127cyclictest0-21swapper/212:44:032
22293995545,84cyclictest0-21swapper/111:55:261
222959955283,211cyclictest41-21ksoftirqd/310:43:303
222959955283,211cyclictest41-21ksoftirqd/310:43:293
222959955283,211cyclictest41-21ksoftirqd/310:43:293
22293995523,127cyclictest12815-21rm11:25:041
22298995511,3cyclictest0-21swapper/610:22:036
2229299551125,296cyclictest0-21swapper/012:03:340
222989955083,84cyclictest0-21swapper/612:23:196
222989955083,84cyclictest0-21swapper/612:23:196
222999954882,211cyclictest0-21swapper/711:55:357
2229399548121,92cyclictest25-21ksoftirqd/110:44:481
2229399548121,92cyclictest25-21ksoftirqd/110:44:471
2229399548121,92cyclictest25-21ksoftirqd/110:44:471
222979954677,126cyclictest0-21swapper/512:34:325
222979954677,126cyclictest0-21swapper/512:34:325
222979954677,126cyclictest0-21swapper/512:34:315
222979954677,126cyclictest0-21swapper/512:34:315
2229499546166,254cyclictest27344-21ssh09:58:112
222979954535,346cyclictest0-21swapper/512:44:405
222999954375,465cyclictest0-21swapper/710:20:487
222959954172,466cyclictest22290-21cyclictest11:54:393
2229599541497,42cyclictest401ktimersoftd/310:00:043
222939953928,338cyclictest0-21swapper/111:04:061
2229899538284,84cyclictest641ktimersoftd/612:14:306
222929953768,211cyclictest0-21swapper/010:34:100
222969953628,84cyclictest0-21swapper/411:15:024
222969953628,84cyclictest0-21swapper/411:15:014
2229699534193,338cyclictest64450irq/122-eth009:57:414
222999953326,423cyclictest0-21swapper/711:05:577
2229899532110,338cyclictest22290-21cyclictest11:21:056
222979953065,210cyclictest0-21swapper/510:22:525
222949953065,253cyclictest0-21swapper/211:05:032
222929952918,211cyclictest0-21swapper/010:00:200
222989952517,84cyclictest0-21swapper/609:58:456
222929952458,84cyclictest14861-21kworker/u16:311:34:480
222969952397,253cyclictest0-21swapper/410:35:014
222969952362,80cyclictest0-21swapper/411:33:474
222979952012,84cyclictest0-21swapper/511:34:575
22293995209,338cyclictest0-21swapper/111:11:311
22293995209,338cyclictest0-21swapper/111:11:311
222979951912,84cyclictest0-21swapper/511:25:025
222989951810,126cyclictest121rcu_preempt11:55:066
222969951810,42cyclictest121rcu_preempt12:14:344
22297995179,126cyclictest0-21swapper/512:21:205
22297995179,126cyclictest0-21swapper/512:21:195
222979951710,84cyclictest0-21swapper/511:05:565
22294995169,254cyclictest0-21swapper/212:00:582
222979951587,380cyclictest0-21swapper/509:58:145
22292995143,338cyclictest10342-21runrttasks10:44:490
22292995143,338cyclictest10342-21runrttasks10:44:490
22292995143,338cyclictest10342-21runrttasks10:44:490
22294995121,89cyclictest0-21swapper/211:25:272
2229299511255,126cyclictest9-21ksoftirqd/011:14:130
2229299511255,126cyclictest9-21ksoftirqd/011:14:130
22295995100,84cyclictest0-21swapper/310:23:533
22294995101,127cyclictest0-21swapper/212:31:232
22294995101,127cyclictest0-21swapper/212:31:222
22294995101,127cyclictest0-21swapper/212:31:222
22294995101,127cyclictest0-21swapper/212:31:222
22294995100,84cyclictest0-21swapper/210:24:092
22292995100,42cyclictest0-21swapper/012:41:180
22298995090,83cyclictest0-21swapper/610:41:296
22298995090,83cyclictest0-21swapper/610:41:296
22298995090,83cyclictest0-21swapper/610:41:296
22296995090,126cyclictest0-21swapper/412:43:534
2229699507120,214cyclictest0-21swapper/411:05:334
2229599507127,169cyclictest27314-21ssh11:33:283
22293995070,42cyclictest0-21swapper/112:41:171
222929950637,84cyclictest121rcu_preempt12:13:050
2229399504118,255cyclictest121rcu_preempt12:23:391
2229399504118,255cyclictest121rcu_preempt12:23:391
222979950335,338cyclictest0-21swapper/510:34:415
2229399503248,253cyclictest10398-21sh10:45:101
222969949977,84cyclictest0-21swapper/411:55:264
2229699499247,122cyclictest23618-21kworker/u16:111:05:024
222969949834,41cyclictest0-21swapper/411:24:054
222929949834,126cyclictest0-21swapper/012:24:170
222929949834,126cyclictest0-21swapper/012:24:170
2229799497158,337cyclictest30257-21kworker/u16:010:00:185
222949949632,303cyclictest0-21swapper/211:13:162
222949949632,303cyclictest0-21swapper/211:13:162
222929949575,336cyclictest0-21swapper/011:02:530
2229899492108,296cyclictest28964-21rm10:00:096
222959949226,211cyclictest0-21swapper/312:03:363
222929949268,126cyclictest0-21swapper/011:55:350
222979949022,335cyclictest0-21swapper/511:55:145
2229399490107,126cyclictest121rcu_preempt11:52:541
222929949066,209cyclictest9-21ksoftirqd/010:35:130
222969948921,128cyclictest0-21swapper/412:23:524
222969948921,128cyclictest0-21swapper/412:23:514
2229499489235,85cyclictest321ktimersoftd/212:25:142
222969948561,84cyclictest10794-21date10:45:094
222939948012,337cyclictest0-21swapper/111:05:281
222999947611,210cyclictest0-21swapper/711:22:577
2229599476219,126cyclictest0-21swapper/312:44:303
22293994768,42cyclictest0-21swapper/112:35:101
22293994768,42cyclictest0-21swapper/112:35:091
2229599475133,84cyclictest0-21swapper/312:23:463
2229599475133,84cyclictest0-21swapper/312:23:453
22294994759,84cyclictest0-21swapper/210:00:092
22299994734,42cyclictest0-21swapper/712:25:127
22299994681,41cyclictest0-21swapper/711:14:137
22299994681,41cyclictest0-21swapper/711:14:137
2229999468126,339cyclictest22290-21cyclictest10:25:047
22293994682,126cyclictest0-21swapper/112:13:521
22298994670,84cyclictest0-21swapper/611:03:496
22296994670,84cyclictest0-21swapper/410:41:304
22296994670,84cyclictest0-21swapper/410:41:294
22292994673,84cyclictest0-21swapper/011:23:180
2229899464123,338cyclictest0-21swapper/611:05:506
222929946480,211cyclictest9-21ksoftirqd/011:05:560
2229899463122,338cyclictest0-21swapper/612:03:346
2229699463123,337cyclictest64450irq/122-eth010:00:104
222959946338,259cyclictest0-21swapper/311:03:493
2229399463123,338cyclictest0-21swapper/112:34:261
2229399463123,338cyclictest0-21swapper/112:34:261
222979946280,84cyclictest0-21swapper/510:45:115
222979946240,255cyclictest0-21swapper/511:14:325
222979946240,255cyclictest0-21swapper/511:14:325
222959946240,256cyclictest0-21swapper/312:14:553
2229599462122,338cyclictest0-21swapper/311:23:433
2229999461120,338cyclictest0-21swapper/711:15:117
2229799461205,212cyclictest561ktimersoftd/511:25:105
2229999460330,84cyclictest73-21ksoftirqd/712:35:137
2229899459118,338cyclictest0-21swapper/612:43:526
222979945975,338cyclictest0-21swapper/511:02:365
2229599459118,338cyclictest25598-21nscd11:55:253
222999945835,255cyclictest0-21swapper/710:35:147
222979945836,256cyclictest0-21swapper/510:35:145
2229499458117,338cyclictest0-21swapper/209:45:262
222969945736,41cyclictest0-21swapper/412:01:064
222959945632,127cyclictest5393-21ssh09:45:263
2229699455115,337cyclictest1553-21runrttasks11:52:524
2229599455202,84cyclictest0-21swapper/311:05:533
222939945529,211cyclictest0-21swapper/112:25:121
2229899454112,339cyclictest0-21swapper/611:25:116
222969945428,253cyclictest0-21swapper/410:45:104
2229699453112,338cyclictest0-21swapper/412:15:074
2229899452109,340cyclictest0-21swapper/612:25:116
222959945226,254cyclictest0-21swapper/310:45:103
2229999450112,335cyclictest15850irq/123-ahci[0009:45:337
222959944826,2cyclictest0-21swapper/310:35:143
2229799447107,338cyclictest0-21swapper/512:25:145
222979944464,83cyclictest31294-21ssh12:15:115
222939944359,381cyclictest22290-21cyclictest12:03:191
2229999442101,338cyclictest0-21swapper/710:00:247
222929944058,85cyclictest121rcu_preempt10:20:370
222939943912,211cyclictest10552-21ssh10:25:041
222999943856,170cyclictest0-21swapper/711:25:117
222939943396,84cyclictest10736-21kworker/u16:212:15:071
222989943217,245cyclictest121rcu_preempt10:35:126
222999942483,338cyclictest0-21swapper/712:01:067
222999942382,338cyclictest0-21swapper/712:15:077
222939942383,338cyclictest0-21swapper/111:25:101
222939942383,338cyclictest0-21swapper/110:00:211
222959942282,338cyclictest0-21swapper/312:25:103
222979942082,84cyclictest0-21swapper/509:45:335
222929941979,338cyclictest0-21swapper/011:15:110
222959941876,339cyclictest0-21swapper/312:15:103
222959941776,338cyclictest0-21swapper/310:00:103
2229499417118,126cyclictest0-21swapper/210:35:122
222929941776,338cyclictest0-21swapper/011:25:110
2229699416159,126cyclictest121rcu_preempt12:25:134
222959941676,338cyclictest0-21swapper/311:25:263
222979941575,338cyclictest0-21swapper/512:35:115
222969941576,84cyclictest0-21swapper/411:25:264
222969941373,84cyclictest0-21swapper/409:45:334
222969941331,84cyclictest0-21swapper/410:35:104
222929941373,338cyclictest0-21swapper/012:35:120
222929940767,338cyclictest0-21swapper/012:25:120
222929940767,338cyclictest0-21swapper/012:15:110
222929940667,211cyclictest0-21swapper/010:45:110
222989940162,84cyclictest0-21swapper/609:45:346
222929939919,252cyclictest9905-21apt-get10:25:040
222989939814,212cyclictest121rcu_preempt12:15:106
222949939510,253cyclictest0-21swapper/210:45:112
222939939454,338cyclictest0-21swapper/112:35:121
222979939050,338cyclictest0-21swapper/510:25:105
222939939089,298cyclictest0-21swapper/109:45:331
22294993831,84cyclictest0-21swapper/212:35:122
2229699381127,252cyclictest481ktimersoftd/410:25:044
222969937941,83cyclictest0-21swapper/411:15:114
222939937335,170cyclictest0-21swapper/111:15:121
222959937233,84cyclictest0-21swapper/310:25:053
222949936527,42cyclictest0-21swapper/210:25:052
222969936426,84cyclictest29976-21ssh12:35:124
2229899361106,253cyclictest0-21swapper/610:45:116
222989936065,211cyclictest0-21swapper/611:15:096
222989935917,212cyclictest0-21swapper/612:35:146
222929935716,338cyclictest0-21swapper/009:45:270
222949935416,42cyclictest0-21swapper/211:15:112
222999935313,338cyclictest0-21swapper/710:45:127
222949935114,126cyclictest0-21swapper/212:15:062
222989934718,245cyclictest0-21swapper/610:25:036
22297993371,251cyclictest0-21swapper/511:15:095
2229599330158,84cyclictest13729-1kworker/u17:212:35:133
222959931924,2cyclictest0-21swapper/311:15:133
2091028883,2sleep40-21swapper/407:05:204
1925628252,27sleep30-21swapper/307:05:023
2175128152,26sleep70-21swapper/707:08:287
2156928151,27sleep60-21swapper/607:05:536
2161927949,27sleep20-21swapper/207:06:372
2156327747,27sleep00-21swapper/007:05:470
1926327748,26sleep10-21swapper/107:05:091
1925827647,26sleep50-21swapper/507:05:045
37602730,0sleep70-21swapper/710:58:277
313372590,2sleep30-21swapper/311:35:543
22297995220,28cyclictest30004-21cat10:55:105
22298994944,3cyclictest0-21swapper/611:35:216
22297994721,22cyclictest31616-21taskset11:36:085
22292994612,16cyclictest0-21swapper/010:15:010
2229899428,20cyclictest65-21ksoftirqd/610:57:036
22298994217,13cyclictest0-21swapper/610:15:026
2229899409,23cyclictest65-21ksoftirqd/609:17:586
2229499409,20cyclictest33-21ksoftirqd/210:57:022
2229899399,18cyclictest0-21swapper/609:37:026
22298993911,15cyclictest0-21swapper/608:51:306
2229699397,17cyclictest49-21ksoftirqd/410:55:354
2229499399,22cyclictest33-21ksoftirqd/209:19:372
2229499399,19cyclictest33-21ksoftirqd/210:13:192
2229499397,22cyclictest33-21ksoftirqd/211:37:372
2229399392,33cyclictest0-21swapper/111:47:581
2229899389,17cyclictest65-21ksoftirqd/612:05:406
2229899381,24cyclictest65-21ksoftirqd/609:34:556
2229699386,19cyclictest49-21ksoftirqd/412:05:334
2229499389,17cyclictest33-21ksoftirqd/209:35:212
2229499377,22cyclictest33-21ksoftirqd/211:45:452
2229699364,25cyclictest49-21ksoftirqd/411:36:414
2229899357,16cyclictest65-21ksoftirqd/611:47:456
2229699358,15cyclictest49-21ksoftirqd/410:13:394
2229699355,12cyclictest49-21ksoftirqd/409:36:374
2229399352,29cyclictest16709-21head09:35:191
22299993425,5cyclictest15787-21grep11:45:187
2229699349,13cyclictest49-21ksoftirqd/411:45:124
22295993425,5cyclictest15798-21head11:45:173
22295993424,6cyclictest15360-21tr12:05:153
2229499347,14cyclictest33-21ksoftirqd/212:05:172
22293993425,5cyclictest25048-21grep10:15:121
2229699338,12cyclictest49-21ksoftirqd/409:19:484
22295993325,5cyclictest24234-21grep10:15:003
22294993310,16cyclictest33-21ksoftirqd/208:51:502
22292993325,5cyclictest14818-21cut11:45:120
22292993322,7cyclictest30642-21cat11:35:330
22297993210,21cyclictest0-21swapper/507:12:335
2229699321,20cyclictest49-21ksoftirqd/409:35:014
22295993225,4cyclictest15693-21sort09:35:153
22295993224,5cyclictest31386-21chrt10:55:193
22299993124,4cyclictest15840-21ssh12:05:167
22299993122,5cyclictest28975-21expr11:35:187
22297993124,4cyclictest18915-21ssh09:36:135
22297993124,4cyclictest15525-21expr12:05:145
22296993110,10cyclictest121rcu_preempt10:15:144
22293993123,5cyclictest16848-21ntpq12:05:261
22292993125,3cyclictest15139-21ssh09:35:000
22292993124,4cyclictest18941-21ssh12:06:430
92002300,2sleep69206-21dump-pmu-power08:35:006
22299993022,5cyclictest24678-21sh10:15:057
22299993022,5cyclictest17638-21rm09:35:287
22299993022,5cyclictest14787-21ssh09:17:537
22297993024,3cyclictest22817-21ssh10:13:465
22297993023,4cyclictest18277-21ssh11:46:265
22296993010,10cyclictest49-21ksoftirqd/408:51:324
22295993022,5cyclictest14676-21sh09:17:453
22293993023,4cyclictest32567-21ssh10:55:321
22293993022,5cyclictest29431-21tune2fs11:35:211
22293993022,5cyclictest14925-21ssh09:17:591
22292993023,4cyclictest15967-21sh09:18:550
22292993022,5cyclictest15666-21grep09:35:140
22299992921,5cyclictest22026-21ssh10:13:057
22297992922,5cyclictest14478-21rm09:17:355
22295992922,4cyclictest24664-21sh10:15:043
2229499298,6cyclictest33-21ksoftirqd/210:15:132
22293992922,4cyclictest22709-21ssh10:13:391
22293992921,5cyclictest21075-21taskset08:51:271
22292992922,4cyclictest29899-21rm10:55:090
22299992820,5cyclictest14961-21cron09:35:007
22298992822,3cyclictest24784-21ssh10:15:126
22295992821,4cyclictest15228-21cat09:35:023
22293992821,4cyclictest14876-21ssh09:34:561
22299992710,0cyclictest0-21swapper/707:12:267
22297992721,3cyclictest211132sleep508:51:575
22296992710,17cyclictest0-21swapper/407:12:264
22295992720,4cyclictest21088-21taskset08:51:373
22295992710,17cyclictest0-21swapper/307:12:353
2229499274,8cyclictest33-21ksoftirqd/209:34:502
22294992710,17cyclictest0-21swapper/207:12:382
22293992710,17cyclictest0-21swapper/107:12:321
22292992721,4cyclictest25545-21sh10:15:140
22292992710,0cyclictest0-21swapper/007:12:280
22299992620,3cyclictest211152sleep708:52:007
22298992525,0cyclictest0-21swapper/607:12:296
22297992519,4cyclictest24731-21taskset10:15:085
22297992215,4cyclictest561ktimersoftd/509:34:495
215892220,0sleep10-21swapper/110:50:191
2229799200,19cyclictest0-21swapper/508:45:175
22297991917,1cyclictest0-21swapper/507:50:165
22292991913,3cyclictest101ktimersoftd/008:52:220
2229499170,8cyclictest0-21swapper/208:15:012
86772160,0sleep70-21swapper/710:05:537
325742160,0sleep20-21swapper/207:25:112
22299991613,2cyclictest721ktimersoftd/708:15:007
2229699161,13cyclictest0-21swapper/407:15:154
2229299161,7cyclictest32732-21date08:20:010
2229899159,1cyclictest121rcu_preempt10:52:536
2229699150,1cyclictest0-21swapper/408:45:144
22295991512,2cyclictest0-21swapper/308:45:133
22295991511,2cyclictest1952-21perf09:44:593
22294991514,1cyclictest0-21swapper/208:45:092
22293991512,2cyclictest0-21swapper/107:15:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional