You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-24 - 19:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Mon Aug 24, 2026 12:55:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
321649973410,721cyclictest0-21swapper/309:57:533
32161997180,84cyclictest0-21swapper/011:34:160
3216499710119,84cyclictest13802-21ssh10:24:593
3216399675122,380cyclictest0-21swapper/210:41:072
321659966330,211cyclictest0-21swapper/411:48:044
321659965116,84cyclictest0-21swapper/410:58:274
32162996370,84cyclictest0-21swapper/111:24:561
3216699627544,3cyclictest561ktimersoftd/509:24:135
321649962630,593cyclictest0-21swapper/309:35:113
3216699624541,3cyclictest561ktimersoftd/511:31:045
321649962327,593cyclictest18504-21sh10:09:593
321659962067,422cyclictest0-21swapper/411:30:594
321649961663,550cyclictest0-21swapper/311:22:523
321649961662,381cyclictest0-21swapper/312:37:163
321649961519,380cyclictest0-21swapper/309:28:363
321639961523,2cyclictest0-21swapper/210:39:472
321619961561,338cyclictest0-21swapper/009:22:320
321619961426,419cyclictest0-21swapper/010:39:280
3216899608266,339cyclictest28600-21kworker/u16:309:58:407
321639960513,2cyclictest0-21swapper/209:53:522
32167995950,84cyclictest2813-21nscd09:56:216
321679959482,84cyclictest121rcu_preempt09:31:016
32163995940,84cyclictest0-21swapper/209:56:212
32163995930,84cyclictest0-21swapper/211:31:292
321649959281,381cyclictest0-21swapper/312:10:483
321619958840,338cyclictest0-21swapper/009:29:500
321619958637,295cyclictest0-21swapper/009:58:180
32168995855,3cyclictest0-21swapper/710:39:477
321619958229,422cyclictest0-21swapper/010:58:520
3216299579112,296cyclictest0-21swapper/109:58:371
3216399576107,126cyclictest0-21swapper/209:27:552
3216599575111,126cyclictest0-21swapper/409:25:094
321649957519,127cyclictest0-21swapper/310:57:263
321619957567,126cyclictest0-21swapper/011:58:090
321639957423,126cyclictest0-21swapper/211:59:252
321619957365,126cyclictest0-21swapper/010:25:540
321649957120,165cyclictest0-21swapper/311:58:433
321639957121,338cyclictest0-21swapper/210:28:342
3216399570271,126cyclictest0-21swapper/211:50:292
321639956920,84cyclictest9455-21irqstats12:10:202
321619956920,84cyclictest0-21swapper/010:49:210
3216699568315,41cyclictest11050-21kworker/u16:112:10:205
3216599564138,253cyclictest121rcu_preempt10:48:174
32163995587,127cyclictest27470-21sh12:37:172
32166995556,383cyclictest6795-21ssh10:39:465
32168995543,84cyclictest0-21swapper/711:58:177
32163995545,84cyclictest0-21swapper/209:30:412
321629954779,295cyclictest0-21swapper/109:28:591
321659954635,211cyclictest0-21swapper/410:36:314
321619954438,422cyclictest0-21swapper/011:05:240
3216499540285,253cyclictest27258-1kworker/u17:211:30:593
321629953933,260cyclictest0-21swapper/109:21:361
321659953831,303cyclictest0-21swapper/408:15:044
3216399537284,84cyclictest0-21swapper/212:05:112
321689953528,169cyclictest0-21swapper/709:52:417
321619953527,84cyclictest0-21swapper/010:24:260
321639953469,380cyclictest0-21swapper/210:25:002
3216699533450,3cyclictest561ktimersoftd/508:15:035
321649953368,341cyclictest1651-21ntpd07:20:173
321639953324,126cyclictest0-21swapper/210:48:202
321659953264,211cyclictest0-21swapper/409:22:424
3216599532106,254cyclictest0-21swapper/412:00:244
321619953268,295cyclictest0-21swapper/012:00:330
3216199532106,296cyclictest17451-21ssh09:32:510
321669953162,211cyclictest0-21swapper/509:56:505
321639953120,380cyclictest0-21swapper/208:13:352
321619953162,338cyclictest121rcu_preempt11:25:020
3216899530275,253cyclictest721ktimersoftd/712:04:587
321619953025,294cyclictest0-21swapper/010:41:370
321679952964,49cyclictest121rcu_preempt11:05:176
3216799529105,126cyclictest0-21swapper/609:52:246
321669952923,255cyclictest0-21swapper/507:20:175
321659952918,295cyclictest49-21ksoftirqd/411:50:144
321649952961,124cyclictest1858-21ssh11:49:163
3216299529231,126cyclictest11913-1kworker/u17:210:25:411
321629952922,126cyclictest0-21swapper/112:38:201
321659952820,84cyclictest0-21swapper/408:10:254
321619952860,254cyclictest121rcu_preempt09:54:540
321669952721,84cyclictest32159-21cyclictest12:17:315
321669952716,380cyclictest0-21swapper/511:40:375
321649952721,425cyclictest0-21swapper/309:34:433
321649952716,508cyclictest0-21swapper/310:50:153
3216499527100,296cyclictest0-21swapper/309:52:463
3216699525225,126cyclictest0-21swapper/511:50:135
321649952416,165cyclictest0-21swapper/310:12:193
3216799522181,338cyclictest1515-21kworker/u16:009:24:166
321629952254,168cyclictest6307-21ssh10:39:161
321639951911,84cyclictest0-21swapper/210:58:312
32163995186,127cyclictest0-21swapper/210:07:502
32164995176,508cyclictest0-21swapper/311:40:313
32164995154,508cyclictest0-21swapper/312:00:303
321629951589,295cyclictest0-21swapper/111:31:461
3216599513176,84cyclictest64450irq/122-eth009:57:284
321629951140,296cyclictest0-21swapper/110:47:021
32167995100,84cyclictest3670-21runrttasks11:31:296
32165995104,255cyclictest0-21swapper/407:20:174
32163995092,84cyclictest0-21swapper/211:23:262
3216399509125,169cyclictest33-21ksoftirqd/209:23:312
32167995081,335cyclictest0-21swapper/610:58:046
3216599508124,253cyclictest0-21swapper/409:34:194
321629950885,254cyclictest0-21swapper/112:17:311
321659950782,126cyclictest49-21ksoftirqd/410:12:394
3216599506167,337cyclictest64450irq/122-eth011:04:254
321649950641,381cyclictest0-21swapper/310:26:123
3216699505422,3cyclictest561ktimersoftd/510:50:075
3216699505421,3cyclictest561ktimersoftd/510:23:465
3216899504161,126cyclictest0-21swapper/711:33:427
3216699504421,3cyclictest561ktimersoftd/511:47:435
321619950482,84cyclictest0-21swapper/012:11:120
3216699503420,3cyclictest561ktimersoftd/510:08:375
321659950377,295cyclictest121rcu_preempt10:24:004
321659950334,304cyclictest0-21swapper/410:27:044
321629950334,211cyclictest0-21swapper/110:23:311
3216799502121,126cyclictest20370-21ssh11:59:196
3216699502419,3cyclictest561ktimersoftd/510:29:035
321649950231,84cyclictest0-21swapper/310:47:393
3216399502117,296cyclictest0-21swapper/211:48:392
321619950234,295cyclictest0-21swapper/010:50:070
3216699501418,3cyclictest561ktimersoftd/511:04:385
321669950074,217cyclictest18948-21ssh11:05:195
321659950030,338cyclictest0-21swapper/411:05:104
321619950034,84cyclictest0-21swapper/010:00:060
321659949935,339cyclictest0-21swapper/409:35:114
321629949973,255cyclictest121rcu_preempt10:56:121
321639949831,84cyclictest121rcu_preempt11:41:142
321659949632,219cyclictest0-21swapper/412:10:064
321659949628,465cyclictest0-21swapper/411:25:184
3216499496112,295cyclictest0-21swapper/309:05:143
321629949628,260cyclictest0-21swapper/112:10:531
321669949529,253cyclictest0-21swapper/511:23:035
321689949472,84cyclictest0-21swapper/709:25:127
321679949470,211cyclictest32159-21cyclictest12:37:046
3216699494410,3cyclictest561ktimersoftd/510:12:545
321639949472,259cyclictest0-21swapper/212:04:572
3216399494451,41cyclictest311rcuc/210:12:552
321619949425,383cyclictest0-21swapper/008:10:340
3216699493408,4cyclictest561ktimersoftd/512:21:525
321649949329,383cyclictest0-21swapper/310:36:233
3216699491407,3cyclictest561ktimersoftd/510:47:005
3216699491365,43cyclictest561ktimersoftd/508:10:205
321649949021,339cyclictest0-21swapper/312:26:183
321629949024,126cyclictest0-21swapper/109:34:381
3216299490149,126cyclictest121rcu_preempt11:49:061
321619949022,465cyclictest0-21swapper/011:04:250
3216699489103,211cyclictest16540-21ssh09:32:115
321639948924,169cyclictest9246-21ssh11:00:102
321639948923,84cyclictest0-21swapper/210:50:042
321669948862,296cyclictest0-21swapper/509:29:565
321689948765,84cyclictest0-21swapper/712:11:127
3216899486192,211cyclictest0-21swapper/711:50:137
321679948659,211cyclictest0-21swapper/610:42:126
321659948622,414cyclictest0-21swapper/409:52:414
321649948614,127cyclictest0-21swapper/311:09:543
3216199485447,36cyclictest111rcuc/012:26:390
321619948521,126cyclictest2555-21ssh11:49:570
321669948460,126cyclictest0-21swapper/510:57:205
3216899483186,125cyclictest121rcu_preempt10:50:087
321689948317,211cyclictest0-21swapper/712:38:137
3216399483143,127cyclictest121rcu_preempt11:09:582
3216899482438,42cyclictest711rcuc/712:17:147
321629948112,295cyclictest0-21swapper/109:54:341
321689948056,127cyclictest0-21swapper/711:48:287
321679948056,211cyclictest0-21swapper/610:48:076
321649948011,466cyclictest0-21swapper/310:43:013
321619948015,340cyclictest0-21swapper/010:13:000
321619947955,85cyclictest0-21swapper/010:09:520
321679947713,126cyclictest0-21swapper/610:10:266
32167994766,262cyclictest19793-21sh10:28:226
321679947611,3cyclictest0-21swapper/608:13:586
321679947510,3cyclictest0-21swapper/610:39:476
32165994738,50cyclictest0-21swapper/410:08:494
32162994721,338cyclictest6627-21runrttasks08:11:191
3216699470421,3cyclictest561ktimersoftd/510:42:115
32162994691,84cyclictest0-21swapper/110:12:241
321679946739,169cyclictest65-21ksoftirqd/612:04:416
3216799467125,339cyclictest0-21swapper/612:10:066
3216799466125,338cyclictest0-21swapper/609:43:136
321659946680,296cyclictest0-21swapper/412:26:204
3216899465124,338cyclictest15850irq/123-ahci[0007:19:157
3216799465166,210cyclictest0-21swapper/610:23:366
3216799465124,338cyclictest14499-1kworker/u17:210:08:156
3216299465126,127cyclictest9393-21kworker/u16:011:40:371
32161994651,256cyclictest7838-21irqstats07:20:160
321669946480,211cyclictest0-21swapper/509:43:145
321659946479,211cyclictest49-21ksoftirqd/407:15:374
321659946441,256cyclictest0-21swapper/411:58:494
3216499464123,338cyclictest0-21swapper/309:21:573
3216199464381,3cyclictest111rcuc/008:15:040
321659946240,260cyclictest0-21swapper/411:15:484
3216599462120,210cyclictest49-21ksoftirqd/411:10:124
321619946235,296cyclictest0-21swapper/012:17:260
321649946135,423cyclictest0-21swapper/307:19:563
321629946176,211cyclictest241ktimersoftd/111:25:181
321689946033,211cyclictest73-21ksoftirqd/710:23:377
3216899460119,338cyclictest0-21swapper/710:47:347
3216699460377,2cyclictest561ktimersoftd/511:59:245
321629946038,256cyclictest30799-21ssh12:05:121
321629946038,219cyclictest0-21swapper/110:42:061
321619946082,175cyclictest32159-21cyclictest11:10:040
321689945936,2cyclictest15850irq/123-ahci[0010:25:057
3216699459117,339cyclictest1515-21kworker/u16:009:53:015
321649945980,84cyclictest0-21swapper/310:16:553
321649945980,84cyclictest0-21swapper/310:16:543
321649945979,296cyclictest0-21swapper/312:17:263
321639945937,2cyclictest0-21swapper/211:10:062
3216299459204,253cyclictest241ktimersoftd/112:04:471
3216299459118,338cyclictest0-21swapper/110:00:131
3216199459118,338cyclictest0-21swapper/011:50:140
321679945874,211cyclictest6064-21ssh09:25:286
3216799458117,338cyclictest0-21swapper/611:50:026
3216599457413,42cyclictest471rcuc/410:54:174
321659945735,256cyclictest0-21swapper/411:23:044
3216599457158,126cyclictest121rcu_preempt10:42:194
321649945731,423cyclictest0-21swapper/311:04:253
3216499457117,84cyclictest0-21swapper/310:00:213
321629945734,126cyclictest0-21swapper/110:07:191
3216899455114,338cyclictest0-21swapper/711:25:137
321619945532,211cyclictest31306-21ssh12:22:070
321689945129,84cyclictest0-21swapper/708:10:237
3216899451197,84cyclictest6172-21ssh10:57:427
321679945128,126cyclictest0-21swapper/610:50:216
3216699451369,3cyclictest561ktimersoftd/512:37:575
321619945128,338cyclictest0-21swapper/011:15:480
321679945028,49cyclictest0-21swapper/609:05:186
3216799450108,211cyclictest7608-21diskmemload11:10:086
321649945027,256cyclictest0-21swapper/311:10:223
321629945028,84cyclictest0-21swapper/111:05:041
321619945028,260cyclictest22851-21ssh11:25:070
321689944965,126cyclictest73-21ksoftirqd/709:30:367
321689944869,126cyclictest0-21swapper/710:42:367
321649944821,424cyclictest0-21swapper/312:22:063
321679944725,42cyclictest0-21swapper/612:26:186
321639944721,84cyclictest0-21swapper/208:40:082
321629944724,257cyclictest0-21swapper/112:22:091
321629944673,118cyclictest32159-21cyclictest10:50:271
321619944624,340cyclictest0-21swapper/011:40:340
3216899445192,87cyclictest0-21swapper/710:12:007
321639944465,295cyclictest0-21swapper/211:15:362
321639944358,126cyclictest33-21ksoftirqd/212:17:152
3216399443232,49cyclictest0-21swapper/209:48:202
321639944219,256cyclictest0-21swapper/210:00:132
321659944119,256cyclictest28223-21ssh12:38:024
321619944114,88cyclictest0-21swapper/007:19:160
321659944018,256cyclictest0-21swapper/412:21:504
321689943817,255cyclictest0-21swapper/710:00:127
3216299438101,172cyclictest0-21swapper/111:59:371
3216199438141,124cyclictest121rcu_preempt12:38:290
321659943753,168cyclictest0-21swapper/412:17:274
321659943594,338cyclictest0-21swapper/408:40:034
321659943514,84cyclictest0-21swapper/409:05:144
32164994348,423cyclictest0-21swapper/311:50:133
321689943353,84cyclictest0-21swapper/709:21:457
3216499431175,254cyclictest401ktimersoftd/311:25:173
32164994303,423cyclictest6626-21seq08:11:193
321639942887,338cyclictest0-21swapper/209:05:202
321689942585,337cyclictest0-21swapper/711:05:237
3216799425124,216cyclictest30800-21ssh12:05:126
321689942481,340cyclictest31306-21ssh12:22:077
321679942483,126cyclictest65-21ksoftirqd/611:22:336
3216799424376,45cyclictest631rcuc/611:04:376
321669942483,338cyclictest0-21swapper/507:19:515
32161994241,84cyclictest0-21swapper/009:05:140
32164994231,2cyclictest0-21swapper/312:05:113
321689942281,338cyclictest0-21swapper/711:04:407
321689942241,85cyclictest0-21swapper/712:25:507
321639942282,338cyclictest0-21swapper/211:25:132
321689942180,338cyclictest0-21swapper/711:23:017
3216399421122,126cyclictest33-21ksoftirqd/212:26:122
321689942079,338cyclictest0-21swapper/710:08:177
321659942080,211cyclictest121rcu_preempt11:40:454
321639942039,169cyclictest33-21ksoftirqd/212:21:512
321629942082,84cyclictest0-21swapper/107:19:151
321679941980,84cyclictest0-21swapper/611:25:176
321669941979,338cyclictest0-21swapper/509:05:215
321619941839,295cyclictest0-21swapper/010:16:540
321619941839,295cyclictest0-21swapper/010:16:540
321659941738,254cyclictest0-21swapper/409:43:254
321679941674,126cyclictest65-21ksoftirqd/610:00:146
321669941674,211cyclictest57-21ksoftirqd/512:00:345
321629941677,84cyclictest0-21swapper/112:26:191
321689941578,84cyclictest0-21swapper/712:05:117
321689941577,83cyclictest0-21swapper/710:16:547
321689941577,83cyclictest0-21swapper/710:16:547
321669941576,337cyclictest0-21swapper/512:25:545
321629941534,169cyclictest25-21ksoftirqd/109:35:121
3216799414161,87cyclictest641ktimersoftd/608:15:156
321649941430,381cyclictest17799-21ssh12:32:083
3216899413114,126cyclictest27492-21sshd11:10:107
321649941329,381cyclictest0-21swapper/311:15:373
321619941374,84cyclictest0-21swapper/009:35:120
321659941128,338cyclictest0-21swapper/410:00:064
321629941172,84cyclictest0-21swapper/111:04:291
321639941067,92cyclictest0-21swapper/209:35:032
321629941071,84cyclictest0-21swapper/109:43:141
321619941069,338cyclictest0-21swapper/012:05:200
321619940968,338cyclictest0-21swapper/012:41:490
321679940829,41cyclictest121rcu_preempt12:17:286
3216299408109,126cyclictest0-21swapper/108:15:141
321679940764,211cyclictest0-21swapper/612:21:356
321679940667,84cyclictest0-21swapper/609:35:106
321669940665,338cyclictest0-21swapper/510:16:545
321669940665,338cyclictest0-21swapper/510:16:545
321639940668,42cyclictest0-21swapper/207:19:562
321689940466,83cyclictest0-21swapper/711:40:327
3216799403105,126cyclictest0-21swapper/608:40:066
321629940364,84cyclictest0-21swapper/111:10:201
3216299400104,84cyclictest121rcu_preempt11:15:411
321679939960,84cyclictest0-21swapper/611:50:146
321619939919,296cyclictest0-21swapper/009:43:240
321679939859,84cyclictest0-21swapper/611:41:186
321669939857,338cyclictest0-21swapper/511:25:125
321659939815,380cyclictest0-21swapper/412:05:124
321639939864,245cyclictest0-21swapper/212:32:092
321629939659,84cyclictest121rcu_preempt12:32:091
321669939554,211cyclictest0-21swapper/510:00:105
321649939454,84cyclictest0-21swapper/308:18:423
321689939354,84cyclictest0-21swapper/709:05:157
321669939356,126cyclictest20139-21rm09:35:115
321629939351,126cyclictest0-21swapper/109:05:201
321679939111,84cyclictest6210-21chrt07:19:576
321669939150,338cyclictest0-21swapper/511:15:425
32168993909,169cyclictest0-21swapper/711:15:457
32166993906,127cyclictest27491-21ssh11:10:095
32166993851,255cyclictest0-21swapper/512:05:125
321629938513,246cyclictest0-21swapper/111:50:141
32165993822,210cyclictest49-21ksoftirqd/409:48:204
3216799378167,88cyclictest641ktimersoftd/612:32:096
321649937779,84cyclictest0-21swapper/309:43:133
321659937539,168cyclictest0-21swapper/412:41:494
321659937534,126cyclictest0-21swapper/412:32:084
321649937434,337cyclictest0-21swapper/312:41:493
321689937335,42cyclictest0-21swapper/708:15:157
321619937134,253cyclictest0-21swapper/012:32:080
321639936831,2cyclictest0-21swapper/209:43:232
321629936831,218cyclictest0-21swapper/108:40:081
321689936728,84cyclictest0-21swapper/712:41:497
321619936632,250cyclictest0-21swapper/009:48:200
321669936425,84cyclictest0-21swapper/509:48:215
321619936469,211cyclictest0-21swapper/008:40:040
321689936326,84cyclictest0-21swapper/707:20:187
321679936166,84cyclictest0-21swapper/611:15:436
321679935821,132cyclictest0-21swapper/607:20:206
321679935819,85cyclictest0-21swapper/610:16:506
321679935819,85cyclictest0-21swapper/610:16:506
321659935821,121cyclictest49-21ksoftirqd/410:16:544
321659935821,121cyclictest49-21ksoftirqd/410:16:544
3216299358102,253cyclictest0-21swapper/110:16:541
3216299358102,253cyclictest0-21swapper/110:16:541
321639935719,3cyclictest0-21swapper/210:16:552
321639935719,3cyclictest0-21swapper/210:16:552
321649935312,338cyclictest0-21swapper/308:40:083
321639935314,84cyclictest0-21swapper/212:41:502
321639935215,255cyclictest0-21swapper/208:18:402
321689935154,84cyclictest0-21swapper/709:35:107
32163993451,85cyclictest0-21swapper/207:20:182
32164993421,338cyclictest0-21swapper/309:48:203
321689933882,253cyclictest0-21swapper/708:40:087
3216299338209,44cyclictest0-21swapper/109:48:201
321629933435,126cyclictest0-21swapper/112:41:501
321689933176,84cyclictest0-21swapper/709:43:137
321669932935,213cyclictest0-21swapper/508:40:065
321669932335,36cyclictest3465-21sh12:41:505
321629932126,41cyclictest0-21swapper/107:20:171
3216699315144,83cyclictest0-21swapper/512:32:085
3216799302135,86cyclictest0-21swapper/612:41:506
321679930044,253cyclictest0-21swapper/609:48:216
321689929340,2cyclictest0-21swapper/712:32:077
3216899285159,8cyclictest721ktimersoftd/709:48:207
3166329646,28sleep40-21swapper/407:09:054
104512940,4sleep09-21ksoftirqd/009:10:220
189122860,0sleep40-21swapper/409:15:154
3067228546,34sleep20-21swapper/207:05:192
2992328581,2sleep50-21swapper/507:05:135
3149728453,27sleep60-21swapper/607:06:426
3142428351,28sleep70-21swapper/707:05:407
3149428250,28sleep30-21swapper/307:06:393
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional