You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-03 - 23:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Fri Apr 03, 2026 12:57:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
226429974161,677cyclictest0-21swapper/712:21:237
226429973656,677cyclictest0-21swapper/712:47:467
2263899721167,338cyclictest30028-21diskmemload10:32:413
226429971880,635cyclictest0-21swapper/710:51:287
226429969860,634cyclictest17757-21ssh09:58:457
226429969616,677cyclictest0-21swapper/712:16:197
22642996843,42cyclictest0-21swapper/712:39:517
226429967540,551cyclictest11326-21ssh10:48:527
2263699669116,338cyclictest0-21swapper/111:33:471
2264099668114,340cyclictest121rcu_preempt12:25:175
2264099665112,295cyclictest57-21ksoftirqd/509:55:185
226429964911,550cyclictest0-21swapper/712:05:047
226369964813,126cyclictest0-21swapper/110:02:451
22642996416,384cyclictest0-21swapper/712:13:307
22635996390,84cyclictest0-21swapper/010:51:280
22641996351,2cyclictest0-21swapper/612:13:296
22640996352,2cyclictest0-21swapper/512:13:295
2263799634123,338cyclictest121rcu_preempt10:25:382
2263599632123,507cyclictest0-21swapper/010:55:090
2263599627117,338cyclictest11364-21sh10:48:570
226359962332,422cyclictest0-21swapper/012:24:260
2263699621111,211cyclictest121rcu_preempt12:48:171
2263599621534,84cyclictest111rcuc/012:13:570
226389962066,381cyclictest0-21swapper/311:34:293
2263699619150,296cyclictest0-21swapper/111:22:261
226359961620,338cyclictest0-21swapper/010:25:290
226359961421,127cyclictest0-21swapper/009:53:410
226369961014,85cyclictest0-21swapper/109:50:491
2263999608268,338cyclictest64450irq/122-eth011:14:404
226359960712,380cyclictest0-21swapper/012:05:000
226389960491,296cyclictest0-21swapper/311:49:283
226369960189,380cyclictest0-21swapper/112:23:131
226399959991,127cyclictest0-21swapper/412:25:024
22637995980,84cyclictest0-21swapper/209:56:452
22638995950,84cyclictest22633-21cyclictest12:13:533
22635995953,2cyclictest0-21swapper/012:08:300
22637995940,84cyclictest0-21swapper/212:25:092
22636995940,211cyclictest0-21swapper/109:47:561
226429959341,507cyclictest0-21swapper/711:35:217
22639995930,84cyclictest0-21swapper/410:28:404
22638995930,84cyclictest0-21swapper/310:28:403
226429959281,381cyclictest121rcu_preempt10:04:197
226359959140,337cyclictest698-21ptp4l09:45:180
226389958977,296cyclictest0-21swapper/309:19:303
226399958776,381cyclictest0-21swapper/410:51:164
2263999587247,338cyclictest64450irq/122-eth009:53:494
226379958675,211cyclictest33-21ksoftirqd/209:18:102
226379958637,338cyclictest22633-21cyclictest12:09:412
226359958632,127cyclictest0-21swapper/009:55:120
226429958532,550cyclictest11697-21taskset09:16:327
226419958574,508cyclictest0-21swapper/609:55:186
226399958477,126cyclictest0-21swapper/410:55:094
226429958373,507cyclictest0-21swapper/711:41:497
2263999582120,122cyclictest22633-21cyclictest10:00:024
2263599582156,423cyclictest21235-21ssh11:47:510
226409958173,126cyclictest0-21swapper/510:55:085
226419958069,380cyclictest0-21swapper/609:50:306
226409957970,127cyclictest0-21swapper/511:43:025
226419957666,507cyclictest0-21swapper/612:38:116
226379957627,8cyclictest0-21swapper/211:49:382
2263799576154,125cyclictest0-21swapper/210:55:272
226389957564,380cyclictest0-21swapper/312:46:493
226359957520,337cyclictest0-21swapper/010:00:130
226369957319,84cyclictest0-21swapper/112:11:051
226359957318,338cyclictest0-21swapper/012:28:210
226429957222,171cyclictest0-21swapper/712:25:217
226419957063,126cyclictest121rcu_preempt11:34:076
226399957017,339cyclictest0-21swapper/411:42:184
2263699570102,295cyclictest0-21swapper/109:16:571
2264099568143,124cyclictest121rcu_preempt10:00:555
226409956555,295cyclictest121rcu_preempt09:50:315
226389956393,296cyclictest0-21swapper/310:00:313
22642995541,41cyclictest0-21swapper/709:14:457
22639995532,126cyclictest0-21swapper/411:46:204
22636995534,126cyclictest10961-21ssh10:31:361
22636995520,84cyclictest17758-21chrt09:58:451
22636995510,84cyclictest0-21swapper/112:25:051
226359955183,465cyclictest0-21swapper/012:38:120
22640995501,383cyclictest0-21swapper/512:08:305
2263799550165,254cyclictest121rcu_preempt12:13:052
22636995501,41cyclictest0-21swapper/110:25:351
226389954678,465cyclictest0-21swapper/312:18:023
226429954534,508cyclictest711rcuc/709:52:547
226359954537,126cyclictest726-21gmain09:18:390
226409954476,211cyclictest0-21swapper/511:49:475
2263999544122,334cyclictest0-21swapper/412:46:364
2263799544288,254cyclictest321ktimersoftd/212:21:282
226369954436,424cyclictest0-21swapper/110:51:331
226389954234,341cyclictest0-21swapper/312:08:293
226429954030,507cyclictest0-21swapper/709:43:377
226419954070,296cyclictest0-21swapper/610:02:586
2263899540284,254cyclictest401ktimersoftd/312:38:143
226369954071,253cyclictest121rcu_preempt12:05:331
226369953928,338cyclictest0-21swapper/112:16:131
226359953931,127cyclictest4761-21ssh12:18:390
226369953830,126cyclictest0-21swapper/112:04:381
226399953728,127cyclictest0-21swapper/410:04:244
226379953726,126cyclictest0-21swapper/212:04:222
2263999536196,338cyclictest264-21jbd2/md0-809:17:514
226389953623,127cyclictest0-21swapper/310:49:343
226429953463,468cyclictest9566-21ssh11:22:387
226379953425,126cyclictest0-21swapper/212:38:112
226419953263,126cyclictest0-21swapper/612:48:076
226419953163,465cyclictest0-21swapper/611:42:486
2263999531108,254cyclictest17178-21diskmemload12:02:414
226369953162,296cyclictest0-21swapper/111:47:291
226419953022,382cyclictest0-21swapper/612:04:386
2264199530105,252cyclictest18364-21ssh10:54:376
226399953023,338cyclictest0-21swapper/410:48:454
226389953062,465cyclictest0-21swapper/310:00:003
2263699530274,126cyclictest721-21nscd11:43:281
226359952817,296cyclictest0-21swapper/010:30:120
226409952766,206cyclictest0-21swapper/512:18:235
226389952758,211cyclictest9999-21ssh12:22:153
226429952618,126cyclictest0-21swapper/712:40:217
226429952618,126cyclictest0-21swapper/712:40:217
226379952516,126cyclictest0-21swapper/210:53:172
226409952458,211cyclictest0-21swapper/509:47:195
226429952311,42cyclictest0-21swapper/710:27:127
226409952115,83cyclictest25363-21ssh11:14:215
226409952114,254cyclictest0-21swapper/511:22:385
22642995131,338cyclictest0-21swapper/709:48:517
22637995110,85cyclictest5058-21ssh09:48:292
22641995091,126cyclictest0-21swapper/612:17:196
2263899508170,336cyclictest22633-21cyclictest09:44:523
226379950840,253cyclictest0-21swapper/211:22:442
226429950739,465cyclictest0-21swapper/711:46:387
226409950579,126cyclictest0-21swapper/512:04:095
226409950478,295cyclictest0-21swapper/510:55:055
226389950434,127cyclictest0-21swapper/310:52:153
226369950334,296cyclictest20489-21/usr/sbin/munin10:55:221
2263599503121,84cyclictest0-21swapper/011:42:170
226399950234,465cyclictest0-21swapper/412:38:154
226379950276,84cyclictest121rcu_preempt11:35:132
226359950238,211cyclictest0-21swapper/011:15:090
226389950129,423cyclictest0-21swapper/311:42:423
226369950180,41cyclictest121rcu_preempt11:35:351
226369950137,253cyclictest698-21ptp4l10:49:511
226359950137,261cyclictest0-21swapper/012:47:110
226359950132,211cyclictest0-21swapper/008:28:460
2263599500119,84cyclictest0-21swapper/009:42:420
226429949931,465cyclictest0-21swapper/712:03:517
2263999499117,85cyclictest15179-21ssh12:25:524
226389949977,338cyclictest0-21swapper/309:49:183
226369949934,126cyclictest0-21swapper/111:15:341
226429949875,343cyclictest0-21swapper/710:55:097
2264199498116,127cyclictest721-21nscd10:30:146
226419949731,381cyclictest0-21swapper/612:05:456
226389949774,338cyclictest0-21swapper/312:04:293
226389949728,466cyclictest1553-21runrttasks10:55:093
226379949774,211cyclictest0-21swapper/211:42:402
226379949729,338cyclictest0-21swapper/211:32:472
226379949728,85cyclictest0-21swapper/209:51:482
2263799497114,84cyclictest121rcu_preempt12:19:232
226379949669,42cyclictest121rcu_preempt09:43:162
226409949570,295cyclictest4428-21ssh10:26:505
226399949573,84cyclictest0-21swapper/411:33:144
226399949531,380cyclictest0-21swapper/412:17:424
226389949568,296cyclictest0-21swapper/311:15:333
2263999494196,126cyclictest121rcu_preempt09:48:204
2263699494153,338cyclictest12425-21kworker/u16:211:14:591
226419949370,211cyclictest0-21swapper/610:29:476
226359949324,253cyclictest0-21swapper/009:14:560
226379949269,211cyclictest0-21swapper/210:31:102
2263599491113,82cyclictest0-21swapper/011:22:040
226429949025,253cyclictest25735-21ssh11:14:387
226419949062,169cyclictest10391-21sh12:22:496
226389949067,211cyclictest0-21swapper/312:27:543
2263999489276,168cyclictest30028-21diskmemload09:44:174
2263799489190,296cyclictest22633-21cyclictest10:04:222
2263699489236,42cyclictest0-21swapper/109:44:561
2263599489108,84cyclictest0-21swapper/011:14:400
226409948865,169cyclictest0-21swapper/509:43:395
226399948825,168cyclictest25243-21ssh12:09:314
226419948619,85cyclictest0-21swapper/610:23:426
226419948618,465cyclictest0-21swapper/611:35:336
226419948521,380cyclictest0-21swapper/609:47:466
226409948517,465cyclictest0-21swapper/512:21:285
226429948419,127cyclictest0-21swapper/711:34:567
226429948415,466cyclictest32587-21ssh10:24:587
226429948319,386cyclictest0-21swapper/710:05:087
226419948318,256cyclictest0-21swapper/609:17:086
226369948357,168cyclictest0-21swapper/112:38:381
226379948115,211cyclictest0-21swapper/211:14:412
226429948011,41cyclictest0-21swapper/710:30:187
226389948015,254cyclictest0-21swapper/309:53:193
2264099478223,253cyclictest561ktimersoftd/509:16:185
22641994768,253cyclictest0-21swapper/611:47:156
22640994759,261cyclictest0-21swapper/510:49:195
2263999474388,84cyclictest471rcuc/410:31:364
2263799471129,126cyclictest33-21ksoftirqd/210:24:302
22640994673,126cyclictest10973-1kworker/u17:212:47:215
226369946681,211cyclictest25-21ksoftirqd/110:05:111
2264099465123,169cyclictest57-21ksoftirqd/509:14:535
22639994651,300cyclictest0-21swapper/410:24:274
2263599465168,85cyclictest121rcu_preempt11:50:110
2264199464417,42cyclictest631rcuc/612:28:196
226409946480,211cyclictest0-21swapper/510:30:555
226409946380,380cyclictest31742-21nscd12:38:125
226399946380,126cyclictest121rcu_preempt11:35:034
2263999463124,84cyclictest0-21swapper/408:28:374
2263999463123,337cyclictest7473-21ssh12:40:344
2263999463123,337cyclictest7473-21ssh12:40:334
2263899463121,339cyclictest0-21swapper/311:22:103
226399946238,337cyclictest0-21swapper/412:11:294
2263999462124,83cyclictest0-21swapper/411:22:364
226359946281,84cyclictest22633-21cyclictest11:33:470
226379946134,84cyclictest0-21swapper/212:48:202
226359946139,2cyclictest0-21swapper/012:40:270
226359946139,2cyclictest0-21swapper/012:40:270
226419946038,253cyclictest698-21ptp4l08:29:206
226419945933,210cyclictest65-21ksoftirqd/609:43:106
2263799459287,84cyclictest0-21swapper/212:40:212
2263799459287,84cyclictest0-21swapper/212:40:212
226399945875,210cyclictest0-21swapper/408:30:194
226379945777,84cyclictest0-21swapper/210:49:442
2264299456157,126cyclictest121rcu_preempt11:15:187
2264199456116,337cyclictest0-21swapper/612:40:156
2264199456116,337cyclictest0-21swapper/612:40:156
2263699456115,338cyclictest0-21swapper/110:24:581
2263999455116,337cyclictest0-21swapper/411:15:224
2263599454113,126cyclictest26646-21fschecks_count10:05:160
226389945331,84cyclictest0-21swapper/310:05:073
226379945328,127cyclictest0-21swapper/211:15:202
2263999452112,337cyclictest0-21swapper/410:05:164
2263999450113,84cyclictest0-21swapper/409:14:284
2263899450111,84cyclictest1703-21sendmail-mta08:29:113
226389944926,261cyclictest0-21swapper/311:35:313
2263899449110,84cyclictest0-21swapper/310:24:443
2264099447232,89cyclictest739-21hwlatdetect11:35:195
226409944663,380cyclictest0-21swapper/512:40:435
226409944663,380cyclictest0-21swapper/512:40:435
226389944661,211cyclictest30028-21diskmemload12:40:243
226389944661,211cyclictest30028-21diskmemload12:40:243
226359944417,126cyclictest0-21swapper/011:35:320
226419943897,338cyclictest0-21swapper/610:49:256
226409943898,338cyclictest0-21swapper/511:32:435
226409943714,380cyclictest0-21swapper/510:23:425
226409943594,338cyclictest0-21swapper/510:05:085
226399943513,338cyclictest0-21swapper/409:20:094
226359943517,3cyclictest0-21swapper/009:20:060
226429943410,84cyclictest0-21swapper/709:20:077
226419943410,126cyclictest0-21swapper/611:22:376
226409943494,337cyclictest0-21swapper/508:29:225
22642994304,423cyclictest721ktimersoftd/708:29:247
226369943010,257cyclictest0-21swapper/112:40:361
226369943010,257cyclictest0-21swapper/112:40:361
226359942989,337cyclictest0-21swapper/008:30:190
22640994271,295cyclictest0-21swapper/511:15:205
226419942482,127cyclictest0-21swapper/610:55:446
226389942482,339cyclictest0-21swapper/309:20:093
226389942382,339cyclictest0-21swapper/309:14:593
226419942283,337cyclictest0-21swapper/610:05:156
226379942281,338cyclictest0-21swapper/210:05:192
226359942250,127cyclictest0-21swapper/010:24:030
2264299421122,126cyclictest22633-21cyclictest08:30:117
226389942181,338cyclictest0-21swapper/311:14:223
226369942181,338cyclictest0-21swapper/111:50:081
2263799420124,85cyclictest121rcu_preempt09:14:262
226369942079,338cyclictest0-21swapper/108:27:481
226379941980,84cyclictest0-21swapper/208:29:202
226429941877,338cyclictest0-21swapper/711:50:097
2264199418119,127cyclictest65-21ksoftirqd/609:20:066
226399941878,338cyclictest0-21swapper/411:50:074
226369941777,338cyclictest0-21swapper/109:20:061
226379941677,84cyclictest0-21swapper/208:30:122
226369941574,84cyclictest121rcu_preempt08:30:201
226419941475,337cyclictest0-21swapper/609:15:006
226419941372,338cyclictest0-21swapper/611:15:216
226419941333,42cyclictest0-21swapper/611:14:596
226389941373,338cyclictest0-21swapper/311:50:093
226389941232,296cyclictest0-21swapper/308:30:183
226369941170,338cyclictest0-21swapper/109:14:531
226409941025,211cyclictest57-21ksoftirqd/509:20:065
226379941070,85cyclictest0-21swapper/211:50:082
226419940766,338cyclictest0-21swapper/611:50:096
226419938645,338cyclictest0-21swapper/608:30:206
226409937840,253cyclictest0-21swapper/508:30:115
226409937840,171cyclictest0-21swapper/511:50:065
226379936324,84cyclictest0-21swapper/209:20:082
22021210183,14sleep60-21swapper/607:07:226
19687210095,2sleep40-21swapper/407:05:124
2219728757,27sleep30-21swapper/307:09:523
2190928554,28sleep70-21swapper/707:05:467
2189628554,27sleep50-21swapper/507:05:375
2208928252,27sleep00-21swapper/007:08:210
293092810,1sleep50-21swapper/511:00:125
1961427948,27sleep10-21swapper/107:05:081
2194027847,28sleep20-21swapper/207:06:142
22638993310,17cyclictest0-21swapper/307:59:053
22638993310,0cyclictest0-21swapper/308:44:153
22638993110,0cyclictest0-21swapper/307:42:083
22638993026,4cyclictest0-21swapper/308:17:183
22638992910,19cyclictest0-21swapper/307:51:333
22636992910,18cyclictest0-21swapper/107:33:261
22642992810,18cyclictest0-21swapper/707:51:257
22642992810,18cyclictest0-21swapper/707:19:147
22641992810,18cyclictest0-21swapper/608:17:296
22641992810,18cyclictest0-21swapper/607:13:596
22641992810,17cyclictest0-21swapper/608:43:356
22638992810,18cyclictest0-21swapper/309:37:383
22638992810,18cyclictest0-21swapper/309:37:383
22638992810,18cyclictest0-21swapper/307:19:493
22638992810,0cyclictest0-21swapper/307:14:013
22637992810,18cyclictest0-21swapper/207:14:222
22635992810,18cyclictest0-21swapper/009:37:490
22635992810,18cyclictest0-21swapper/009:37:490
22635992810,18cyclictest0-21swapper/008:44:010
22635992810,18cyclictest0-21swapper/007:51:220
22635992810,18cyclictest0-21swapper/007:33:300
22635992810,18cyclictest0-21swapper/007:19:220
22642992727,0cyclictest0-21swapper/707:41:477
22642992710,17cyclictest0-21swapper/709:37:387
22642992710,17cyclictest0-21swapper/709:37:377
22642992710,17cyclictest0-21swapper/708:53:037
22642992710,17cyclictest0-21swapper/708:53:027
22642992710,17cyclictest0-21swapper/708:17:017
22642992710,17cyclictest0-21swapper/707:33:227
22642992710,17cyclictest0-21swapper/707:26:547
22642992710,17cyclictest0-21swapper/707:14:077
22642992710,0cyclictest0-21swapper/708:43:387
22642992710,0cyclictest0-21swapper/708:24:597
22642992710,0cyclictest0-21swapper/708:08:517
22642992710,0cyclictest0-21swapper/707:59:107
22641992727,0cyclictest0-21swapper/609:37:386
22641992727,0cyclictest0-21swapper/609:37:376
22641992726,0cyclictest0-21swapper/607:41:466
22641992710,17cyclictest0-21swapper/608:09:136
22641992710,17cyclictest0-21swapper/607:59:136
22641992710,17cyclictest0-21swapper/607:50:596
22641992710,17cyclictest0-21swapper/607:20:006
22641992710,0cyclictest0-21swapper/609:02:056
22641992710,0cyclictest0-21swapper/608:53:156
22641992710,0cyclictest0-21swapper/608:53:146
22641992710,0cyclictest0-21swapper/607:33:236
22641992710,0cyclictest0-21swapper/607:26:536
22641992710,0cyclictest0-21swapper/607:19:426
22640992710,17cyclictest0-21swapper/509:02:065
22640992710,17cyclictest0-21swapper/508:52:545
22640992710,17cyclictest0-21swapper/508:52:535
22640992710,17cyclictest0-21swapper/508:17:295
22640992710,17cyclictest0-21swapper/507:41:465
22640992710,17cyclictest0-21swapper/507:33:525
22640992710,17cyclictest0-21swapper/507:19:165
22640992710,17cyclictest0-21swapper/507:14:095
22640992710,0cyclictest0-21swapper/509:37:345
22640992710,0cyclictest0-21swapper/509:37:335
22640992710,0cyclictest0-21swapper/508:43:395
22640992710,0cyclictest0-21swapper/508:09:095
22640992710,0cyclictest0-21swapper/507:51:155
22640992710,0cyclictest0-21swapper/507:27:225
22639992727,0cyclictest0-21swapper/408:17:374
22639992727,0cyclictest0-21swapper/407:42:294
22639992727,0cyclictest0-21swapper/407:33:554
22639992710,17cyclictest0-21swapper/409:38:024
22639992710,17cyclictest0-21swapper/409:38:014
22639992710,17cyclictest0-21swapper/409:02:004
22639992710,17cyclictest0-21swapper/408:43:364
22639992710,17cyclictest0-21swapper/407:59:364
22639992710,17cyclictest0-21swapper/407:27:224
22639992710,17cyclictest0-21swapper/407:19:474
22638992723,4cyclictest0-21swapper/307:33:273
22638992710,17cyclictest0-21swapper/309:02:013
22638992710,17cyclictest0-21swapper/307:27:023
22638992710,0cyclictest0-21swapper/308:52:413
22638992710,0cyclictest0-21swapper/308:52:403
22638992710,0cyclictest0-21swapper/308:08:523
22637992727,0cyclictest0-21swapper/207:59:122
22637992727,0cyclictest0-21swapper/207:51:062
22637992710,17cyclictest0-21swapper/208:52:422
22637992710,17cyclictest0-21swapper/208:52:412
22637992710,17cyclictest0-21swapper/208:09:212
22637992710,17cyclictest0-21swapper/207:33:542
22637992710,17cyclictest0-21swapper/207:27:012
22637992710,0cyclictest0-21swapper/209:37:442
22637992710,0cyclictest0-21swapper/209:37:432
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional