You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-10 - 19:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue Mar 10, 2026 12:55:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
92639967381,381cyclictest0-21swapper/310:37:063
926399654185,296cyclictest623-21nscd12:36:313
92629965319,382cyclictest0-21swapper/212:37:062
92649964512,2cyclictest0-21swapper/409:33:374
9262996360,126cyclictest121rcu_preempt09:44:242
9266996351,3cyclictest0-21swapper/609:33:376
92629963438,423cyclictest0-21swapper/211:34:042
926599626116,380cyclictest0-21swapper/511:09:225
92649962573,549cyclictest0-21swapper/412:27:064
92649962573,549cyclictest0-21swapper/412:27:064
92609962426,425cyclictest0-21swapper/009:43:580
92619962272,126cyclictest0-21swapper/110:58:521
92659962171,380cyclictest8151-21rm11:58:225
926299619278,338cyclictest16863-21diskmemload12:29:472
926299619278,338cyclictest16863-21diskmemload12:29:462
92679961219,387cyclictest0-21swapper/709:33:377
92609961116,126cyclictest0-21swapper/009:23:530
926299609269,338cyclictest6600-21kworker/u16:011:56:532
92609960552,84cyclictest0-21swapper/012:00:380
926599600136,46cyclictest31074-21ssh12:30:155
9261996008,383cyclictest631-21ptp4l09:33:381
926499597259,84cyclictest16435-21kworker/u16:311:09:524
926399597128,296cyclictest0-21swapper/309:34:083
9267995940,84cyclictest0-21swapper/711:11:207
9265995940,84cyclictest0-21swapper/510:39:365
92609958738,296cyclictest0-21swapper/010:39:470
92659958170,338cyclictest0-21swapper/512:37:475
92649958030,126cyclictest0-21swapper/409:35:164
92649958030,126cyclictest0-21swapper/409:35:164
92659957926,380cyclictest0-21swapper/509:44:325
92629957929,297cyclictest0-21swapper/210:39:302
926099577238,124cyclictest16863-21diskmemload10:11:540
92609957623,126cyclictest24520-21netstat11:15:190
926699574233,338cyclictest644-21nscd11:33:366
92639957261,126cyclictest4804-21taskset12:15:213
92609957266,124cyclictest0-21swapper/011:24:000
92609957266,124cyclictest0-21swapper/011:24:000
92609957266,124cyclictest0-21swapper/011:24:000
926099572105,380cyclictest0-21swapper/012:27:450
926099572105,380cyclictest0-21swapper/012:27:440
926499571149,126cyclictest121rcu_preempt11:12:534
92609957161,465cyclictest0-21swapper/011:33:200
92629956959,338cyclictest0-21swapper/210:09:022
92629956959,338cyclictest0-21swapper/210:09:022
92629956959,338cyclictest0-21swapper/210:09:012
92609956756,342cyclictest121rcu_preempt09:35:030
92609956714,423cyclictest0-21swapper/011:13:330
92619956197,255cyclictest16863-21diskmemload11:57:191
9266995609,211cyclictest0-21swapper/609:47:186
92619956010,126cyclictest0-21swapper/112:22:481
9261995596,380cyclictest0-21swapper/110:07:171
9261995596,380cyclictest0-21swapper/110:07:171
9261995596,380cyclictest0-21swapper/110:07:171
92639955141,296cyclictest0-21swapper/311:32:173
92639955083,169cyclictest0-21swapper/310:54:543
926399549250,126cyclictest0-21swapper/309:45:013
92629954879,338cyclictest0-21swapper/212:15:012
926099547343,83cyclictest29249-21ssh10:59:250
92639954436,126cyclictest121rcu_preempt11:24:233
92639954436,126cyclictest121rcu_preempt11:24:233
92639954436,126cyclictest121rcu_preempt11:24:233
92639954235,134cyclictest0-21swapper/311:14:553
92619954233,126cyclictest0-21swapper/112:32:131
92609954134,338cyclictest1683-21ntpd12:30:490
92659953927,338cyclictest0-21swapper/509:24:515
92629953928,296cyclictest0-21swapper/212:41:532
92649953869,85cyclictest121rcu_preempt12:36:264
92629953826,339cyclictest0-21swapper/212:31:322
92669953670,126cyclictest0-21swapper/611:09:026
92679953570,253cyclictest0-21swapper/712:33:157
92609953428,295cyclictest14641-21ssh11:08:510
926399532237,211cyclictest11812-1kworker/u17:110:55:353
92649953122,84cyclictest0-21swapper/409:45:514
92619953124,41cyclictest0-21swapper/112:04:121
92669953066,44cyclictest0-21swapper/609:41:546
926299530108,2cyclictest0-21swapper/211:22:362
926299530108,2cyclictest0-21swapper/211:22:362
926299530108,2cyclictest0-21swapper/211:22:362
926299529275,125cyclictest16863-21diskmemload11:42:232
926199529188,338cyclictest14242-21kworker/u16:309:41:231
926599528188,337cyclictest623-21nscd09:25:245
926299524223,84cyclictest0-21swapper/209:33:542
92629952312,381cyclictest121rcu_preempt10:54:262
92629952311,84cyclictest121rcu_preempt09:45:232
926099520480,37cyclictest111rcuc/012:14:030
92669951997,255cyclictest0-21swapper/612:37:066
926399519176,126cyclictest121rcu_preempt12:03:143
92659951812,422cyclictest0-21swapper/510:55:355
92639951546,296cyclictest0-21swapper/310:08:003
92639951546,296cyclictest0-21swapper/310:08:003
92639951546,296cyclictest0-21swapper/310:08:003
92669951488,126cyclictest65-21ksoftirqd/610:10:596
92619951445,253cyclictest0-21swapper/111:12:181
92649951289,126cyclictest0-21swapper/412:31:364
9262995121,508cyclictest0-21swapper/212:01:012
9264995110,84cyclictest0-21swapper/410:39:374
926099511128,168cyclictest8889-21ssh11:59:220
9266995091,84cyclictest0-21swapper/611:59:236
9266995090,84cyclictest0-21swapper/610:39:366
9267995081,84cyclictest0-21swapper/711:35:067
92629950881,296cyclictest0-21swapper/211:11:202
9260995081,256cyclictest0-21swapper/012:37:060
92679950579,211cyclictest73-21ksoftirqd/710:08:317
92679950579,211cyclictest73-21ksoftirqd/710:08:317
92679950579,211cyclictest73-21ksoftirqd/710:08:317
926599505249,254cyclictest561ktimersoftd/509:45:555
92649950540,84cyclictest121rcu_preempt11:56:404
92649950483,255cyclictest68350irq/122-eth010:09:344
92649950483,255cyclictest68350irq/122-eth010:09:344
92649950483,255cyclictest68350irq/122-eth010:09:344
926399504420,4cyclictest401ktimersoftd/311:55:493
926399503122,254cyclictest9258-21cyclictest11:42:243
926799502118,211cyclictest0-21swapper/710:55:307
92659950232,338cyclictest0-21swapper/512:02:275
92609950276,338cyclictest0-21swapper/012:22:480
92659950138,218cyclictest0-21swapper/510:08:245
92659950138,218cyclictest0-21swapper/510:08:245
92659950138,218cyclictest0-21swapper/510:08:245
92649950179,84cyclictest0-21swapper/412:00:534
92649950178,84cyclictest0-21swapper/410:59:494
92619950034,211cyclictest0-21swapper/112:28:341
92619950034,211cyclictest0-21swapper/112:28:341
92609950073,211cyclictest9-21ksoftirqd/009:25:100
926699498114,211cyclictest0-21swapper/610:34:006
9264994980,118cyclictest0-21swapper/409:44:244
92679949731,84cyclictest121rcu_preempt11:22:137
92679949731,84cyclictest121rcu_preempt11:22:137
92679949731,84cyclictest121rcu_preempt11:22:137
92669949775,84cyclictest0-21swapper/610:55:266
92669949734,46cyclictest0-21swapper/612:30:146
926299497116,84cyclictest121rcu_preempt09:25:042
926299496115,84cyclictest0-21swapper/210:57:502
926699495113,338cyclictest0-21swapper/612:02:196
92649949574,83cyclictest0-21swapper/411:34:414
92639949572,126cyclictest0-21swapper/309:46:453
92619949529,84cyclictest0-21swapper/111:32:171
92659949330,83cyclictest121rcu_preempt10:55:005
92659949324,338cyclictest0-21swapper/512:15:245
92609949370,84cyclictest121rcu_preempt10:09:200
92609949370,84cyclictest121rcu_preempt10:09:200
92609949370,84cyclictest121rcu_preempt10:09:200
92659949219,262cyclictest0-21swapper/510:12:325
92619949226,84cyclictest0-21swapper/111:22:441
92619949226,84cyclictest0-21swapper/111:22:441
92619949226,84cyclictest0-21swapper/111:22:441
926799491408,3cyclictest711rcuc/712:12:577
926699490234,254cyclictest641ktimersoftd/610:08:346
926699490234,254cyclictest641ktimersoftd/610:08:346
926699490234,254cyclictest641ktimersoftd/610:08:336
92629949063,211cyclictest0-21swapper/211:07:512
92619949024,211cyclictest0-21swapper/110:10:181
92649948923,84cyclictest0-21swapper/409:25:044
926399489104,127cyclictest41-21ksoftirqd/312:41:473
92679948828,37cyclictest0-21swapper/710:54:537
926699488151,126cyclictest21183-21ssh11:13:316
92619948866,175cyclictest21740-21sh09:45:231
92619948822,126cyclictest0-21swapper/110:37:061
92679948722,85cyclictest0-21swapper/711:59:387
92649948660,295cyclictest0-21swapper/411:24:004
92649948660,295cyclictest0-21swapper/411:24:004
92649948660,295cyclictest0-21swapper/411:24:004
926399486229,126cyclictest121rcu_preempt10:40:183
92639948617,296cyclictest0-21swapper/312:32:393
92679948519,211cyclictest0-21swapper/711:33:367
926399485105,215cyclictest623-21nscd12:21:483
92619948518,84cyclictest0-21swapper/110:54:531
92629948419,42cyclictest0-21swapper/212:22:492
92609948458,210cyclictest0-21swapper/010:54:490
92679948255,126cyclictest121rcu_preempt10:10:597
926799481224,255cyclictest721ktimersoftd/712:28:347
926799481224,255cyclictest721ktimersoftd/712:28:347
926599481225,253cyclictest561ktimersoftd/511:24:575
926599481225,253cyclictest561ktimersoftd/511:24:575
926599481225,253cyclictest561ktimersoftd/511:24:575
92619948115,126cyclictest0-21swapper/111:09:241
92679948015,295cyclictest0-21swapper/712:42:147
92629947851,296cyclictest0-21swapper/211:35:222
9262994748,84cyclictest0-21swapper/209:23:522
926599471216,253cyclictest561ktimersoftd/511:14:565
9264994716,253cyclictest0-21swapper/411:00:044
9265994704,84cyclictest0-21swapper/509:33:265
92679946884,381cyclictest0-21swapper/712:01:017
9264994684,254cyclictest0-21swapper/409:23:464
92649946745,126cyclictest0-21swapper/411:35:064
92639946782,211cyclictest41-21ksoftirqd/311:25:143
926799466125,338cyclictest0-21swapper/709:45:427
926699466124,126cyclictest65-21ksoftirqd/612:29:566
926699466124,126cyclictest65-21ksoftirqd/612:29:566
92659946685,88cyclictest25829-21tr10:40:155
92639946682,211cyclictest5848-21ssh10:11:003
926799465125,338cyclictest0-21swapper/709:40:417
926499465166,126cyclictest121rcu_preempt12:42:234
926399465124,338cyclictest0-21swapper/311:35:183
92679946441,4cyclictest23004-21sh10:37:417
92679946441,258cyclictest0-21swapper/711:09:367
926499464123,338cyclictest0-21swapper/410:40:194
926399464124,338cyclictest0-21swapper/312:28:403
926399464124,338cyclictest0-21swapper/312:28:393
92659946337,423cyclictest0-21swapper/511:41:575
92639946340,258cyclictest0-21swapper/311:09:363
92629946381,127cyclictest2675-21rm12:14:282
92629946340,339cyclictest0-21swapper/211:15:172
926299463123,337cyclictest30205-21runrttasks11:00:052
92659946279,380cyclictest0-21swapper/512:28:055
92659946279,380cyclictest0-21swapper/512:28:045
92639946240,256cyclictest0-21swapper/309:25:173
92629946240,256cyclictest0-21swapper/210:12:032
92629946239,256cyclictest0-21swapper/208:54:322
92669946034,168cyclictest65-21ksoftirqd/612:15:246
926099459202,126cyclictest0-21swapper/012:15:240
92679945878,296cyclictest0-21swapper/712:37:157
92669945832,88cyclictest0-21swapper/608:54:366
92619945835,84cyclictest0-21swapper/112:15:181
926799457116,338cyclictest0-21swapper/712:15:207
92659945776,84cyclictest0-21swapper/512:41:095
926499457116,126cyclictest49-21ksoftirqd/411:15:024
926199456118,89cyclictest121rcu_preempt12:41:391
926199456115,338cyclictest0-21swapper/112:35:421
926599455246,125cyclictest561ktimersoftd/512:14:115
926499455114,338cyclictest8679-21taskset08:55:144
926499455113,168cyclictest0-21swapper/410:11:164
926299455116,84cyclictest25808-21cut10:40:142
926599454113,338cyclictest0-21swapper/511:25:115
926399454112,339cyclictest0-21swapper/309:35:163
926399454112,339cyclictest0-21swapper/309:35:163
92629945330,257cyclictest0-21swapper/211:25:032
926399452112,209cyclictest121rcu_preempt12:14:363
926299452112,338cyclictest0-21swapper/209:35:172
926299452112,338cyclictest0-21swapper/209:35:172
926099452111,338cyclictest0-21swapper/011:35:070
926799451112,168cyclictest0-21swapper/709:24:407
926799450110,338cyclictest0-21swapper/711:42:507
92659945033,287cyclictest0-21swapper/511:34:575
926799449111,127cyclictest2080-21sh09:35:157
926799449111,127cyclictest2080-21sh09:35:147
926699449277,126cyclictest8624-21cut11:25:026
92609944826,255cyclictest0-21swapper/010:34:320
92649944764,210cyclictest0-21swapper/412:14:144
92619944723,45cyclictest0-21swapper/110:34:441
926099446107,84cyclictest0-21swapper/009:45:410
92619944519,211cyclictest0-21swapper/112:13:271
92649944360,338cyclictest0-21swapper/412:15:194
92609944320,211cyclictest9258-21cyclictest11:42:340
92659944221,337cyclictest616-21nscd12:21:485
926799441100,338cyclictest0-21swapper/710:34:517
92619944059,126cyclictest29210-21grep11:35:221
92609944014,211cyclictest9258-21cyclictest11:25:220
92649943916,84cyclictest0-21swapper/411:25:104
926099439140,126cyclictest121rcu_preempt10:40:120
92609943854,169cyclictest9-21ksoftirqd/011:00:060
92669943657,176cyclictest0-21swapper/608:04:496
92609943697,84cyclictest9258-21cyclictest12:42:020
92619943147,168cyclictest241ktimersoftd/109:25:251
9266994309,83cyclictest0-21swapper/611:00:136
92609942849,211cyclictest0-21swapper/009:35:160
92609942849,211cyclictest0-21swapper/009:35:150
92619942748,210cyclictest25-21ksoftirqd/111:25:151
9261994270,84cyclictest0-21swapper/111:15:281
92649942587,84cyclictest0-21swapper/412:22:154
9264994252,169cyclictest0-21swapper/410:34:414
92659942383,338cyclictest0-21swapper/511:15:195
92609942383,338cyclictest0-21swapper/008:55:130
92679942284,257cyclictest9258-21cyclictest11:15:077
92679942281,338cyclictest0-21swapper/709:25:197
92669942283,84cyclictest0-21swapper/611:35:186
92659942282,338cyclictest0-21swapper/511:00:135
92659942241,177cyclictest0-21swapper/509:35:115
92659942241,177cyclictest0-21swapper/509:35:115
92669942182,84cyclictest0-21swapper/612:41:236
92669942182,84cyclictest0-21swapper/611:42:526
92669942182,84cyclictest0-21swapper/611:25:146
92669942182,84cyclictest0-21swapper/611:24:006
92669942182,84cyclictest0-21swapper/611:24:006
92659942180,338cyclictest0-21swapper/510:34:315
92649942183,83cyclictest0-21swapper/411:42:524
92639942180,339cyclictest0-21swapper/309:24:403
92629942180,338cyclictest0-21swapper/210:34:312
92619942136,218cyclictest0-21swapper/110:40:121
92669942082,84cyclictest0-21swapper/612:23:016
92679941937,84cyclictest0-21swapper/711:25:147
92669941980,84cyclictest25691-21cpuspeed_turbos10:40:126
92669941980,84cyclictest0-21swapper/609:23:586
92669941879,84cyclictest0-21swapper/609:25:176
92659941777,338cyclictest0-21swapper/511:35:065
926199417119,295cyclictest0-21swapper/111:42:001
92669941677,84cyclictest0-21swapper/610:54:526
92669941677,84cyclictest0-21swapper/609:35:176
92669941677,84cyclictest0-21swapper/609:35:166
92659941675,338cyclictest0-21swapper/508:05:195
92669941576,84cyclictest0-21swapper/612:14:286
92639941536,83cyclictest121rcu_preempt11:00:103
926399415117,126cyclictest0-21swapper/311:15:223
92649941274,84cyclictest0-21swapper/408:54:374
92639941228,211cyclictest16994-21ssh10:34:003
92629941231,41cyclictest0-21swapper/208:55:072
926099412116,84cyclictest0-21swapper/008:54:320
92679941129,85cyclictest0-21swapper/710:40:177
92669941072,83cyclictest0-21swapper/608:55:136
92619941071,84cyclictest0-21swapper/109:24:131
92649940870,84cyclictest0-21swapper/410:54:374
92629940626,84cyclictest0-21swapper/208:05:192
92659940564,338cyclictest0-21swapper/508:54:515
92619940525,84cyclictest0-21swapper/109:35:151
92619940525,84cyclictest0-21swapper/109:35:151
92619940521,253cyclictest0-21swapper/111:00:041
92609940525,296cyclictest0-21swapper/008:05:180
92639940463,338cyclictest0-21swapper/308:55:153
92679940362,338cyclictest0-21swapper/712:22:487
92669940162,84cyclictest0-21swapper/611:15:166
92659940161,338cyclictest0-21swapper/508:55:135
92639939657,84cyclictest0-21swapper/308:54:373
92629939661,251cyclictest0-21swapper/208:04:062
92619939313,84cyclictest0-21swapper/108:04:241
92619939010,126cyclictest0-21swapper/111:52:561
9261993823,7cyclictest121rcu_preempt08:55:131
92679938143,84cyclictest0-21swapper/711:00:037
92639938080,127cyclictest41-21ksoftirqd/308:05:163
92679937537,4cyclictest0-21swapper/708:54:327
92659937436,172cyclictest0-21swapper/508:04:255
92619937236,170cyclictest0-21swapper/108:54:521
92609937033,171cyclictest0-21swapper/008:04:240
926499364108,253cyclictest0-21swapper/408:05:194
92679936329,46cyclictest0-21swapper/708:55:157
926799360147,126cyclictest121rcu_preempt08:05:197
92649935758,126cyclictest121rcu_preempt08:04:494
926399351141,84cyclictest0-21swapper/311:52:553
92639933841,3cyclictest0-21swapper/308:04:243
92679933641,3cyclictest0-21swapper/708:04:247
92619932832,3cyclictest0-21swapper/108:05:191
92669931559,254cyclictest0-21swapper/608:05:156
92629928135,165cyclictest0-21swapper/211:52:562
92659927317,92cyclictest32522-21snmpd11:52:565
92669926958,83cyclictest0-21swapper/611:52:556
926799266183,3cyclictest0-21swapper/711:52:557
9260992619,171cyclictest0-21swapper/011:52:550
92649923722,126cyclictest0-21swapper/411:52:564
682821460,11sleep40-21swapper/407:05:144
855329949,27sleep50-21swapper/507:06:035
874228552,29sleep60-21swapper/607:08:456
859628555,27sleep10-21swapper/107:06:391
883028352,28sleep70-21swapper/707:09:587
623328350,29sleep20-21swapper/207:05:042
878728149,28sleep30-21swapper/307:09:233
868728150,27sleep00-21swapper/007:07:590
188112800,2sleep3926399cyclictest10:18:433
259082690,0sleep70-21swapper/710:21:437
9265993610,6cyclictest0-21swapper/510:23:455
9265993427,3cyclictest121rcu_preempt09:12:565
9265993210,4cyclictest121rcu_preempt07:22:215
9265993127,3cyclictest0-21swapper/509:55:535
9265993110,19cyclictest121rcu_preempt10:04:165
9266992910,0cyclictest0-21swapper/607:15:026
9265992910,18cyclictest0-21swapper/508:44:135
9265992910,18cyclictest0-21swapper/508:39:235
9265992910,18cyclictest0-21swapper/508:34:255
9265992910,18cyclictest0-21swapper/507:50:185
9265992910,18cyclictest0-21swapper/507:42:515
9263992910,18cyclictest0-21swapper/309:56:073
9261992910,18cyclictest0-21swapper/108:23:531
9267992828,0cyclictest0-21swapper/708:44:207
9267992810,18cyclictest0-21swapper/710:04:177
9267992810,18cyclictest0-21swapper/707:30:147
9267992810,0cyclictest0-21swapper/707:50:537
9266992810,18cyclictest0-21swapper/610:04:366
9266992810,0cyclictest0-21swapper/609:08:246
9265992810,1cyclictest0-21swapper/507:46:375
9265992810,17cyclictest0-21swapper/507:15:225
9264992810,18cyclictest0-21swapper/407:15:174
9263992828,0cyclictest0-21swapper/307:30:023
9263992810,18cyclictest0-21swapper/307:50:533
9263992810,18cyclictest0-21swapper/307:22:223
9263992810,0cyclictest0-21swapper/310:24:053
9263992810,0cyclictest0-21swapper/308:24:193
9263992810,0cyclictest0-21swapper/308:13:113
9262992828,0cyclictest0-21swapper/209:08:192
9262992810,18cyclictest0-21swapper/210:04:222
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional