You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-17 - 00:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Thu Jul 16, 2026 12:56:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
99669981512,719cyclictest0-21swapper/609:39:236
99649973613,591cyclictest0-21swapper/411:15:104
99669970366,634cyclictest0-21swapper/612:32:556
99669969717,677cyclictest0-21swapper/612:14:586
9966996781,41cyclictest0-21swapper/611:05:126
99659966127,126cyclictest0-21swapper/511:22:025
99659966127,126cyclictest0-21swapper/511:22:025
99659966127,126cyclictest0-21swapper/511:22:025
9966996389,76cyclictest0-21swapper/607:35:226
996599637126,381cyclictest28932-1kworker/u17:012:16:075
99619963178,380cyclictest0-21swapper/112:15:131
99669961722,592cyclictest0-21swapper/610:54:476
99669961217,592cyclictest2279-21rm11:35:546
99669961119,508cyclictest0-21swapper/608:05:116
99669960813,592cyclictest11331-21ssh11:23:406
99669960813,592cyclictest11331-21ssh11:23:406
99669960813,592cyclictest11331-21ssh11:23:406
996499596217,4cyclictest64450irq/122-eth012:14:544
99649959585,507cyclictest0-21swapper/412:15:294
996499594254,337cyclictest64450irq/122-eth011:52:024
996199590427,79cyclictest231rcuc/110:45:211
99679958934,381cyclictest0-21swapper/711:35:487
996499587165,382cyclictest17718-21diskmemload11:56:424
99619958779,126cyclictest0-21swapper/111:52:001
996199584119,126cyclictest0-21swapper/109:38:151
99609958378,336cyclictest0-21swapper/012:44:360
99669958031,465cyclictest0-21swapper/612:20:576
99609957627,126cyclictest0-21swapper/012:18:270
996599575106,126cyclictest29046-21ssh12:14:265
99609957364,507cyclictest0-21swapper/011:05:000
996499572145,295cyclictest121rcu_preempt11:22:314
996499572145,295cyclictest121rcu_preempt11:22:314
996499572145,295cyclictest121rcu_preempt11:22:314
99609957266,126cyclictest0-21swapper/011:55:440
99679956717,128cyclictest11540-21ssh11:05:137
99659956760,126cyclictest121rcu_preempt10:53:475
996499566226,337cyclictest21716-21nscd11:36:484
99619956557,126cyclictest121rcu_preempt11:47:411
99649956314,380cyclictest0-21swapper/412:32:454
99609956313,126cyclictest0-21swapper/011:13:080
99609956253,127cyclictest0-21swapper/009:40:200
996699559219,338cyclictest20717-1kworker/u17:010:05:026
9961995598,420cyclictest0-21swapper/110:02:431
9961995598,420cyclictest0-21swapper/110:02:421
9962995556,295cyclictest0-21swapper/212:22:572
9965995520,84cyclictest1551-21snmpd10:03:415
9965995520,84cyclictest1551-21snmpd10:03:415
996199552212,338cyclictest32558-21kworker/u16:012:20:111
9965995511,304cyclictest0-21swapper/507:36:165
9961995510,84cyclictest0-21swapper/110:52:481
99609955141,379cyclictest0-21swapper/011:24:060
99609955141,379cyclictest0-21swapper/011:24:060
99609955141,379cyclictest0-21swapper/011:24:060
996099551124,211cyclictest9-21ksoftirqd/010:02:280
996099551124,211cyclictest9-21ksoftirqd/010:02:270
99669954837,508cyclictest0-21swapper/612:15:286
996499548123,422cyclictest0-21swapper/411:46:224
996499547123,338cyclictest0-21swapper/412:21:414
996099546162,381cyclictest0-21swapper/011:52:480
99649954580,210cyclictest0-21swapper/411:12:324
99639954578,126cyclictest121rcu_preempt11:55:053
99679954433,508cyclictest0-21swapper/712:17:097
99609954379,7cyclictest1551-21snmpd12:22:580
996699540456,3cyclictest631rcuc/611:04:016
99669954029,508cyclictest0-21swapper/610:03:526
99669954029,508cyclictest0-21swapper/610:03:526
99649953971,465cyclictest0-21swapper/407:33:184
99649953933,339cyclictest0-21swapper/410:04:144
99649953933,339cyclictest0-21swapper/410:04:144
99629953930,84cyclictest0-21swapper/211:37:262
99629953930,127cyclictest0-21swapper/208:25:182
99649953830,84cyclictest0-21swapper/408:23:344
996699537111,423cyclictest0-21swapper/611:13:036
99679953525,507cyclictest0-21swapper/711:05:007
996099535105,380cyclictest0-21swapper/011:15:340
99669953423,508cyclictest0-21swapper/609:40:066
99609953428,345cyclictest0-21swapper/010:05:310
99669953364,338cyclictest0-21swapper/611:47:456
99669953061,466cyclictest0-21swapper/612:00:056
99669953061,466cyclictest0-21swapper/612:00:056
99649952923,341cyclictest0-21swapper/409:40:264
99649952919,507cyclictest0-21swapper/411:05:004
99679952819,126cyclictest0-21swapper/712:43:437
99669952818,168cyclictest0-21swapper/612:44:136
99639952661,210cyclictest0-21swapper/312:33:243
99649952397,210cyclictest1553-21runrttasks11:32:334
99679952299,4cyclictest15850irq/123-ahci[0011:46:397
99629952256,254cyclictest0-21swapper/212:33:222
99609952253,211cyclictest17718-21diskmemload09:36:130
996399521180,339cyclictest25909-21kworker/u16:111:33:113
99619951646,340cyclictest0-21swapper/111:56:581
9966995155,41cyclictest0-21swapper/611:50:266
9965995158,126cyclictest0-21swapper/512:33:215
996099515260,253cyclictest101ktimersoftd/012:13:030
9964995147,211cyclictest0-21swapper/410:05:034
9961995147,42cyclictest121rcu_preempt12:44:401
9963995130,84cyclictest0-21swapper/311:03:093
9964995111,507cyclictest0-21swapper/409:39:004
99629951184,211cyclictest33-21ksoftirqd/211:55:202
9967995100,85cyclictest26561-21sh11:52:377
9965995091,126cyclictest11087-21ssh11:04:595
9963995090,84cyclictest0-21swapper/310:03:413
9963995090,84cyclictest0-21swapper/310:03:403
99629950983,211cyclictest33-21ksoftirqd/210:54:092
996099507123,211cyclictest26069-21sh10:54:180
996199506123,177cyclictest0-21swapper/111:32:161
996599505120,301cyclictest0-21swapper/507:43:055
996399505120,211cyclictest41-21ksoftirqd/312:17:083
99609950541,295cyclictest0-21swapper/011:48:410
996499504124,84cyclictest0-21swapper/411:05:144
99629950432,85cyclictest0-21swapper/211:15:382
996199504124,212cyclictest14283-21kworker/u16:211:22:191
996199504124,212cyclictest14283-21kworker/u16:211:22:191
996199504124,212cyclictest14283-21kworker/u16:211:22:191
99669950279,126cyclictest0-21swapper/611:56:426
99669950234,424cyclictest0-21swapper/607:42:366
99619950276,253cyclictest0-21swapper/111:14:411
99619950276,210cyclictest25-21ksoftirqd/111:05:261
99619950274,127cyclictest10202-21ssh11:03:381
996099502119,380cyclictest0-21swapper/007:34:140
99659950132,211cyclictest0-21swapper/509:37:265
99619950080,82cyclictest0-21swapper/111:39:371
99619950033,127cyclictest0-21swapper/110:05:291
99679949931,380cyclictest0-21swapper/710:54:457
99629949972,211cyclictest0-21swapper/207:37:192
99669949672,381cyclictest0-21swapper/608:23:346
996299496452,42cyclictest311rcuc/212:43:522
99659949574,83cyclictest0-21swapper/512:43:435
99659949535,249cyclictest17718-21diskmemload11:33:135
99679949472,338cyclictest0-21swapper/712:13:547
996399494155,169cyclictest391rcuc/307:34:133
996399494112,380cyclictest0-21swapper/311:52:483
99629949467,211cyclictest0-21swapper/211:31:342
99619949471,169cyclictest0-21swapper/112:12:551
996599493238,253cyclictest561ktimersoftd/511:12:315
99639949370,84cyclictest0-21swapper/312:43:443
99639949227,261cyclictest0-21swapper/311:14:003
996299492108,211cyclictest11325-21ssh11:23:392
996299492108,211cyclictest11325-21ssh11:23:392
996299492108,211cyclictest11325-21ssh11:23:392
99639949164,211cyclictest41-21ksoftirqd/311:48:223
996799490191,126cyclictest121rcu_preempt10:04:507
996799490191,126cyclictest121rcu_preempt10:04:497
996599490150,126cyclictest121rcu_preempt08:24:575
99609948925,301cyclictest0-21swapper/011:38:370
99629948862,423cyclictest0-21swapper/212:16:582
99659948761,211cyclictest0-21swapper/511:50:415
99649948722,342cyclictest0-21swapper/407:44:104
99649948718,380cyclictest0-21swapper/412:42:434
99639948722,210cyclictest0-21swapper/312:20:113
99629948721,84cyclictest0-21swapper/211:54:142
99619948723,45cyclictest12656-21sh12:25:211
99609948723,261cyclictest0-21swapper/012:32:260
99659948616,380cyclictest0-21swapper/510:05:355
996499486188,296cyclictest26093-21kworker/u16:310:53:104
99639948518,212cyclictest0-21swapper/308:23:553
99669948356,211cyclictest65-21ksoftirqd/607:34:146
99619948316,301cyclictest0-21swapper/111:15:151
99679948260,256cyclictest698-21ptp4l11:11:467
99669948113,465cyclictest0-21swapper/608:03:576
99629948015,42cyclictest0-21swapper/212:12:542
99619947910,338cyclictest0-21swapper/112:32:391
99659947856,84cyclictest0-21swapper/511:15:185
99659947717,329cyclictest0-21swapper/511:57:065
996099477223,252cyclictest101ktimersoftd/007:42:160
9965994759,211cyclictest0-21swapper/511:38:105
9961994749,126cyclictest1553-21runrttasks07:35:241
9966994723,42cyclictest0-21swapper/611:33:126
99639947047,257cyclictest3382-21sshd11:37:303
99639946684,82cyclictest0-21swapper/311:21:163
99639946684,82cyclictest0-21swapper/311:21:163
99639946684,82cyclictest0-21swapper/311:21:163
996399466166,126cyclictest121rcu_preempt08:03:563
9960994661,176cyclictest0-21swapper/011:05:210
99679946581,84cyclictest0-21swapper/711:21:167
99679946581,84cyclictest0-21swapper/711:21:167
99679946581,84cyclictest0-21swapper/711:21:167
99619946540,212cyclictest0-21swapper/109:40:221
996599464123,338cyclictest0-21swapper/509:40:185
996299464121,211cyclictest0-21swapper/211:04:572
99679946381,338cyclictest0-21swapper/712:21:107
996799463122,338cyclictest4417-21/usr/sbin/munin09:35:297
99659946378,211cyclictest0-21swapper/511:48:205
99649946338,379cyclictest0-21swapper/407:38:484
99629946379,211cyclictest33-21ksoftirqd/211:48:272
99629946340,256cyclictest0-21swapper/211:05:132
996299462120,126cyclictest11007-21taskset08:03:562
996199462122,338cyclictest0-21swapper/107:40:171
99609946242,342cyclictest0-21swapper/012:00:090
99609946242,342cyclictest0-21swapper/012:00:090
996099462123,84cyclictest0-21swapper/007:36:190
996099462122,338cyclictest0-21swapper/008:02:250
99669946135,423cyclictest0-21swapper/611:15:086
99659946134,210cyclictest0-21swapper/512:22:345
996499461120,339cyclictest0-21swapper/408:02:264
99639946139,2cyclictest0-21swapper/307:40:373
99629946135,211cyclictest33-21ksoftirqd/208:23:292
996299461120,338cyclictest5697-21ssh11:40:132
99679946038,256cyclictest9958-21cyclictest11:55:107
99679946037,177cyclictest0-21swapper/711:32:457
996799460118,339cyclictest0-21swapper/712:31:527
996399460161,126cyclictest121rcu_preempt09:35:533
996299460203,84cyclictest0-21swapper/209:37:062
996299460120,338cyclictest0-21swapper/210:01:162
996299460120,338cyclictest0-21swapper/210:01:162
996199460122,336cyclictest0-21swapper/108:22:401
996499459120,337cyclictest0-21swapper/410:55:204
996499458118,338cyclictest0-21swapper/411:40:114
99629945831,295cyclictest0-21swapper/209:40:222
99679945734,211cyclictest0-21swapper/711:25:037
996799457201,254cyclictest721ktimersoftd/708:24:577
99619945778,84cyclictest0-21swapper/108:04:531
99619945731,211cyclictest0-21swapper/111:40:201
99679945676,296cyclictest15850irq/123-ahci[0009:40:197
99629945671,211cyclictest0-21swapper/210:55:092
996599455116,337cyclictest0-21swapper/507:33:195
996599455114,338cyclictest0-21swapper/511:05:165
996399455113,339cyclictest11518-21rm11:05:083
996399455113,127cyclictest1551-21snmpd12:13:463
99619945574,84cyclictest0-21swapper/108:25:191
99679945431,338cyclictest0-21swapper/708:03:187
99679945429,250cyclictest0-21swapper/711:15:167
996799454113,338cyclictest0-21swapper/707:37:157
996399454112,339cyclictest0-21swapper/307:35:213
99609945432,260cyclictest0-21swapper/010:45:210
996199453112,338cyclictest0-21swapper/107:32:091
99609945369,210cyclictest9-21ksoftirqd/010:55:170
996299450366,3cyclictest311rcuc/207:32:592
996299450110,338cyclictest0-21swapper/211:13:192
99679944923,423cyclictest0-21swapper/707:42:017
996399449108,338cyclictest0-21swapper/309:40:183
99669944822,169cyclictest0-21swapper/610:55:166
99609944868,377cyclictest0-21swapper/008:25:050
99659944725,84cyclictest0-21swapper/508:00:335
99629944762,211cyclictest28552-21taskset10:05:202
99619944726,84cyclictest0-21swapper/110:55:091
99649944566,376cyclictest0-21swapper/408:25:044
99649944221,255cyclictest0-21swapper/412:00:184
99649944221,255cyclictest0-21swapper/412:00:184
996099441142,126cyclictest121rcu_preempt08:24:510
996099440102,83cyclictest7231-21sed11:40:230
99629943897,338cyclictest0-21swapper/207:45:052
99609943816,295cyclictest27297-21sh11:31:580
99679943695,338cyclictest0-21swapper/708:05:167
99639943694,211cyclictest0-21swapper/310:52:273
99619943513,168cyclictest28443-21kworker/u16:212:00:241
99619943513,168cyclictest28443-21kworker/u16:212:00:241
99679943189,339cyclictest0-21swapper/711:40:217
99669942885,126cyclictest121rcu_preempt11:40:216
99679942785,211cyclictest721ktimersoftd/712:00:237
99679942785,211cyclictest721ktimersoftd/712:00:237
9967994274,3cyclictest0-21swapper/710:05:277
99679942582,340cyclictest0-21swapper/707:32:097
9967994241,256cyclictest0-21swapper/710:55:207
99649942484,337cyclictest0-21swapper/410:45:214
99669942383,338cyclictest0-21swapper/610:45:236
996399423123,127cyclictest0-21swapper/312:00:163
996399423123,127cyclictest0-21swapper/312:00:163
99629942382,338cyclictest29460-21runrttasks07:40:162
99679942280,339cyclictest0-21swapper/710:45:147
99639942283,84cyclictest0-21swapper/310:45:233
99659942180,84cyclictest0-21swapper/510:45:195
996599421376,42cyclictest561ktimersoftd/510:55:195
99639942140,3cyclictest0-21swapper/311:40:103
99639941877,126cyclictest41-21ksoftirqd/310:55:093
99659941677,84cyclictest0-21swapper/512:00:245
99659941677,84cyclictest0-21swapper/512:00:245
99679941372,338cyclictest0-21swapper/708:25:057
99659941375,84cyclictest0-21swapper/511:25:045
99619941373,84cyclictest0-21swapper/111:25:041
99639941273,84cyclictest0-21swapper/311:15:203
99609941232,296cyclictest0-21swapper/008:05:160
99649941130,295cyclictest0-21swapper/408:05:154
99639941172,84cyclictest0-21swapper/310:05:283
99679941025,254cyclictest0-21swapper/707:45:167
99629941069,338cyclictest0-21swapper/212:35:332
99609941030,260cyclictest0-21swapper/012:25:290
996199409152,126cyclictest121rcu_preempt12:35:331
99649940827,297cyclictest0-21swapper/412:25:184
99629940868,338cyclictest0-21swapper/210:45:232
99629940867,338cyclictest0-21swapper/212:00:172
99629940867,338cyclictest0-21swapper/212:00:172
99679940423,297cyclictest0-21swapper/712:25:187
99659940466,217cyclictest0-21swapper/508:05:065
99639940364,84cyclictest0-21swapper/307:45:193
99669940261,338cyclictest0-21swapper/608:25:056
99659939813,84cyclictest0-21swapper/507:45:175
99669939516,300cyclictest0-21swapper/612:25:186
99619939512,380cyclictest0-21swapper/107:45:151
99649939212,260cyclictest0-21swapper/412:35:334
99639939153,84cyclictest0-21swapper/312:25:183
99629939111,83cyclictest0-21swapper/208:05:042
9965993842,380cyclictest9958-21cyclictest12:25:215
996599379123,253cyclictest0-21swapper/512:35:325
99639937739,168cyclictest41-21ksoftirqd/312:35:323
99639937633,126cyclictest0-21swapper/308:25:223
996599373117,253cyclictest5666-21ssh11:40:105
99629937326,84cyclictest0-21swapper/212:25:202
99609937173,84cyclictest121rcu_preempt11:25:020
99669937029,339cyclictest0-21swapper/607:45:146
996699370113,168cyclictest0-21swapper/611:25:036
99619937030,85cyclictest0-21swapper/108:05:161
99609937071,169cyclictest121rcu_preempt07:45:190
99639936970,126cyclictest0-21swapper/308:05:163
99669936830,254cyclictest0-21swapper/612:35:336
99609936625,126cyclictest0-21swapper/012:35:320
99649936367,84cyclictest0-21swapper/407:45:174
99659935617,84cyclictest0-21swapper/508:25:195
996799345129,89cyclictest121rcu_preempt12:35:347
99649933077,84cyclictest0-21swapper/411:25:034
99629932671,253cyclictest0-21swapper/211:25:042
99639928331,85cyclictest41-21ksoftirqd/311:25:043
763721190,2sleep70-21swapper/707:05:117
923229962,34sleep60-21swapper/607:05:436
946928454,27sleep20-21swapper/207:09:082
951028352,27sleep50-21swapper/507:09:435
925628354,26sleep30-21swapper/307:06:033
952428251,27sleep10-21swapper/107:09:551
947128250,28sleep40-21swapper/407:09:094
952327947,28sleep00-21swapper/007:09:540
265082730,1sleep10-21swapper/109:30:071
126932730,0sleep00-21swapper/009:56:000
126932730,0sleep00-21swapper/009:55:590
197962700,0sleep20-21swapper/207:25:012
137882690,0sleep50-21swapper/507:15:025
9967993410,23cyclictest0-21swapper/710:44:507
9967993410,23cyclictest0-21swapper/708:54:277
9967993410,17cyclictest0-21swapper/707:59:597
9967993326,6cyclictest0-21swapper/709:59:447
9967993326,6cyclictest0-21swapper/709:59:447
9967993226,5cyclictest0-21swapper/707:54:107
9967993210,22cyclictest0-21swapper/708:19:447
9967993210,21cyclictest0-21swapper/708:14:057
9967993110,17cyclictest0-21swapper/708:39:027
9960993110,17cyclictest0-21swapper/008:54:170
9967992924,4cyclictest0-21swapper/707:24:527
9967992923,5cyclictest0-21swapper/707:19:297
9964992927,1cyclictest0-21swapper/407:13:524
9964992926,2cyclictest0-21swapper/408:54:174
9963992910,18cyclictest0-21swapper/310:44:093
9963992910,18cyclictest0-21swapper/309:50:573
9960992910,18cyclictest0-21swapper/007:59:580
9967992810,18cyclictest0-21swapper/709:26:107
9967992810,0cyclictest0-21swapper/708:47:097
9966992810,18cyclictest0-21swapper/607:13:576
9965992826,1cyclictest0-21swapper/508:32:535
9964992826,2cyclictest0-21swapper/408:13:594
9963992810,18cyclictest0-21swapper/310:37:113
9963992810,0cyclictest0-21swapper/309:26:183
9963992810,0cyclictest0-21swapper/309:15:483
9962992828,0cyclictest0-21swapper/208:54:022
9962992810,17cyclictest0-21swapper/210:36:462
9962992810,0cyclictest0-21swapper/209:26:102
9961992827,1cyclictest0-21swapper/109:15:301
9961992826,1cyclictest0-21swapper/108:19:511
9960992827,1cyclictest0-21swapper/008:47:430
9960992810,18cyclictest0-21swapper/009:26:230
9960992810,17cyclictest0-21swapper/010:36:470
9967992727,0cyclictest0-21swapper/709:50:347
9967992727,0cyclictest0-21swapper/709:34:557
9967992727,0cyclictest0-21swapper/708:33:037
9967992727,0cyclictest0-21swapper/707:13:237
9967992710,17cyclictest0-21swapper/710:36:417
9967992710,0cyclictest0-21swapper/709:15:347
9967992710,0cyclictest0-21swapper/709:09:207
9967992710,0cyclictest0-21swapper/709:02:367
9966992727,0cyclictest0-21swapper/610:43:576
9966992727,0cyclictest0-21swapper/610:36:456
9966992727,0cyclictest0-21swapper/607:24:456
9966992710,17cyclictest0-21swapper/609:50:406
9966992710,17cyclictest0-21swapper/609:34:516
9966992710,17cyclictest0-21swapper/609:26:166
9966992710,17cyclictest0-21swapper/609:02:386
9966992710,17cyclictest0-21swapper/607:19:316
9966992710,0cyclictest0-21swapper/609:59:436
9966992710,0cyclictest0-21swapper/609:59:426
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional