You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-04 - 05:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sat Jul 04, 2026 00:55:09)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
36129978159,719cyclictest0-21swapper/223:01:202
36129976282,84cyclictest0-21swapper/221:54:422
36179967679,381cyclictest0-21swapper/723:44:507
36129967579,593cyclictest0-21swapper/200:31:302
36129965824,550cyclictest0-21swapper/200:18:142
361499653142,423cyclictest3608-21cyclictest00:33:424
36129963135,592cyclictest15760-21pmu-power00:10:242
36109962934,380cyclictest698-21ptp4l23:47:180
36149962534,126cyclictest0-21swapper/422:25:234
361599624117,126cyclictest0-21swapper/500:32:065
361299607102,124cyclictest33-21ksoftirqd/221:44:502
36109960696,295cyclictest14234-21sh22:02:450
36149960552,505cyclictest0-21swapper/423:34:504
361099604179,215cyclictest121rcu_preempt00:08:530
36109960393,295cyclictest121rcu_preempt23:01:510
361799598555,41cyclictest711rcuc/700:00:067
361399596211,212cyclictest614-21kworker/u16:322:35:523
3617995950,84cyclictest0-21swapper/700:10:257
3617995940,84cyclictest0-21swapper/700:20:167
3613995940,84cyclictest0-21swapper/321:24:243
361299589121,465cyclictest321ktimersoftd/200:06:222
36159958837,126cyclictest3608-21cyclictest00:44:265
36179958632,381cyclictest0-21swapper/721:43:257
36129958329,550cyclictest0-21swapper/200:27:282
36149958228,381cyclictest0-21swapper/422:40:184
36109958072,211cyclictest0-21swapper/023:24:330
361499579239,338cyclictest10994-21diskmemload23:46:524
361299577492,4cyclictest311rcuc/223:43:452
36109957725,296cyclictest0-21swapper/000:28:470
36129957021,422cyclictest0-21swapper/222:57:452
36149956917,380cyclictest0-21swapper/423:04:214
361199568183,296cyclictest0-21swapper/123:14:401
36109956818,126cyclictest0-21swapper/023:14:400
36179956291,296cyclictest5834-21taskset23:45:547
36129956211,126cyclictest0-21swapper/223:25:552
36109956011,84cyclictest0-21swapper/022:39:440
3614995577,126cyclictest0-21swapper/422:35:524
3612995541,7cyclictest0-21swapper/222:37:442
36109954983,126cyclictest0-21swapper/000:20:170
361799548207,338cyclictest32531-21nscd22:02:217
361199546203,253cyclictest0-21swapper/122:39:441
36109954579,84cyclictest0-21swapper/021:43:200
361099545119,295cyclictest0-21swapper/000:44:250
36149954433,379cyclictest1553-21runrttasks19:41:404
361799541117,421cyclictest0-21swapper/700:34:207
36159954029,84cyclictest0-21swapper/523:43:125
36129954025,512cyclictest0-21swapper/223:49:082
36109954031,84cyclictest0-21swapper/023:26:010
36149953931,89cyclictest0-21swapper/419:51:524
36109953974,126cyclictest779-21ssh22:13:560
36179953767,254cyclictest0-21swapper/723:34:257
36129953727,507cyclictest0-21swapper/221:55:192
36159953668,253cyclictest0-21swapper/522:58:045
361599536110,211cyclictest0-21swapper/522:49:035
36139953671,84cyclictest0-21swapper/322:03:453
36129953670,211cyclictest0-21swapper/223:34:262
36119953528,85cyclictest0-21swapper/122:57:551
36149953225,380cyclictest0-21swapper/421:24:274
36169952917,296cyclictest0-21swapper/622:50:206
36119952859,380cyclictest0-21swapper/123:45:191
36149952661,84cyclictest0-21swapper/421:44:064
36149952615,381cyclictest0-21swapper/400:26:244
361699525140,126cyclictest631rcuc/623:12:276
36149952498,295cyclictest30037-21chrt21:54:494
36139952497,296cyclictest0-21swapper/323:25:593
361099523478,43cyclictest111rcuc/000:18:030
36149952113,84cyclictest0-21swapper/423:25:594
36119952094,338cyclictest0-21swapper/119:42:391
3611995169,168cyclictest3608-21cyclictest22:24:471
3614995155,507cyclictest0-21swapper/422:24:394
3612995155,41cyclictest0-21swapper/222:48:362
3612995154,42cyclictest0-21swapper/223:14:282
36109951411,374cyclictest0-21swapper/021:55:040
3612995130,84cyclictest0-21swapper/221:24:202
3611995139,420cyclictest0-21swapper/123:23:141
3612995121,42cyclictest0-21swapper/200:44:432
361099512213,169cyclictest121rcu_preempt21:22:400
36149951189,216cyclictest3608-21cyclictest22:04:494
361399511124,254cyclictest6805-21ssh23:46:593
36119951042,126cyclictest0-21swapper/121:41:541
3616995090,84cyclictest0-21swapper/621:24:206
36159950941,295cyclictest0-21swapper/521:21:565
3615995091,84cyclictest12394-21ssh00:25:465
36149950940,126cyclictest0-21swapper/423:13:304
36139950981,302cyclictest0-21swapper/300:30:553
36129950940,466cyclictest0-21swapper/222:40:202
36159950782,210cyclictest0-21swapper/523:04:185
361499507124,168cyclictest49-21ksoftirqd/400:09:234
36149950641,380cyclictest0-21swapper/423:45:014
36119950637,338cyclictest25-21ksoftirqd/100:34:461
361799504124,338cyclictest19133-21ssh23:00:097
361599504421,2cyclictest551rcuc/522:24:405
36129950440,387cyclictest0-21swapper/221:25:262
361099504125,295cyclictest10994-21diskmemload23:33:270
36139950334,338cyclictest0-21swapper/322:58:563
36169950276,211cyclictest0-21swapper/622:40:006
3613995021,339cyclictest0-21swapper/300:29:483
36129950133,465cyclictest0-21swapper/222:24:372
36119950137,3cyclictest0-21swapper/122:48:161
36109950134,210cyclictest9-21ksoftirqd/000:33:340
36159950035,296cyclictest0-21swapper/521:42:075
361499500116,169cyclictest0-21swapper/422:47:534
36129950073,296cyclictest0-21swapper/200:00:102
36109950076,84cyclictest3608-21cyclictest21:52:280
36129949932,463cyclictest0-21swapper/222:12:352
36169949875,295cyclictest0-21swapper/621:25:326
361199498115,126cyclictest25-21ksoftirqd/122:04:001
361399497118,126cyclictest31735-21cut21:55:173
361699496113,126cyclictest0-21swapper/619:43:276
361599496158,127cyclictest121rcu_preempt22:05:285
36109949627,295cyclictest18187-21taskset22:59:260
36169949569,126cyclictest121rcu_preempt00:26:576
36149949574,84cyclictest0-21swapper/422:50:214
36139949573,84cyclictest28956-21rm21:53:453
36129949573,338cyclictest0-21swapper/223:23:092
36129949527,465cyclictest0-21swapper/222:15:192
36129949527,126cyclictest30936-21runrttasks19:54:452
361499494113,83cyclictest64450irq/122-eth000:18:564
36139949425,211cyclictest41-21ksoftirqd/323:44:383
361399494114,211cyclictest0-21swapper/322:05:323
361299494114,84cyclictest0-21swapper/222:50:202
36119949469,210cyclictest25-21ksoftirqd/123:34:261
36179949327,211cyclictest704-21nscd00:29:587
36159949327,211cyclictest0-21swapper/500:10:205
36149949369,84cyclictest0-21swapper/423:23:464
36119949367,423cyclictest0-21swapper/121:54:131
361399492153,169cyclictest0-21swapper/322:13:553
36129949225,423cyclictest20798-21cut22:25:252
361199492150,126cyclictest25-21ksoftirqd/100:10:301
36179949168,84cyclictest0-21swapper/722:58:147
36139949024,127cyclictest0-21swapper/300:35:143
36129949025,2cyclictest0-21swapper/223:58:502
36109949027,331cyclictest14853-21runrttasks00:10:130
361699489148,338cyclictest15518-1kworker/u17:223:57:506
36159948918,126cyclictest121rcu_preempt19:42:375
361799487149,171cyclictest721ktimersoftd/700:05:377
36179948518,338cyclictest0-21swapper/722:48:367
36179948462,84cyclictest0-21swapper/723:14:167
36169948460,126cyclictest0-21swapper/623:47:256
361699484104,255cyclictest0-21swapper/600:00:156
36129948416,169cyclictest0-21swapper/222:05:472
36119948357,168cyclictest25-21ksoftirqd/122:51:041
36179948112,295cyclictest0-21swapper/719:51:587
36179948058,84cyclictest0-21swapper/722:50:567
36169948054,253cyclictest0-21swapper/623:35:026
361199480139,126cyclictest121rcu_preempt00:20:121
36109947910,89cyclictest0-21swapper/023:57:440
361599478399,76cyclictest561ktimersoftd/500:09:055
361499478223,253cyclictest481ktimersoftd/423:05:074
36159947712,338cyclictest0-21swapper/523:48:155
36179947697,84cyclictest0-21swapper/700:18:227
36139947696,295cyclictest0-21swapper/322:48:373
36119947553,84cyclictest0-21swapper/123:00:081
361199475395,77cyclictest231rcuc/100:08:061
36149947292,84cyclictest0-21swapper/400:35:144
3611994728,125cyclictest0-21swapper/100:28:481
3611994723,295cyclictest0-21swapper/121:23:031
36129947086,253cyclictest0-21swapper/222:04:502
3612994691,41cyclictest0-21swapper/200:20:162
3617994671,211cyclictest0-21swapper/721:54:157
36159946644,338cyclictest0-21swapper/522:03:505
36149946580,84cyclictest0-21swapper/423:15:024
36139946537,211cyclictest41-21ksoftirqd/300:08:153
361799464122,339cyclictest0-21swapper/721:21:397
36149946482,82cyclictest0-21swapper/422:15:014
361499464123,338cyclictest0-21swapper/422:57:204
361399464123,338cyclictest0-21swapper/322:23:423
36119946480,126cyclictest121rcu_preempt22:15:141
361799463117,342cyclictest0-21swapper/723:05:147
361699463123,337cyclictest0-21swapper/622:15:086
36159946341,256cyclictest0-21swapper/500:00:215
36149946381,380cyclictest187-21md0_raid122:15:284
361799462121,338cyclictest0-21swapper/722:39:567
361799462119,340cyclictest0-21swapper/722:22:387
36169946240,85cyclictest0-21swapper/619:54:116
36159946240,256cyclictest0-21swapper/522:13:195
361599462120,169cyclictest20768-21ssh22:25:265
36109946240,84cyclictest10994-21diskmemload22:15:170
361099462123,84cyclictest121rcu_preempt00:35:050
36179946177,381cyclictest0-21swapper/700:44:367
361699461120,338cyclictest0-21swapper/600:33:146
361699461120,126cyclictest0-21swapper/623:25:166
36159946178,210cyclictest57-21ksoftirqd/523:32:375
36159946139,256cyclictest0-21swapper/521:54:075
36149946133,338cyclictest0-21swapper/423:58:494
361499461123,84cyclictest0-21swapper/422:05:534
361499461123,84cyclictest0-21swapper/400:44:304
36139946179,85cyclictest0-21swapper/321:40:173
361399461120,338cyclictest0-21swapper/321:45:053
361399461120,338cyclictest0-21swapper/300:10:133
36119946139,84cyclictest0-21swapper/119:50:241
36119946139,3cyclictest0-21swapper/123:59:041
36119946139,3cyclictest0-21swapper/122:12:371
361799460119,338cyclictest0-21swapper/723:57:277
36129946034,423cyclictest0-21swapper/219:40:442
361799459118,338cyclictest0-21swapper/722:14:127
361699459373,84cyclictest631rcuc/600:10:316
361699459121,254cyclictest10613-21taskset21:44:076
361599459117,169cyclictest1553-21runrttasks23:15:145
361499459121,302cyclictest0-21swapper/421:55:174
36109945933,126cyclictest9-21ksoftirqd/022:24:490
36169945835,256cyclictest0-21swapper/623:24:026
361699458160,126cyclictest0-21swapper/600:07:556
361399458117,338cyclictest0-21swapper/323:03:433
36119945874,211cyclictest25-21ksoftirqd/121:25:101
36109945836,82cyclictest121rcu_preempt22:40:180
361699457115,126cyclictest24650-21ssh23:03:486
36159945774,210cyclictest0-21swapper/523:24:415
36139945775,84cyclictest0-21swapper/323:33:483
36139945734,84cyclictest0-21swapper/323:24:283
36139945729,254cyclictest0-21swapper/323:59:493
361399457116,338cyclictest0-21swapper/319:51:043
361399457116,338cyclictest0-21swapper/300:18:393
36119945773,211cyclictest0-21swapper/123:25:311
36169945634,84cyclictest0-21swapper/623:33:296
36169945631,84cyclictest7622-21ssh00:43:186
36159945634,169cyclictest0-21swapper/522:39:195
36149945574,84cyclictest0-21swapper/400:10:294
361499455114,338cyclictest0-21swapper/421:25:374
36139945533,3cyclictest0-21swapper/300:42:193
361399455114,339cyclictest0-21swapper/323:14:503
36129945533,3cyclictest0-21swapper/200:35:162
361199455113,211cyclictest1594-21ssh23:44:091
361599454113,338cyclictest0-21swapper/500:18:045
361099454113,126cyclictest121rcu_preempt19:53:170
361299453114,84cyclictest0-21swapper/221:45:052
36109945374,211cyclictest0-21swapper/022:49:420
36169945273,126cyclictest30036-21ssh21:54:506
36149945271,84cyclictest0-21swapper/400:20:164
361599451111,338cyclictest9214-21switchtime21:25:375
36149945129,338cyclictest26577-21if_err_eth019:45:214
361399451110,338cyclictest0-21swapper/322:50:333
36119945130,2cyclictest0-21swapper/100:42:371
361799450110,338cyclictest0-21swapper/722:15:247
361599450110,338cyclictest0-21swapper/519:51:035
361399450109,338cyclictest0-21swapper/323:05:143
36179944968,211cyclictest0-21swapper/723:23:297
361199448365,3cyclictest241ktimersoftd/100:00:211
36179944762,296cyclictest0-21swapper/722:40:197
36149944764,380cyclictest0-21swapper/423:35:074
36169944619,296cyclictest0-21swapper/622:40:036
361599446232,126cyclictest0-21swapper/523:57:265
361599445362,80cyclictest551rcuc/523:26:055
36159944523,2cyclictest3608-21cyclictest22:50:085
36119944464,42cyclictest121rcu_preempt00:18:131
36169944320,45cyclictest0-21swapper/600:35:096
36179944219,168cyclictest704-21nscd22:05:327
36169944157,126cyclictest65-21ksoftirqd/622:23:576
36169944119,177cyclictest0-21swapper/622:59:086
361699441104,253cyclictest0-21swapper/622:04:136
36159944119,299cyclictest0-21swapper/500:35:095
361399441100,338cyclictest0-21swapper/322:40:073
361099441102,84cyclictest0-21swapper/023:42:470
361099441101,126cyclictest121rcu_preempt21:25:380
36179944018,2cyclictest0-21swapper/722:25:157
36179944014,134cyclictest0-21swapper/719:43:427
36179943912,296cyclictest0-21swapper/700:35:147
361699439140,126cyclictest10994-21diskmemload23:44:256
36119943998,84cyclictest121rcu_preempt22:40:111
36169943815,258cyclictest0-21swapper/622:48:596
36129943797,338cyclictest0-21swapper/223:05:162
36169943510,169cyclictest0-21swapper/623:05:216
36159943513,3cyclictest0-21swapper/522:15:255
36109943597,84cyclictest0-21swapper/023:05:140
36169943495,84cyclictest0-21swapper/623:15:036
36169943412,3cyclictest0-21swapper/622:25:156
36139943311,218cyclictest24840-21chrt19:42:383
3612994338,43cyclictest0-21swapper/219:45:222
36119943391,211cyclictest12878-21rm21:45:141
361099433102,118cyclictest0-21swapper/022:05:230
3615994295,84cyclictest0-21swapper/519:45:255
36159942885,211cyclictest561ktimersoftd/523:13:525
3611994270,84cyclictest26411-21sh23:05:071
36169942685,338cyclictest0-21swapper/600:20:006
361099425125,126cyclictest0-21swapper/019:45:250
36159942439,84cyclictest121rcu_preempt23:35:085
3611994240,3cyclictest0-21swapper/122:05:331
36139942283,84cyclictest0-21swapper/323:15:143
36119942241,3cyclictest0-21swapper/121:55:031
36179942183,84cyclictest0-21swapper/721:45:157
36169942183,83cyclictest0-21swapper/622:13:216
36109942183,84cyclictest0-21swapper/019:43:520
36119942079,338cyclictest0-21swapper/123:15:021
36139941979,85cyclictest0-21swapper/321:25:193
36119941979,338cyclictest0-21swapper/122:25:041
36169941880,83cyclictest0-21swapper/621:45:136
36129941838,302cyclictest0-21swapper/219:55:112
36129941837,303cyclictest0-21swapper/223:35:032
36119941877,338cyclictest0-21swapper/100:35:121
36169941779,83cyclictest0-21swapper/622:05:086
36139941778,84cyclictest0-21swapper/322:15:293
361799415115,127cyclictest0-21swapper/723:25:457
36149941577,84cyclictest0-21swapper/400:00:234
36179941472,211cyclictest31562-21/usr/sbin/munin21:55:157
36109941476,84cyclictest0-21swapper/022:25:120
36159941372,338cyclictest0-21swapper/522:40:075
361099409156,92cyclictest1639-21rm22:50:070
36169940765,84cyclictest0-21swapper/621:55:036
36109940769,84cyclictest0-21swapper/000:00:120
36159940666,337cyclictest0-21swapper/523:05:155
36149940626,177cyclictest0-21swapper/419:55:024
36179940465,84cyclictest0-21swapper/721:25:387
36149940463,338cyclictest0-21swapper/421:45:054
36119940424,2cyclictest0-21swapper/123:35:071
36169940262,84cyclictest0-21swapper/600:20:176
36179940061,84cyclictest0-21swapper/723:35:067
36139939961,171cyclictest0-21swapper/300:00:223
36159939858,337cyclictest0-21swapper/500:20:195
36159939819,3cyclictest0-21swapper/521:55:035
36109939818,253cyclictest0-21swapper/021:45:050
36109939818,211cyclictest0-21swapper/023:35:050
36159939718,84cyclictest0-21swapper/519:55:035
36139939759,171cyclictest0-21swapper/319:45:083
36139939353,84cyclictest0-21swapper/300:20:083
3612993916,84cyclictest121rcu_preempt23:15:102
36109939052,84cyclictest0-21swapper/023:15:130
36179938950,84cyclictest0-21swapper/719:55:037
3611993820,84cyclictest121rcu_preempt19:45:171
361399381165,85cyclictest0-21swapper/322:25:213
36139937941,2cyclictest0-21swapper/323:35:083
361799378122,254cyclictest0-21swapper/723:15:087
36139937132,41cyclictest0-21swapper/319:55:113
36169936872,84cyclictest0-21swapper/619:45:226
36179936023,170cyclictest0-21swapper/719:45:097
361599357188,42cyclictest561ktimersoftd/520:31:335
36119935618,169cyclictest25-21ksoftirqd/120:31:321
36139933779,255cyclictest3608-21cyclictest20:31:343
36159933680,83cyclictest121rcu_preempt21:45:135
36109932425,129cyclictest9-21ksoftirqd/019:55:090
36109932122,126cyclictest0-21swapper/020:31:330
361299320108,126cyclictest22212-21taskset20:31:332
36169931762,84cyclictest0-21swapper/619:55:106
36169931620,84cyclictest0-21swapper/620:31:336
36149930713,210cyclictest0-21swapper/420:31:324
3611993001,92cyclictest0-21swapper/119:55:031
3617992582,253cyclictest0-21swapper/720:31:337
285929546,27sleep00-21swapper/019:08:180
245028984,2sleep10-21swapper/119:05:241
268428755,28sleep60-21swapper/619:05:526
287728658,5sleep70-21swapper/719:08:347
289128352,27sleep30-21swapper/319:08:463
63542820,0sleep40-21swapper/422:34:474
268228250,28sleep40-21swapper/419:05:504
282428151,27sleep20-21swapper/219:07:492
268328049,27sleep50-21swapper/519:05:515
55212740,0sleep30-21swapper/322:34:123
37212430,1sleep6361699cyclictest21:39:576
3614993226,5cyclictest0-21swapper/421:32:284
3614993010,20cyclictest0-21swapper/421:01:424
3614993010,20cyclictest0-21swapper/421:01:424
3614992927,1cyclictest0-21swapper/421:09:444
3611992927,1cyclictest0-21swapper/121:17:371
3617992828,0cyclictest0-21swapper/722:33:407
3617992828,0cyclictest0-21swapper/721:17:077
3617992828,0cyclictest0-21swapper/721:02:117
3617992828,0cyclictest0-21swapper/721:02:117
3617992810,18cyclictest0-21swapper/721:32:137
3617992810,18cyclictest0-21swapper/721:09:127
3617992810,18cyclictest0-21swapper/720:02:587
3617992810,18cyclictest0-21swapper/719:13:467
3617992810,0cyclictest0-21swapper/721:39:427
3617992810,0cyclictest0-21swapper/720:11:037
3616992810,18cyclictest0-21swapper/619:14:236
3614992827,1cyclictest0-21swapper/420:23:324
3613992828,0cyclictest0-21swapper/321:17:123
3613992828,0cyclictest0-21swapper/319:32:573
3613992810,18cyclictest0-21swapper/321:39:423
3613992810,18cyclictest0-21swapper/321:08:503
3613992810,18cyclictest0-21swapper/321:02:103
3613992810,18cyclictest0-21swapper/321:02:103
3613992810,18cyclictest0-21swapper/320:54:383
3613992810,18cyclictest0-21swapper/320:45:583
3613992810,18cyclictest0-21swapper/320:23:303
3613992810,18cyclictest0-21swapper/319:19:203
3613992810,0cyclictest0-21swapper/320:38:213
3612992828,0cyclictest0-21swapper/219:39:572
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional