You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-28 - 20:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Thu May 28, 2026 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7643991153,72cyclictest18290-21taskset10:50:343
7637991153,90cyclictest18226-21apt-get10:50:342
7643991103,94cyclictest3957-21chrt11:20:293
7637991103,81cyclictest16792-21apt-get09:55:322
76379910811,51cyclictest3926-21apt-get11:20:342
7637991078,46cyclictest12523-21/usr/sbin/munin08:51:422
7637991074,52cyclictest27045-21tail10:10:512
738021076,16sleep00-21swapper/006:58:590
76379910649,16cyclictest14646-21switchtime09:51:292
7637991042,78cyclictest10664-21apt-get08:45:382
6684210316,50sleep26724-21ntpq06:56:452
76299910274,12cyclictest181rcu_preempt08:51:321
1202821020,6sleep30-21swapper/310:40:293
7620999776,8cyclictest0-21swapper/010:10:380
7637999510,30cyclictest0-21swapper/210:05:562
7629999469,17cyclictest12454-21latency_hist08:50:191
7629999356,8cyclictest181rcu_preempt10:25:151
7620999312,46cyclictest15-21ksoftirqd/010:38:380
7637999260,8cyclictest39-21ksoftirqd/212:14:372
7637999111,48cyclictest5787-21apt-get10:30:292
7637999111,48cyclictest5787-21apt-get10:30:292
763799908,62cyclictest8472-21apt-get10:35:282
7637998945,12cyclictest181rcu_preempt11:55:372
7637998859,12cyclictest8816-21kworker/u17:1-flush-179:007:15:432
7637998847,29cyclictest7008-21modprobe09:40:142
7637998847,29cyclictest7008-21modprobe09:40:142
7620998870,9cyclictest0-21swapper/007:55:490
762099883,56cyclictest15-21ksoftirqd/008:25:060
7629998771,10cyclictest23224-21diskmemload10:06:021
7629998767,10cyclictest0-21swapper/107:05:391
7629998767,10cyclictest0-21swapper/107:05:391
762999876,50cyclictest31-21ksoftirqd/109:30:181
762999876,50cyclictest31-21ksoftirqd/109:30:181
7629998716,42cyclictest31-21ksoftirqd/110:04:001
7629998716,42cyclictest31-21ksoftirqd/110:04:001
7620998710,47cyclictest15-21ksoftirqd/011:14:430
7620998710,47cyclictest15-21ksoftirqd/011:14:430
7629998667,10cyclictest0-21swapper/109:15:171
7629998665,15cyclictest27010-21threads07:55:491
7620998670,9cyclictest0-21swapper/011:55:460
763799853,60cyclictest3460-21apt-get08:25:282
762099858,46cyclictest15-21ksoftirqd/010:49:130
762099858,46cyclictest15-21ksoftirqd/010:49:130
7620998569,11cyclictest24380-21kworker/u18:2-rpciod11:17:290
7620998554,23cyclictest0-21swapper/009:40:500
764399845,44cyclictest0-21swapper/310:36:413
7637998459,19cyclictest15511-21diskmemload12:15:492
7629998470,8cyclictest0-21swapper/108:15:401
7629998470,8cyclictest0-21swapper/108:15:401
7629998462,12cyclictest0-21swapper/109:35:381
7629998462,12cyclictest0-21swapper/109:35:381
7629998458,7cyclictest181rcu_preempt10:49:561
7629998458,7cyclictest181rcu_preempt10:49:561
7620998463,11cyclictest15511-21diskmemload11:05:170
7620998463,11cyclictest15511-21diskmemload11:05:170
7620998414,41cyclictest15-21ksoftirqd/011:47:590
762099841,43cyclictest15-21ksoftirqd/012:09:080
762099841,43cyclictest15-21ksoftirqd/012:09:080
7643998311,41cyclictest0-21swapper/309:55:363
763799832,33cyclictest9193-21latency_hist07:05:172
7629998362,10cyclictest0-21swapper/110:45:171
7629998362,10cyclictest0-21swapper/107:45:361
762999831,37cyclictest31-21ksoftirqd/111:29:081
7620998363,11cyclictest0-21swapper/008:45:170
7620998362,7cyclictest181rcu_preempt09:37:490
7620998362,7cyclictest181rcu_preempt09:37:490
7620998354,21cyclictest0-21swapper/010:50:320
7620998312,41cyclictest15-21ksoftirqd/011:36:450
7637998261,13cyclictest39-21ksoftirqd/212:30:172
763799824,48cyclictest31300-21latency09:25:402
763799824,48cyclictest31300-21latency09:25:402
763799822,55cyclictest27594-21apt-get08:00:292
7629998265,9cyclictest0-21swapper/111:20:341
7629998265,8cyclictest0-21swapper/111:55:451
7629998265,11cyclictest14562-21sh11:37:221
7629998264,9cyclictest0-21swapper/107:40:491
7629998264,9cyclictest0-21swapper/107:40:491
7629998256,8cyclictest181rcu_preempt12:19:231
7620998264,12cyclictest18805-21/usr/sbin/munin09:05:370
7620998258,15cyclictest12019-21latency_hist08:50:190
7620998211,43cyclictest15-21ksoftirqd/010:19:370
7637998152,19cyclictest0-21swapper/207:35:172
7629998159,12cyclictest0-21swapper/108:30:361
7629998159,12cyclictest0-21swapper/108:30:361
7629998133,20cyclictest30471-21sh12:05:041
7620998112,41cyclictest15-21ksoftirqd/011:34:560
7620998112,41cyclictest15-21ksoftirqd/011:34:560
7629998053,8cyclictest181rcu_preempt07:15:431
7620998063,9cyclictest0-21swapper/009:20:480
7620998055,7cyclictest181rcu_preempt10:58:200
7620998015,37cyclictest15-21ksoftirqd/012:25:020
7620998015,37cyclictest15-21ksoftirqd/012:25:020
7637997949,9cyclictest181rcu_preempt10:25:452
7637997949,9cyclictest181rcu_preempt10:25:452
7637997938,17cyclictest181rcu_preempt07:30:172
7637997935,14cyclictest181rcu_preempt07:15:172
7629997963,8cyclictest0-21swapper/111:15:491
7629997956,13cyclictest0-21swapper/110:15:501
7629997947,16cyclictest181rcu_preempt09:08:201
7620997954,17cyclictest9358-21munin-setwarn07:05:180
7637997856,12cyclictest0-21swapper/209:43:562
7629997856,15cyclictest5441-21latency_hist10:30:171
7629997856,15cyclictest5441-21latency_hist10:30:171
7629997855,16cyclictest1-21systemd08:25:151
7629997854,7cyclictest181rcu_preempt11:43:061
7629997847,10cyclictest181rcu_preempt11:05:021
7629997847,10cyclictest181rcu_preempt11:05:021
762999782,35cyclictest31-21ksoftirqd/109:43:481
762999781,44cyclictest31-21ksoftirqd/111:06:311
7620997856,16cyclictest5277-21apt-key10:30:150
7620997856,16cyclictest5277-21apt-key10:30:150
7620997855,16cyclictest15511-21diskmemload10:40:400
7620997853,17cyclictest7614-21cyclictest10:31:080
7620997853,17cyclictest7614-21cyclictest10:31:080
762099784,36cyclictest15-21ksoftirqd/009:16:400
762099784,36cyclictest15-21ksoftirqd/009:16:400
7620997811,24cyclictest0-21swapper/011:30:170
7637997760,13cyclictest5138-21kworker/u18:1-events_unbound11:35:152
7637997760,13cyclictest5138-21kworker/u18:1-events_unbound11:35:152
7629997758,12cyclictest2374-21systemd-journal07:05:151
7629997749,10cyclictest181rcu_preempt12:20:211
7629997749,10cyclictest181rcu_preempt12:20:211
7629997748,7cyclictest181rcu_preempt09:59:551
7629997742,19cyclictest0-21swapper/108:35:381
7629997735,15cyclictest181rcu_preempt08:01:461
762099777,44cyclictest15-21ksoftirqd/010:00:330
762099777,44cyclictest15-21ksoftirqd/010:00:330
762099776,28cyclictest15-21ksoftirqd/012:04:110
7620997754,17cyclictest308-21latency_hist08:15:160
7620997754,17cyclictest308-21latency_hist08:15:160
762099772,38cyclictest15-21ksoftirqd/011:43:010
7620997713,33cyclictest15-21ksoftirqd/009:48:210
7637997636,16cyclictest181rcu_preempt11:43:152
7637997621,11cyclictest181rcu_preempt09:20:422
7629997660,9cyclictest21439-21sh10:55:351
7629997657,14cyclictest7614-21cyclictest11:15:171
7629997657,14cyclictest7614-21cyclictest11:15:171
7629997649,9cyclictest181rcu_preempt09:46:181
7629997647,8cyclictest181rcu_preempt12:29:191
762999762,43cyclictest31-21ksoftirqd/107:30:011
7620997614,36cyclictest15-21ksoftirqd/008:51:060
7620997613,35cyclictest15-21ksoftirqd/009:57:250
764399759,33cyclictest0-21swapper/310:30:303
764399759,33cyclictest0-21swapper/310:30:303
764399752,61cyclictest13609-21chrt09:50:313
7637997553,12cyclictest0-21swapper/211:10:392
7637997553,12cyclictest0-21swapper/211:10:392
7637997547,20cyclictest14949-21kworker/u17:0-xprtiod10:50:172
7637997547,20cyclictest14949-21kworker/u17:0-xprtiod10:50:172
7637997540,12cyclictest181rcu_preempt11:25:372
7637997528,8cyclictest181rcu_preempt07:55:442
763799752,45cyclictest2290-21latency_hist10:25:162
7629997553,9cyclictest181rcu_preempt12:10:461
7629997553,11cyclictest0-21swapper/110:50:511
7629997550,7cyclictest181rcu_preempt11:54:521
7629997547,9cyclictest181rcu_preempt09:18:261
7629997547,9cyclictest181rcu_preempt09:18:261
762099756,41cyclictest15-21ksoftirqd/009:33:360
7620997558,11cyclictest22127-21fschecks_time09:10:370
7620997556,10cyclictest0-21swapper/007:40:150
7620997551,18cyclictest11207-21cut07:10:170
7620997551,18cyclictest11207-21cut07:10:170
7620997551,14cyclictest0-21swapper/007:25:290
763799744,44cyclictest11334-21apt-key07:10:162
763799744,44cyclictest11334-21apt-key07:10:162
763799743,37cyclictest10166-21munin-run08:45:152
7629997458,11cyclictest7614-21cyclictest09:00:391
7629997457,9cyclictest0-21swapper/108:15:141
7629997457,9cyclictest0-21swapper/108:15:141
7629997456,11cyclictest297-21systemd-logind07:25:161
762999743,35cyclictest31-21ksoftirqd/109:22:461
7620997455,13cyclictest352-21runrttasks11:53:460
7620997440,7cyclictest181rcu_preempt09:01:510
763799739,43cyclictest24745-21ntp_kernel_err11:00:422
763799739,43cyclictest24745-21ntp_kernel_err11:00:422
7637997357,10cyclictest15551-21unin-run09:00:152
7637997350,14cyclictest0-21swapper/212:23:042
7637997350,14cyclictest0-21swapper/212:23:042
7637997348,15cyclictest0-21swapper/212:10:172
7637997348,15cyclictest0-21swapper/212:10:172
7637997345,8cyclictest181rcu_preempt10:55:522
7629997349,7cyclictest181rcu_preempt09:34:151
7629997349,10cyclictest181rcu_preempt11:31:071
7629997349,10cyclictest181rcu_preempt11:31:071
7629997347,8cyclictest181rcu_preempt07:15:081
7629997347,17cyclictest11085-21ntpd08:26:371
7629997333,10cyclictest181rcu_preempt10:30:331
7629997333,10cyclictest181rcu_preempt10:30:331
7629997332,12cyclictest181rcu_preempt10:14:591
762999731,34cyclictest31-21ksoftirqd/111:49:561
762099735,27cyclictest15-21ksoftirqd/012:18:160
7620997320,31cyclictest15-21ksoftirqd/010:23:040
7620997319,23cyclictest1-21systemd07:55:150
614827312,37sleep15648-21apt-get06:55:251
7637997254,13cyclictest31584-21fschecks_time08:10:372
7637997254,13cyclictest31584-21fschecks_time08:10:372
7637997254,11cyclictest0-21swapper/210:40:512
7637997244,8cyclictest181rcu_preempt08:25:182
7637997243,11cyclictest181rcu_preempt12:05:152
7637997239,11cyclictest20025-21fschecks_time07:35:362
7637997230,17cyclictest181rcu_preempt09:30:402
7629997250,12cyclictest0-21swapper/107:40:191
7620997254,9cyclictest0-21swapper/007:45:290
7620997254,12cyclictest16302-21runrttasks07:25:150
7620997252,13cyclictest11483-21sed12:25:510
762099723,27cyclictest15-21ksoftirqd/010:10:070
7620997222,24cyclictest13003-21apt-get09:50:300
7620997210,24cyclictest15-21ksoftirqd/008:26:250
7637997143,9cyclictest181rcu_preempt11:50:362
7629997151,14cyclictest0-21swapper/108:10:181
7629997149,9cyclictest181rcu_preempt12:07:191
7629997149,9cyclictest181rcu_preempt12:07:191
7629997148,12cyclictest0-21swapper/108:40:361
7629997137,14cyclictest181rcu_preempt10:36:241
7629997135,18cyclictest13570-21apt-get09:50:421
762999712,26cyclictest31-21ksoftirqd/107:50:501
7620997154,11cyclictest21929-21ntp_offset07:40:430
7620997154,11cyclictest21929-21ntp_offset07:40:430
762099714,36cyclictest15-21ksoftirqd/008:05:350
7620997131,7cyclictest181rcu_preempt11:23:090
7620997128,35cyclictest29507-21latency_hist08:05:170
7637997036,16cyclictest11145-21cat09:45:482
7637997019,33cyclictest24807-21/usr/sbin/munin09:15:502
7637997019,33cyclictest24807-21/usr/sbin/munin09:15:502
7620997051,12cyclictest0-21swapper/007:30:370
7620997044,19cyclictest1060-21ssh09:30:150
7620997044,19cyclictest1060-21ssh09:30:150
7620997041,22cyclictest0-21swapper/008:35:520
762099702,37cyclictest15-21ksoftirqd/012:14:330
7620997012,30cyclictest15-21ksoftirqd/011:06:190
7637996944,17cyclictest28101-21timerwakeupswit11:05:512
763799694,33cyclictest25990-21apt07:55:142
7637996933,8cyclictest181rcu_preempt10:20:142
763799693,27cyclictest0-21swapper/209:05:512
7637996913,32cyclictest22160-21ssh09:10:382
7629996943,8cyclictest181rcu_preempt08:57:131
7629996934,11cyclictest181rcu_preempt07:31:571
763799684,42cyclictest15225-21fschecks_time07:20:372
763799684,25cyclictest15818-21ssh09:00:232
763799683,43cyclictest7688-21/usr/sbin/munin08:35:432
7620996851,7cyclictest0-21swapper/008:55:450
7620996815,27cyclictest15-21ksoftirqd/008:30:500
7620996815,27cyclictest15-21ksoftirqd/008:30:500
74602684,14sleep30-21swapper/307:00:043
763799673,50cyclictest12915-21ssh11:35:232
763799673,42cyclictest19766-21acpi10:00:232
763799673,42cyclictest19766-21acpi10:00:232
7637996730,9cyclictest181rcu_preempt11:19:032
762099673,51cyclictest170-21jbd2/mmcblk2p2-807:10:420
7620996720,24cyclictest15-21ksoftirqd/007:18:450
763799669,33cyclictest19577-21kworker/2:2+events_power_efficient08:15:502
763799669,33cyclictest19577-21kworker/2:2+events_power_efficient08:15:502
7637996641,15cyclictest0-21swapper/207:45:392
762099664,34cyclictest15-21ksoftirqd/008:18:500
762099664,34cyclictest15-21ksoftirqd/008:18:500
7637996544,13cyclictest0-21swapper/211:45:462
763799653,44cyclictest352-21runrttasks08:32:512
763799653,44cyclictest352-21runrttasks08:32:512
7643996410,28cyclictest0-21swapper/310:06:113
7637996340,12cyclictest0-21swapper/208:05:392
763799633,28cyclictest0-21swapper/207:43:292
763799633,28cyclictest0-21swapper/207:43:292
7643996214,31cyclictest0-21swapper/308:45:393
7643996210,29cyclictest0-21swapper/308:26:123
764399603,44cyclictest13440-21taskset09:50:193
764399603,39cyclictest917-21kworker/3:1+events11:30:513
764399603,39cyclictest917-21kworker/3:1+events11:30:513
764399563,39cyclictest27730-21taskset10:12:323
764399553,39cyclictest31713-21taskset10:20:143
764399553,35cyclictest1301-21taskset11:15:423
764399543,37cyclictest27161-21taskset09:19:183
764399543,37cyclictest27161-21taskset09:19:183
764399543,36cyclictest19491-21chrt11:45:413
764399543,34cyclictest4448-21chrt09:35:323
764399543,34cyclictest4448-21chrt09:35:323
764399543,30cyclictest0-21swapper/308:01:063
764399542,35cyclictest10393-21chrt12:25:253
764399534,36cyclictest4633-21chrt12:15:363
764399534,35cyclictest20699-21taskset10:00:493
764399534,35cyclictest20699-21taskset10:00:493
764399533,40cyclictest17142-21chrt09:01:263
764399533,40cyclictest14576-21taskset08:55:393
764399533,38cyclictest26505-21taskset07:55:363
764399533,35cyclictest15739-21chrt07:20:493
764399533,34cyclictest21695-21taskset09:10:183
764399532,35cyclictest31302-21taskset08:10:183
764399524,38cyclictest2911-21chrt09:32:073
764399523,33cyclictest917-21kworker/3:1+events08:35:393
764399523,32cyclictest30162-21chrt11:10:243
764399523,32cyclictest30162-21chrt11:10:243
764399522,37cyclictest12944-21taskset11:35:283
764399522,34cyclictest12456-21taskset07:11:343
7643995218,17cyclictest0-21swapper/308:51:423
764399513,36cyclictest7531-21chrt11:25:443
764399513,36cyclictest16942-21chrt10:48:153
764399513,36cyclictest16942-21chrt10:48:153
764399513,35cyclictest21208-21chrt07:40:173
764399513,34cyclictest7991-21chrt07:00:363
764399513,30cyclictest28224-21chrt12:00:373
764399512,39cyclictest32649-21taskset09:27:573
764399512,39cyclictest32649-21taskset09:27:573
764399512,38cyclictest16032-21taskset11:40:313
764399512,33cyclictest23135-21chrt10:58:123
764399512,32cyclictest24564-21chrt07:50:183
764399512,31cyclictest25951-21chrt11:55:503
286442510,9sleep30-21swapper/311:06:553
764399503,34cyclictest31919-21chrt08:10:473
764399503,34cyclictest31919-21chrt08:10:473
764399503,32cyclictest2227-21chrt08:20:313
764399503,31cyclictest11330-21chrt07:10:163
764399503,31cyclictest11330-21chrt07:10:163
764399502,36cyclictest22382-21taskset11:50:403
764399493,35cyclictest7685-21chrt12:20:343
764399493,35cyclictest7685-21chrt12:20:343
764399493,33cyclictest22715-21chrt09:10:513
764399493,32cyclictest9017-21chrt08:40:363
764399492,32cyclictest31626-21chrt12:05:473
764399492,32cyclictest31626-21chrt12:05:473
764399492,32cyclictest30133-21chrt09:24:173
764399482,33cyclictest9398-21taskset09:43:343
764399474,32cyclictest14727-21taskset07:20:163
764399473,32cyclictest4970-21chrt10:29:343
764399473,32cyclictest4970-21chrt10:29:343
764399472,33cyclictest2084-21chrt10:24:523
764399464,33cyclictest26537-21chrt11:04:243
764399464,33cyclictest26537-21chrt11:04:243
764399463,32cyclictest18342-21chrt07:30:333
764399463,29cyclictest17359-21chrt07:25:473
764399462,35cyclictest22247-21taskset07:40:503
764399462,35cyclictest22247-21taskset07:40:503
764399443,29cyclictest25334-21chrt07:50:503
764399432,32cyclictest3951-21taskset12:14:513
764399423,27cyclictest1271-21chrt08:15:493
764399423,27cyclictest1271-21chrt08:15:493
764399422,30cyclictest6586-21chrt08:30:523
764399422,30cyclictest6586-21chrt08:30:523
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional