You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-22 - 16:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6.osadl.org (updated Wed Oct 22, 2025 12:45:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2527821450,5sleep10-21swapper/111:20:201
32213210132,25sleep10-21swapper/107:08:451
32563999472,13cyclictest0-21swapper/008:15:120
3123529236,40sleep00-21swapper/007:05:240
289072920,7chrt0-21swapper/111:30:191
32563998963,13cyclictest14-21ksoftirqd/012:25:150
32563998663,12cyclictest14-21ksoftirqd/010:45:150
32563998160,11cyclictest14-21ksoftirqd/008:40:150
32563997949,20cyclictest14-21ksoftirqd/009:20:170
32563997947,18cyclictest14-21ksoftirqd/010:25:140
32563997752,14cyclictest14-21ksoftirqd/008:20:160
32563997749,16cyclictest14-21ksoftirqd/011:25:140
32563997745,26cyclictest14-21ksoftirqd/007:30:130
292482770,7sleep00-21swapper/010:00:200
32563997647,20cyclictest14-21ksoftirqd/011:20:150
32563997618,50cyclictest0-21swapper/010:15:130
32563997548,16cyclictest14-21ksoftirqd/008:35:140
32563997547,18cyclictest14-21ksoftirqd/012:15:110
32563997546,18cyclictest14-21ksoftirqd/009:50:130
32563997449,16cyclictest14-21ksoftirqd/009:25:120
32563997443,18cyclictest0-21swapper/007:55:160
32563997347,16cyclictest14-21ksoftirqd/008:25:120
32563997346,16cyclictest0-21swapper/012:05:150
32563997344,17cyclictest0-21swapper/011:40:180
32563997343,17cyclictest0-21swapper/012:20:130
32563997343,17cyclictest0-21swapper/012:10:160
32563997244,17cyclictest0-21swapper/011:55:120
32563997239,19cyclictest0-21swapper/007:10:030
32563997147,16cyclictest14-21ksoftirqd/007:50:150
32563997046,16cyclictest14-21ksoftirqd/010:20:150
32563997043,16cyclictest0-21swapper/009:40:180
32563997041,18cyclictest0-21swapper/011:35:150
32563997039,18cyclictest0-21swapper/011:05:140
32567996922,13cyclictest26-21ksoftirqd/107:20:061
32563996942,17cyclictest0-21swapper/010:10:160
32563996941,17cyclictest0-21swapper/009:05:150
32563996941,17cyclictest0-21swapper/009:05:140
32563996941,16cyclictest0-21swapper/012:35:170
32563996939,17cyclictest0-21swapper/010:30:150
32563996844,17cyclictest14-21ksoftirqd/010:35:130
32563996841,17cyclictest0-21swapper/008:55:150
32563996840,18cyclictest0-21swapper/012:30:130
32563996840,16cyclictest0-21swapper/011:10:240
32563996839,19cyclictest0-21swapper/011:45:150
32563996839,17cyclictest0-21swapper/007:45:120
32567996740,10cyclictest26-21ksoftirqd/109:07:451
32567996740,10cyclictest26-21ksoftirqd/109:07:451
32567996718,35cyclictest26-21ksoftirqd/112:00:011
32567996716,12cyclictest26-21ksoftirqd/111:00:021
32563996742,17cyclictest14-21ksoftirqd/010:55:140
32563996739,18cyclictest0-21swapper/009:00:150
3256799669,45cyclictest26-21ksoftirqd/110:10:451
3256799668,46cyclictest26-21ksoftirqd/108:30:481
32567996612,14cyclictest151rcu_preempt10:20:011
32567996611,8cyclictest151rcu_preempt08:40:141
32563996642,16cyclictest14-21ksoftirqd/008:05:150
32563996638,18cyclictest0-21swapper/007:25:170
32563996636,17cyclictest0-21swapper/011:50:160
32567996525,12cyclictest26-21ksoftirqd/111:39:011
32567996519,21cyclictest26-21ksoftirqd/112:39:001
32567996517,20cyclictest26-21ksoftirqd/108:10:181
32567996514,23cyclictest26-21ksoftirqd/109:05:001
32563996541,15cyclictest14-21ksoftirqd/009:55:140
3256799649,44cyclictest26-21ksoftirqd/111:45:221
32567996441,10cyclictest6772-21/usr/sbin/munin12:00:341
32567996433,13cyclictest26-21ksoftirqd/107:35:031
32567996432,12cyclictest26-21ksoftirqd/109:15:001
3256399649,10cyclictest14-21ksoftirqd/007:20:050
3256399647,10cyclictest14-21ksoftirqd/008:30:060
32563996439,16cyclictest0-21swapper/010:40:140
32563996437,16cyclictest0-21swapper/007:15:140
32563996434,17cyclictest0-21swapper/011:15:260
3256799633,40cyclictest1272-21grep07:10:381
3256799633,10cyclictest12340-21expr12:15:191
32567996329,14cyclictest26-21ksoftirqd/110:09:011
32567996322,19cyclictest26-21ksoftirqd/110:49:011
32567996322,13cyclictest26-21ksoftirqd/109:40:061
32567996321,19cyclictest26-21ksoftirqd/108:29:091
32563996337,15cyclictest14-21ksoftirqd/007:40:130
32563996335,18cyclictest12882-21taskset09:15:130
32563996334,17cyclictest0-21swapper/012:00:110
32563996318,18cyclictest22690-21/usr/sbin/munin08:10:250
32567996233,12cyclictest26-21ksoftirqd/110:40:001
32567996219,20cyclictest26-21ksoftirqd/109:38:291
32567996219,20cyclictest26-21ksoftirqd/108:57:161
3256399628,11cyclictest14-21ksoftirqd/007:35:030
32563996236,15cyclictest0-21swapper/009:30:120
32563996236,15cyclictest0-21swapper/009:30:120
3256799615,51cyclictest0-21swapper/109:30:311
3256799615,51cyclictest0-21swapper/109:30:301
32567996135,11cyclictest26-21ksoftirqd/111:01:441
32567996133,14cyclictest26-21ksoftirqd/111:30:011
32567996133,13cyclictest26-21ksoftirqd/111:19:591
3256799612,20cyclictest251rcuc/111:10:051
32567996119,37cyclictest26-21ksoftirqd/110:40:301
32567996119,19cyclictest26-21ksoftirqd/107:58:401
32567996117,20cyclictest26-21ksoftirqd/107:15:211
32567996113,20cyclictest26-21ksoftirqd/112:30:001
3256399617,12cyclictest14-21ksoftirqd/010:09:010
32563996131,17cyclictest0-21swapper/011:30:160
32567996029,11cyclictest26-21ksoftirqd/110:00:221
32567996022,23cyclictest26-21ksoftirqd/112:25:011
32567996021,19cyclictest26-21ksoftirqd/112:14:381
32567996019,20cyclictest26-21ksoftirqd/111:40:321
32567996019,19cyclictest26-21ksoftirqd/107:45:171
32567996019,13cyclictest26-21ksoftirqd/108:18:101
32567996017,21cyclictest26-21ksoftirqd/110:51:301
32563996011,10cyclictest14-21ksoftirqd/008:50:010
32567995926,11cyclictest26-21ksoftirqd/112:09:001
32567995921,21cyclictest26-21ksoftirqd/107:40:171
32567995920,12cyclictest26-21ksoftirqd/108:23:101
32567995919,8cyclictest151rcu_preempt08:45:171
32567995918,26cyclictest21847-21seq08:08:261
32567995916,24cyclictest26-21ksoftirqd/109:25:141
32567995915,21cyclictest26-21ksoftirqd/108:03:081
32567995914,18cyclictest7021-21ntpq07:25:321
32567995914,10cyclictest0-21swapper/109:50:201
32563995933,17cyclictest32557-21cyclictest08:00:140
32563995933,16cyclictest0-21swapper/009:35:120
32563995915,36cyclictest0-21swapper/009:45:120
32563995910,10cyclictest14-21ksoftirqd/009:11:440
32567995832,12cyclictest26-21ksoftirqd/110:31:441
32567995831,12cyclictest26-21ksoftirqd/110:30:001
3256799582,21cyclictest12872-21/usr/sbin/munin09:15:391
32567995822,19cyclictest26-21ksoftirqd/109:45:181
32567995822,12cyclictest26-21ksoftirqd/108:53:171
32567995819,20cyclictest26-21ksoftirqd/111:05:371
32567995818,21cyclictest26-21ksoftirqd/109:20:441
32567995818,19cyclictest26-21ksoftirqd/111:55:021
32567995816,20cyclictest26-21ksoftirqd/107:35:011
32567995813,18cyclictest15931-21ntpq07:50:301
3256799578,14cyclictest151rcu_preempt08:40:001
32567995737,8cyclictest3857-21ls10:20:201
32567995731,13cyclictest26-21ksoftirqd/112:35:011
32567995717,20cyclictest26-21ksoftirqd/109:55:301
32563995728,16cyclictest0-21swapper/011:00:170
32563995632,15cyclictest0-21swapper/010:50:140
32563995619,20cyclictest14-21ksoftirqd/008:50:240
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional