You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-03-20 - 03:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack3slot6.osadl.org (updated Thu Mar 20, 2025 00:45:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25987210222,34sleep10-21swapper/119:05:421
2483129132,45sleep00-21swapper/019:05:140
2892028123,33sleep00-21swapper/019:15:140
2657199816,65cyclictest0-21swapper/020:55:160
26574997328,40cyclictest26-21ksoftirqd/100:15:261
26574997146,12cyclictest26-21ksoftirqd/119:35:151
26574997121,45cyclictest0-21swapper/119:40:151
26574997121,45cyclictest0-21swapper/119:40:141
26571997033,23cyclictest14-21ksoftirqd/022:32:090
26574996924,41cyclictest26-21ksoftirqd/122:20:151
2657199697,54cyclictest0-21swapper/021:40:130
26571996830,26cyclictest14-21ksoftirqd/000:01:300
26571996749,11cyclictest14-21ksoftirqd/020:39:370
26574996639,13cyclictest26-21ksoftirqd/119:50:171
2657499656,43cyclictest0-21swapper/119:45:181
26574996536,22cyclictest14804-21seq23:35:131
26574996535,20cyclictest26-21ksoftirqd/123:00:151
26571996435,12cyclictest14-21ksoftirqd/020:10:150
26571996434,10cyclictest14-21ksoftirqd/023:20:330
26574996334,20cyclictest26-21ksoftirqd/121:30:181
2657199637,49cyclictest0-21swapper/022:15:160
26571996341,17cyclictest14-21ksoftirqd/020:40:270
26571996340,17cyclictest14-21ksoftirqd/022:20:160
26571996323,33cyclictest14-21ksoftirqd/023:29:230
26571996236,21cyclictest14-21ksoftirqd/023:31:110
26571996224,32cyclictest14-21ksoftirqd/020:00:430
26574996137,16cyclictest441-21dbus-daemon21:05:001
26574996132,16cyclictest0-21swapper/122:35:251
26571996140,16cyclictest14-21ksoftirqd/022:10:310
26571996132,22cyclictest14-21ksoftirqd/019:55:150
26571996123,32cyclictest14-21ksoftirqd/023:40:210
2657499604,26cyclictest25054-21awk00:10:011
26574996032,22cyclictest26-21ksoftirqd/119:15:141
26574996030,22cyclictest7016-21cron23:10:001
26571996037,17cyclictest14-21ksoftirqd/021:55:190
26571996036,18cyclictest14-21ksoftirqd/019:30:210
26571996032,22cyclictest14-21ksoftirqd/022:55:290
26571996030,25cyclictest14-21ksoftirqd/019:37:300
26571996018,17cyclictest30844-21cron20:54:590
26574995935,18cyclictest26-21ksoftirqd/120:05:191
26574995933,18cyclictest0-21swapper/120:40:241
26574995931,17cyclictest0-21swapper/120:35:141
26574995915,40cyclictest0-21swapper/121:50:221
2657199595,40cyclictest0-21swapper/019:20:170
26571995940,12cyclictest14-21ksoftirqd/022:06:440
26571995936,17cyclictest14-21ksoftirqd/021:50:020
26571995924,29cyclictest0-21swapper/000:15:130
26574995831,21cyclictest26-21ksoftirqd/123:40:151
26574995830,21cyclictest26-21ksoftirqd/121:05:151
26574995829,21cyclictest441-21dbus-daemon00:39:011
26574995829,16cyclictest0-21swapper/100:10:161
26574995824,30cyclictest26-21ksoftirqd/120:00:011
26574995812,12cyclictest0-21swapper/123:50:361
2657199586,46cyclictest0-21swapper/022:35:240
26571995842,10cyclictest14-21ksoftirqd/020:20:300
26571995841,11cyclictest14-21ksoftirqd/021:05:000
26571995835,8cyclictest14-21ksoftirqd/000:35:330
26571995832,20cyclictest14-21ksoftirqd/020:15:130
26571995829,24cyclictest14-21ksoftirqd/020:35:000
26571995826,26cyclictest14-21ksoftirqd/023:10:210
26571995823,29cyclictest14-21ksoftirqd/023:35:220
26571995821,31cyclictest14-21ksoftirqd/000:20:240
26574995731,21cyclictest441-21dbus-daemon20:55:001
26574995729,19cyclictest26-21ksoftirqd/121:55:181
26574995726,25cyclictest441-21dbus-daemon20:35:001
26574995711,11cyclictest26-21ksoftirqd/121:43:421
2657199575,47cyclictest0-21swapper/023:45:390
26571995741,10cyclictest14-21ksoftirqd/022:55:000
26571995741,10cyclictest14-21ksoftirqd/000:30:000
26571995740,10cyclictest14-21ksoftirqd/021:10:370
26571995740,10cyclictest14-21ksoftirqd/021:10:360
26571995740,10cyclictest14-21ksoftirqd/020:50:010
26571995735,7cyclictest14-21ksoftirqd/020:05:380
26571995735,17cyclictest14-21ksoftirqd/023:56:290
26571995735,16cyclictest14-21ksoftirqd/023:20:010
26571995729,22cyclictest14-21ksoftirqd/019:55:010
26571995726,27cyclictest0-21swapper/000:30:210
2657499564,20cyclictest748-21cron00:25:001
26574995641,10cyclictest0-21swapper/119:30:251
26574995640,8cyclictest26-21ksoftirqd/122:15:011
26574995632,14cyclictest0-21swapper/100:00:101
26574995631,19cyclictest441-21dbus-daemon21:39:001
26574995629,22cyclictest261-21systemd-journal00:35:001
26574995628,17cyclictest0-21swapper/119:20:131
26574995625,24cyclictest441-21dbus-daemon21:00:001
26574995625,18cyclictest0-21swapper/120:15:151
26571995640,9cyclictest14-21ksoftirqd/019:40:310
26571995640,9cyclictest14-21ksoftirqd/019:40:310
26571995640,10cyclictest14-21ksoftirqd/022:50:000
26571995640,10cyclictest14-21ksoftirqd/022:45:010
26571995640,10cyclictest14-21ksoftirqd/021:15:200
26571995640,10cyclictest14-21ksoftirqd/019:30:000
26571995639,10cyclictest14-21ksoftirqd/023:00:230
26571995638,12cyclictest14-21ksoftirqd/021:30:360
26571995635,16cyclictest14-21ksoftirqd/023:50:040
26571995634,17cyclictest14-21ksoftirqd/021:46:540
26571995633,18cyclictest14-21ksoftirqd/021:39:000
26571995633,18cyclictest14-21ksoftirqd/021:20:190
26571995620,23cyclictest14-21ksoftirqd/021:29:230
26571995620,23cyclictest14-21ksoftirqd/021:29:230
26574995540,9cyclictest26-21ksoftirqd/123:30:171
26574995540,9cyclictest26-21ksoftirqd/122:34:591
26574995539,9cyclictest26-21ksoftirqd/119:25:281
26574995539,10cyclictest26-21ksoftirqd/100:00:031
26574995532,19cyclictest29106-21cron20:49:591
26571995539,10cyclictest14-21ksoftirqd/021:05:200
26571995539,10cyclictest14-21ksoftirqd/000:06:390
26571995538,10cyclictest14-21ksoftirqd/019:12:120
26571995536,14cyclictest26564-21chrt00:12:430
26571995532,18cyclictest14-21ksoftirqd/020:28:360
26571995530,19cyclictest14-21ksoftirqd/019:48:190
2657499547,18cyclictest3947-21apt-get21:10:171
2657499547,18cyclictest3947-21apt-get21:10:161
2657499546,11cyclictest0-21swapper/121:20:211
2657499546,11cyclictest0-21swapper/120:10:341
26574995439,9cyclictest26-21ksoftirqd/121:30:011
26574995439,9cyclictest26-21ksoftirqd/121:30:001
26574995439,9cyclictest26-21ksoftirqd/121:20:011
26574995439,9cyclictest26-21ksoftirqd/120:00:441
26574995433,16cyclictest2073-21ps22:50:341
2657499543,17cyclictest15449-21taskset21:49:071
26574995427,17cyclictest24321-21sort22:15:391
26574995424,23cyclictest441-21dbus-daemon00:29:591
26574995416,35cyclictest26-21ksoftirqd/122:40:511
26574995413,37cyclictest0-21swapper/123:24:211
26571995438,9cyclictest14-21ksoftirqd/022:03:320
26571995430,18cyclictest14-21ksoftirqd/022:25:340
2657499536,43cyclictest0-21swapper/119:10:231
2657499534,25cyclictest261-21systemd-journal20:25:001
26574995339,9cyclictest26-21ksoftirqd/122:55:111
26574995339,9cyclictest26-21ksoftirqd/122:47:071
26574995339,9cyclictest26-21ksoftirqd/122:05:371
26574995338,9cyclictest26-21ksoftirqd/123:50:021
26574995338,9cyclictest26-21ksoftirqd/123:15:001
26574995337,9cyclictest26-21ksoftirqd/123:20:011
26574995326,21cyclictest20779-21cron22:05:001
26574995237,9cyclictest26-21ksoftirqd/123:30:001
26574995237,9cyclictest26-21ksoftirqd/122:30:011
26574995228,20cyclictest261-21systemd-journal20:30:011
26571995231,16cyclictest6648-21taskset23:06:340
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional