You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-19 - 06:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Sat Jul 19, 2025 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11542993128,2cyclictest9938-21cron23:40:002
1154299300,29cyclictest303-21systemd-journal19:15:022
1153899300,29cyclictest3535-21cron21:10:001
1153899300,29cyclictest22-21ksoftirqd/121:35:141
11544992926,2cyclictest303-21systemd-journal19:45:003
1154499290,28cyclictest0-21swapper/323:15:143
1154499290,28cyclictest0-21swapper/300:10:013
1154499290,1cyclictest31366-21apt-get00:25:143
1154299290,28cyclictest0-21swapper/222:20:142
1154299290,28cyclictest0-21swapper/221:45:142
11538992927,1cyclictest609-21dbus-daemon21:20:011
11538992927,1cyclictest3013-21idleruntime-cro20:00:011
11538992927,1cyclictest22-21ksoftirqd/119:15:131
1153899290,28cyclictest9686-21apt-get22:30:151
1153899290,28cyclictest0-21swapper/122:45:141
1153899290,28cyclictest0-21swapper/100:15:121
11534992927,1cyclictest609-21dbus-daemon21:15:010
1153499290,28cyclictest5566-21apt-get23:30:130
11544992828,0cyclictest0-21swapper/322:45:133
11544992826,1cyclictest609-21dbus-daemon23:35:003
1154499280,27cyclictest29263-21apt-get20:55:143
1154499280,1cyclictest11755-21munin-run22:35:013
1154499280,0cyclictest0-21swapper/323:05:143
1154299280,27cyclictest3306-21apt-get20:00:132
1154299280,27cyclictest17264-21apt-get23:55:142
11538992828,0cyclictest0-21swapper/122:55:161
11538992828,0cyclictest0-21swapper/120:20:131
1153899280,28cyclictest0-21swapper/123:35:141
1153899280,0cyclictest18813-21apt-get19:25:141
11534992828,0cyclictest17264-21apt-get23:55:130
11534992827,1cyclictest25495-21apt-get21:55:120
11534992827,0cyclictest0-21swapper/023:40:140
11534992826,1cyclictest0-21swapper/021:05:000
11544992727,0cyclictest8505-21apt-get21:20:133
11542992727,0cyclictest0-21swapper/200:10:142
11542992726,1cyclictest26942-21apt-get20:50:152
11538992727,0cyclictest0-21swapper/123:10:091
11534992727,0cyclictest7888-21apt-get23:35:140
11534992727,0cyclictest21136-21apt-get19:30:130
11534992727,0cyclictest0-21swapper/022:00:130
11534992725,1cyclictest0-21swapper/020:29:590
1153499270,0cyclictest21993-21apt-get20:40:120
11544992626,0cyclictest1268-21apt-get00:30:143
11544992626,0cyclictest0-21swapper/322:10:163
11544992626,0cyclictest0-21swapper/321:55:113
11544992626,0cyclictest0-21swapper/319:55:133
11544992625,1cyclictest31605-21apt-get21:00:133
11542992626,0cyclictest14946-21apt-get20:25:142
11542992625,1cyclictest613-21in:imuxsock20:20:002
11538992626,0cyclictest0-21swapper/122:05:121
11538992626,0cyclictest0-21swapper/100:20:141
11534992626,0cyclictest21383-21apt-get22:55:140
11534992626,0cyclictest0-21swapper/020:00:140
11534992626,0cyclictest0-21swapper/019:20:170
11534992626,0cyclictest0-21swapper/019:10:130
11544992525,0cyclictest4737-21apt-get22:20:143
11544992525,0cyclictest0-21swapper/320:25:133
11542992525,0cyclictest29045-21apt-get00:20:132
11542992525,0cyclictest26046-21apt-get23:05:142
11542992525,0cyclictest0-21swapper/220:40:142
11538992525,0cyclictest0-21swapper/123:40:141
11538992525,0cyclictest0-21swapper/123:00:131
11538992525,0cyclictest0-21swapper/122:40:141
11534992525,0cyclictest0-21swapper/000:20:140
11534992525,0cyclictest0-21swapper/000:00:130
11544992424,0cyclictest12622-21apt-get20:20:123
11544992424,0cyclictest0-21swapper/321:25:013
11544992423,0cyclictest12017-21apt-get22:35:153
11544992422,1cyclictest0-21swapper/319:40:003
11542992424,0cyclictest0-21swapper/222:35:142
11542992422,1cyclictest30484-21apt-get19:50:042
11538992424,0cyclictest0-21swapper/123:50:161
11538992424,0cyclictest0-21swapper/121:25:121
11538992424,0cyclictest0-21swapper/121:10:141
11538992424,0cyclictest0-21swapper/100:35:151
11538992421,2cyclictest10534-21awk21:25:011
11534992424,0cyclictest951-21apt-get19:55:110
11534992422,1cyclictest19362-21cron20:35:000
11544992323,0cyclictest30484-21apt-get19:50:013
11544992323,0cyclictest0-21swapper/321:45:143
11542992323,0cyclictest0-21swapper/200:05:182
11538992323,0cyclictest31052-21apt-get19:50:121
11538992323,0cyclictest0-21swapper/122:50:121
11538992323,0cyclictest0-21swapper/122:25:091
11538992323,0cyclictest0-21swapper/121:00:121
11538992323,0cyclictest0-21swapper/119:35:151
11538992321,1cyclictest978-21awk00:30:021
11534992323,0cyclictest0-21swapper/000:05:170
11534992320,2cyclictest9979-21awk20:15:010
11544992222,0cyclictest0-21swapper/323:55:133
11542992222,0cyclictest0-21swapper/223:45:122
11538992222,0cyclictest0-21swapper/120:40:121
11538992222,0cyclictest0-21swapper/120:35:161
11534992222,0cyclictest14074-21perf22:40:010
11534992222,0cyclictest0-21swapper/023:05:130
11534992220,1cyclictest2954-21awk23:25:000
11544992121,0cyclictest0-21swapper/321:50:123
11544992121,0cyclictest0-21swapper/300:05:013
11544992119,1cyclictest19381-21perf20:35:003
11538992121,0cyclictest0-21swapper/120:30:131
11534992121,0cyclictest25229-21perf21:55:010
11534992121,0cyclictest18226-21apt-get21:40:110
11534992121,0cyclictest0-21swapper/019:40:140
11534992119,1cyclictest3564-21perf21:10:010
11544992020,0cyclictest24376-21apt-get00:10:153
11542992018,1cyclictest31285-21cron20:59:592
11538992020,0cyclictest0-21swapper/120:00:131
11538992020,0cyclictest0-21swapper/119:20:161
11534992020,0cyclictest0-21swapper/020:45:120
11544991919,0cyclictest10232-21apt-get23:40:133
11542991919,0cyclictest28426-21apt-get19:45:122
11542991919,0cyclictest0-21swapper/220:05:142
11538991919,0cyclictest0-21swapper/121:40:101
11538991918,1cyclictest2104-21cron22:15:011
11538991917,2cyclictest23173-21awk19:35:011
11544991816,1cyclictest637-21cron19:55:023
11542991818,0cyclictest26108-21apt-get19:40:152
11542991818,0cyclictest0-21swapper/221:25:022
11542991817,1cyclictest5646-21cron00:40:022
11534991818,0cyclictest0-21swapper/021:15:120
11544991717,0cyclictest12562-21apt-get23:45:113
11544991717,0cyclictest0-21swapper/321:05:113
11542991717,0cyclictest951-21apt-get19:55:132
11542991717,0cyclictest0-21swapper/221:31:542
11542991715,1cyclictest626-21gdbus20:50:012
11534991717,0cyclictest23183-21apt-get19:35:010
11544991614,1cyclictest32192-21awk22:10:003
1154499160,15cyclictest7734-21munin-run20:10:013
11542991616,0cyclictest0-21swapper/223:15:132
11542991616,0cyclictest0-21swapper/221:55:112
11542991616,0cyclictest0-21swapper/220:10:122
11542991615,1cyclictest6156-21apt-get21:15:112
1154299160,15cyclictest2093-21cron22:15:012
11538991616,0cyclictest0-21swapper/120:45:121
11538991614,1cyclictest0-21swapper/121:55:201
11538991614,1cyclictest0-21swapper/100:10:141
1153899160,1cyclictest303-21systemd-journal00:05:001
1153899160,15cyclictest4801-21unixbench_multi23:25:211
11534991616,0cyclictest0-21swapper/020:50:150
11534991614,1cyclictest537-21taskset19:54:040
11534991614,1cyclictest2657-21cat00:30:230
1153499160,15cyclictest18294-21awk22:45:220
11544991514,1cyclictest24036-21apt-get20:45:013
1154499150,14cyclictest4106-21irqstats20:00:183
1154499150,14cyclictest0-21swapper/320:40:003
11542991515,0cyclictest0-21swapper/221:40:102
11542991513,1cyclictest0-21swapper/223:25:172
1154299150,1cyclictest0-21swapper/222:19:362
1154299150,14cyclictest0-21swapper/223:24:132
11538991515,0cyclictest0-21swapper/122:15:121
11538991514,1cyclictest0-21swapper/123:20:121
11538991513,1cyclictest0-21swapper/123:55:201
11534991514,1cyclictest176262chrt21:36:230
11544991414,0cyclictest30166-21sshd23:12:103
11544991414,0cyclictest0-21swapper/323:20:293
11544991414,0cyclictest0-21swapper/322:55:223
11544991414,0cyclictest0-21swapper/321:40:113
11544991414,0cyclictest0-21swapper/320:50:563
11544991412,1cyclictest8367-21df_inode20:10:133
1154499141,0cyclictest0-21swapper/322:25:213
1154499140,14cyclictest0-21swapper/323:50:033
1154499140,14cyclictest0-21swapper/323:26:453
1154499140,14cyclictest0-21swapper/322:41:393
1154499140,14cyclictest0-21swapper/322:17:493
1154499140,14cyclictest0-21swapper/322:04:483
1154499140,14cyclictest0-21swapper/321:12:163
1154499140,14cyclictest0-21swapper/320:40:543
1154499140,14cyclictest0-21swapper/319:21:323
1154499140,14cyclictest0-21swapper/319:11:273
1154499140,14cyclictest0-21swapper/300:19:533
1154499140,0cyclictest0-21swapper/323:36:163
1154499140,0cyclictest0-21swapper/323:00:543
1154499140,0cyclictest0-21swapper/322:54:273
1154499140,0cyclictest0-21swapper/321:36:283
1154499140,0cyclictest0-21swapper/321:32:363
1154499140,0cyclictest0-21swapper/319:30:233
1154499140,0cyclictest0-21swapper/319:15:083
1154499140,0cyclictest0-21swapper/300:24:473
11542991414,0cyclictest0-21swapper/223:41:102
11542991414,0cyclictest0-21swapper/223:10:512
11542991414,0cyclictest0-21swapper/222:02:402
11542991414,0cyclictest0-21swapper/221:35:182
11542991414,0cyclictest0-21swapper/221:12:212
11542991414,0cyclictest0-21swapper/221:05:112
11542991414,0cyclictest0-21swapper/219:15:292
1154299140,14cyclictest0-21swapper/223:51:372
1154299140,14cyclictest0-21swapper/223:03:552
1154299140,14cyclictest0-21swapper/222:58:032
1154299140,14cyclictest0-21swapper/222:51:092
1154299140,14cyclictest0-21swapper/222:40:182
1154299140,14cyclictest0-21swapper/222:30:062
1154299140,14cyclictest0-21swapper/222:27:592
1154299140,14cyclictest0-21swapper/221:03:232
1154299140,14cyclictest0-21swapper/220:35:242
1154299140,14cyclictest0-21swapper/220:20:242
1154299140,14cyclictest0-21swapper/219:35:472
1154299140,14cyclictest0-21swapper/219:30:032
1154299140,14cyclictest0-21swapper/219:27:032
1154299140,14cyclictest0-21swapper/219:21:142
1154299140,14cyclictest0-21swapper/200:30:112
1154299140,14cyclictest0-21swapper/200:02:552
1154299140,0cyclictest0-21swapper/222:49:152
1154299140,0cyclictest0-21swapper/221:52:502
1154299140,0cyclictest0-21swapper/221:20:592
1154299140,0cyclictest0-21swapper/220:31:002
11538991414,0cyclictest0-21swapper/122:00:011
11538991414,0cyclictest0-21swapper/121:46:201
11538991414,0cyclictest0-21swapper/119:11:171
1153899140,14cyclictest0-21swapper/123:45:561
1153899140,14cyclictest0-21swapper/123:05:331
1153899140,14cyclictest0-21swapper/122:35:021
1153899140,14cyclictest0-21swapper/122:21:051
1153899140,14cyclictest0-21swapper/121:50:321
1153899140,14cyclictest0-21swapper/120:50:101
1153899140,14cyclictest0-21swapper/120:26:261
1153899140,14cyclictest0-21swapper/120:10:341
1153899140,14cyclictest0-21swapper/120:06:151
1153899140,14cyclictest0-21swapper/119:45:101
1153899140,14cyclictest0-21swapper/119:43:281
1153899140,0cyclictest0-21swapper/123:30:441
1153899140,0cyclictest0-21swapper/121:31:061
1153899140,0cyclictest0-21swapper/120:55:271
1153899140,0cyclictest0-21swapper/120:16:411
1153899140,0cyclictest0-21swapper/100:30:241
1153899140,0cyclictest0-21swapper/100:05:241
11534991414,0cyclictest20552-21apt-get21:45:150
11534991414,0cyclictest0-21swapper/023:04:120
11534991414,0cyclictest0-21swapper/022:50:280
11534991414,0cyclictest0-21swapper/022:32:360
11534991414,0cyclictest0-21swapper/021:21:030
11534991414,0cyclictest0-21swapper/020:55:140
11534991414,0cyclictest0-21swapper/020:20:130
11534991414,0cyclictest0-21swapper/019:18:000
11534991414,0cyclictest0-21swapper/000:28:130
11534991414,0cyclictest0-21swapper/000:15:220
11534991412,1cyclictest2358-21/usr/sbin/munin22:15:160
1153499140,14cyclictest0-21swapper/023:53:120
1153499140,14cyclictest0-21swapper/023:45:060
1153499140,14cyclictest0-21swapper/023:11:580
1153499140,14cyclictest0-21swapper/022:06:050
1153499140,14cyclictest0-21swapper/021:30:070
1153499140,14cyclictest0-21swapper/020:15:090
1153499140,14cyclictest0-21swapper/000:35:390
1153499140,0cyclictest0-21swapper/023:25:460
1153499140,0cyclictest0-21swapper/023:17:410
1153499140,0cyclictest0-21swapper/022:41:500
1153499140,0cyclictest0-21swapper/022:25:250
1153499140,0cyclictest0-21swapper/022:20:250
1153499140,0cyclictest0-21swapper/022:10:050
1153499140,0cyclictest0-21swapper/021:27:090
1153499140,0cyclictest0-21swapper/020:35:060
1153499140,0cyclictest0-21swapper/020:05:090
1153499140,0cyclictest0-21swapper/019:45:440
1153499140,0cyclictest0-21swapper/019:26:330
1153499140,0cyclictest0-21swapper/000:10:230
11544991313,0cyclictest0-21swapper/300:35:423
1154499130,13cyclictest0-21swapper/320:15:073
1154499130,0cyclictest0-21swapper/321:15:093
11542991313,0cyclictest0-21swapper/223:30:192
11542991313,0cyclictest0-21swapper/222:05:392
1154299130,0cyclictest0-21swapper/200:25:422
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional