You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 14:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Sun Nov 30, 2025 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11946993130,1cyclictest28-21ksoftirqd/200:20:022
1194399300,29cyclictest27874-21cron23:10:011
1194399300,29cyclictest14213-21awk19:15:011
1194199300,29cyclictest7455-21awk23:35:010
1194199300,29cyclictest13017-21cron21:30:000
1195199290,29cyclictest31698-21apt-get21:00:143
1195199290,28cyclictest609-21dbus-daemon19:15:003
1195199290,28cyclictest303-21systemd-journal23:10:003
11946992927,1cyclictest8078-21apt-get20:10:162
11946992927,1cyclictest609-21dbus-daemon20:40:002
1194399290,28cyclictest0-21swapper/121:00:131
11951992827,1cyclictest8659-21apt-get21:20:133
11951992826,1cyclictest12134-21cron23:45:013
1195199280,0cyclictest0-21swapper/321:35:133
11946992828,0cyclictest24199-21apt-get00:10:142
1194699280,0cyclictest27307-21apt-get22:00:142
11943992826,1cyclictest12135-21idleruntime-cro23:45:001
1194399280,28cyclictest0-21swapper/123:15:141
11941992828,0cyclictest18900-21apt-get19:25:010
11941992827,0cyclictest0-21swapper/022:55:030
11941992826,1cyclictest609-21dbus-daemon23:05:010
11941992825,2cyclictest19441-21cron20:35:000
1194199280,28cyclictest0-21swapper/023:05:120
1194199280,28cyclictest0-21swapper/022:45:150
1194199280,28cyclictest0-21swapper/022:25:110
1194199280,27cyclictest0-21swapper/022:15:150
1194199280,0cyclictest3987-21apt-get21:10:150
1194199280,0cyclictest0-21swapper/022:10:130
1194199280,0cyclictest0-21swapper/021:50:130
1194199280,0cyclictest0-21swapper/019:55:140
11951992727,0cyclictest0-21swapper/323:55:123
11951992727,0cyclictest0-21swapper/323:25:153
11951992727,0cyclictest0-21swapper/320:10:163
11951992726,1cyclictest24959-21apt-get21:55:133
1195199270,27cyclictest0-21swapper/320:45:143
1195199270,27cyclictest0-21swapper/320:35:123
1195199270,0cyclictest0-21swapper/323:15:143
11946992727,0cyclictest26725-21apt-get20:50:132
11946992727,0cyclictest0-21swapper/222:40:132
11946992727,0cyclictest0-21swapper/221:55:122
11946992725,1cyclictest9797-21sh23:40:022
11946992725,1cyclictest29354-21apt-get20:55:142
1194699270,27cyclictest1914-21apt-get22:15:152
11943992727,0cyclictest3090-21apt-get23:25:141
11943992727,0cyclictest17072-21apt-get23:55:131
11943992727,0cyclictest0-21swapper/121:20:141
1194399270,27cyclictest0-21swapper/120:45:141
1194399270,27cyclictest0-21swapper/120:35:131
1194399270,0cyclictest0-21swapper/121:35:121
11941992727,0cyclictest0-21swapper/023:50:140
11941992727,0cyclictest0-21swapper/019:35:150
11941992727,0cyclictest0-21swapper/000:30:130
11941992726,0cyclictest0-21swapper/000:35:140
1194199270,0cyclictest0-21swapper/020:40:140
11951992624,1cyclictest20268-21cron22:55:013
11946992626,0cyclictest26477-21apt-get19:40:142
11946992626,0cyclictest0-21swapper/222:50:142
11946992626,0cyclictest0-21swapper/220:34:592
11943992626,0cyclictest0-21swapper/121:55:131
11943992626,0cyclictest0-21swapper/120:10:151
11943992624,2cyclictest20279-21sh22:55:011
11951992524,1cyclictest7820-21munin-run20:10:013
11951992524,1cyclictest0-21swapper/300:10:133
11946992525,0cyclictest362-21apt-get23:20:132
11946992525,0cyclictest362-21apt-get23:20:132
11946992525,0cyclictest15916-21apt-get22:45:142
11946992522,2cyclictest6027-21cron21:15:002
11943992525,0cyclictest0-21swapper/121:40:131
11943992524,1cyclictest20868-21apt-get22:55:151
11943992524,1cyclictest0-21swapper/120:10:011
11943992524,0cyclictest0-21swapper/121:15:131
11941992525,0cyclictest0-21swapper/020:15:140
11941992525,0cyclictest0-21swapper/019:50:140
11951992424,0cyclictest0-21swapper/322:55:143
11951992424,0cyclictest0-21swapper/321:15:123
11951992424,0cyclictest0-21swapper/320:20:153
11951992424,0cyclictest0-21swapper/300:25:163
11951992423,0cyclictest28773-21apt-get20:55:023
11946992424,0cyclictest0-21swapper/221:45:142
11946992424,0cyclictest0-21swapper/220:20:012
11946992424,0cyclictest0-21swapper/219:45:142
11946992424,0cyclictest0-21swapper/219:15:162
11943992424,0cyclictest0-21swapper/120:20:151
11943992423,1cyclictest0-21swapper/120:55:011
11941992424,0cyclictest0-21swapper/023:10:130
11941992424,0cyclictest0-21swapper/020:00:160
11941992423,1cyclictest28781-21perf20:55:000
11941992423,1cyclictest17991-21apt-get21:40:130
11951992323,0cyclictest0-21swapper/319:50:133
11951992321,1cyclictest10977-21munin-run22:35:013
11946992323,0cyclictest0-21swapper/222:30:122
11946992322,1cyclictest0-21swapper/221:45:012
11943992323,0cyclictest31120-21apt-get19:50:141
11943992323,0cyclictest0-21swapper/100:25:151
11943992323,0cyclictest0-21swapper/100:10:141
11943992321,1cyclictest10971-21perf22:35:001
11941992323,0cyclictest0-21swapper/023:20:120
11941992323,0cyclictest0-21swapper/023:20:120
11941992323,0cyclictest0-21swapper/000:20:130
11951992222,0cyclictest0-21swapper/323:45:153
11951992222,0cyclictest0-21swapper/323:00:013
11951992222,0cyclictest0-21swapper/322:05:143
11951992222,0cyclictest0-21swapper/321:25:123
11951992222,0cyclictest0-21swapper/319:15:143
11946992222,0cyclictest0-21swapper/200:35:132
11943992222,0cyclictest10982-21apt-get21:25:131
11943992222,0cyclictest0-21swapper/123:45:141
11943992222,0cyclictest0-21swapper/122:05:151
11943992222,0cyclictest0-21swapper/119:15:151
11941992222,0cyclictest0-21swapper/023:55:130
11941992222,0cyclictest0-21swapper/023:45:140
11951992121,0cyclictest0-21swapper/322:35:123
11946992118,2cyclictest609-21dbus-daemon23:55:002
11943992121,0cyclictest11234-21apt-get22:35:111
11943992121,0cyclictest0-21swapper/123:00:021
11941992121,0cyclictest30478-21apt-get23:15:130
11941992121,0cyclictest0-21swapper/022:30:120
11941992121,0cyclictest0-21swapper/022:20:130
11941992121,0cyclictest0-21swapper/000:15:120
11941992121,0cyclictest0-21swapper/000:05:140
11946992020,0cyclictest0-21swapper/220:05:152
11946992014,5cyclictest0-21swapper/222:10:142
11951991919,0cyclictest13591-21apt-get22:40:133
11946991919,0cyclictest0-21swapper/219:25:132
11946991917,1cyclictest609-21dbus-daemon22:30:012
11943991919,0cyclictest0-21swapper/122:40:121
11941991919,0cyclictest0-21swapper/020:25:130
11941991919,0cyclictest0-21swapper/019:10:130
11951991818,0cyclictest0-21swapper/320:30:003
11946991818,0cyclictest20302-21apt-get22:55:022
11946991818,0cyclictest0-21swapper/221:00:132
11946991818,0cyclictest0-21swapper/200:05:142
11943991818,0cyclictest0-21swapper/120:30:011
11941991818,0cyclictest0-21swapper/023:35:120
11941991818,0cyclictest0-21swapper/019:20:130
1195199175,8cyclictest5645-21vmstat21:10:243
11951991715,1cyclictest0-21swapper/322:14:593
11946991717,0cyclictest0-21swapper/223:25:022
11943991715,1cyclictest1648-21munin-run22:15:001
11941991717,0cyclictest0-21swapper/021:30:110
11941991715,1cyclictest609-21dbus-daemon23:30:000
11946991616,0cyclictest0-21swapper/219:35:142
11941991616,0cyclictest0-21swapper/022:00:150
11941991616,0cyclictest0-21swapper/021:35:120
1194199160,15cyclictest20161-21snmpd00:00:170
11951991515,0cyclictest0-21swapper/319:40:143
11951991513,1cyclictest23913-21basename00:10:003
1195199150,1cyclictest9369-21sed23:35:223
1195199150,1cyclictest22003-21cstates19:30:163
11946991515,0cyclictest16848-21apt-get19:20:142
11946991514,1cyclictest21653-21latency_hist00:05:012
11946991513,1cyclictest16124-21ntp_states20:25:172
1194699150,14cyclictest2463-21irqstats21:05:182
1194699150,14cyclictest0-21swapper/223:05:012
11943991515,0cyclictest0-21swapper/119:40:141
11943991513,1cyclictest23902-21cron00:10:011
1194399150,14cyclictest0-21swapper/119:56:181
11941991513,1cyclictest8600-21grep20:10:170
11951991414,0cyclictest0-21swapper/300:30:493
1195199140,14cyclictest0-21swapper/323:50:053
1195199140,14cyclictest0-21swapper/323:30:093
1195199140,14cyclictest0-21swapper/323:20:323
1195199140,14cyclictest0-21swapper/323:20:323
1195199140,14cyclictest0-21swapper/322:45:113
1195199140,14cyclictest0-21swapper/322:26:283
1195199140,14cyclictest0-21swapper/322:20:283
1195199140,14cyclictest0-21swapper/322:15:053
1195199140,14cyclictest0-21swapper/321:51:173
1195199140,14cyclictest0-21swapper/321:45:553
1195199140,14cyclictest0-21swapper/321:06:303
1195199140,14cyclictest0-21swapper/320:50:053
1195199140,14cyclictest0-21swapper/320:16:243
1195199140,14cyclictest0-21swapper/320:00:333
1195199140,14cyclictest0-21swapper/319:46:233
1195199140,14cyclictest0-21swapper/319:25:343
1195199140,14cyclictest0-21swapper/319:21:113
1195199140,14cyclictest0-21swapper/300:20:593
1195199140,14cyclictest0-21swapper/300:00:583
1195199140,0cyclictest0-21swapper/323:14:233
1195199140,0cyclictest0-21swapper/322:00:113
1195199140,0cyclictest0-21swapper/321:30:173
1195199140,0cyclictest0-21swapper/320:40:593
1195199140,0cyclictest0-21swapper/319:56:173
1195199140,0cyclictest0-21swapper/319:37:013
1195199140,0cyclictest0-21swapper/300:35:223
1195199140,0cyclictest0-21swapper/300:15:483
11946991414,0cyclictest0-21swapper/222:35:132
11946991413,1cyclictest1077-21apt-get19:55:142
1194699140,14cyclictest0-21swapper/223:40:192
1194699140,14cyclictest0-21swapper/223:30:092
1194699140,14cyclictest0-21swapper/223:10:592
1194699140,14cyclictest0-21swapper/222:22:312
1194699140,14cyclictest0-21swapper/221:54:592
1194699140,14cyclictest0-21swapper/221:36:452
1194699140,14cyclictest0-21swapper/221:29:112
1194699140,14cyclictest0-21swapper/221:21:102
1194699140,14cyclictest0-21swapper/221:19:482
1194699140,14cyclictest0-21swapper/220:40:122
1194699140,14cyclictest0-21swapper/219:54:392
1194699140,14cyclictest0-21swapper/219:30:122
1194699140,14cyclictest0-21swapper/219:11:492
1194699140,14cyclictest0-21swapper/200:33:482
1194699140,14cyclictest0-21swapper/200:25:172
1194699140,14cyclictest0-21swapper/200:20:332
1194699140,0cyclictest0-21swapper/223:46:212
1194699140,0cyclictest0-21swapper/223:15:272
1194699140,0cyclictest0-21swapper/223:05:092
1194699140,0cyclictest0-21swapper/222:07:592
1194699140,0cyclictest0-21swapper/221:33:522
1194699140,0cyclictest0-21swapper/220:46:222
1194699140,0cyclictest0-21swapper/220:23:072
1194699140,0cyclictest0-21swapper/220:01:322
11943991414,0cyclictest0-21swapper/121:45:041
11943991414,0cyclictest0-21swapper/121:10:171
11943991414,0cyclictest0-21swapper/121:06:281
11943991414,0cyclictest0-21swapper/120:30:261
11943991414,0cyclictest0-21swapper/100:30:481
1194399140,14cyclictest0-21swapper/123:50:061
1194399140,14cyclictest0-21swapper/123:30:081
1194399140,14cyclictest0-21swapper/123:20:321
1194399140,14cyclictest0-21swapper/123:20:311
1194399140,14cyclictest0-21swapper/122:26:291
1194399140,14cyclictest0-21swapper/121:30:171
1194399140,14cyclictest0-21swapper/120:50:041
1194399140,14cyclictest0-21swapper/120:40:591
1194399140,14cyclictest0-21swapper/120:00:331
1194399140,14cyclictest0-21swapper/119:25:331
1194399140,14cyclictest0-21swapper/119:21:111
1194399140,14cyclictest0-21swapper/100:00:591
1194399140,0cyclictest0-21swapper/123:35:021
1194399140,0cyclictest0-21swapper/123:14:121
1194399140,0cyclictest0-21swapper/122:46:461
1194399140,0cyclictest0-21swapper/122:20:281
1194399140,0cyclictest0-21swapper/122:15:061
1194399140,0cyclictest0-21swapper/122:00:121
1194399140,0cyclictest0-21swapper/121:52:151
1194399140,0cyclictest0-21swapper/120:15:211
1194399140,0cyclictest0-21swapper/119:36:491
1194399140,0cyclictest0-21swapper/119:30:151
1194399140,0cyclictest0-21swapper/100:35:211
1194399140,0cyclictest0-21swapper/100:20:181
1194399140,0cyclictest0-21swapper/100:15:481
11941991414,0cyclictest0-21swapper/021:46:020
1194199140,14cyclictest0-21swapper/023:41:190
1194199140,14cyclictest0-21swapper/022:50:330
1194199140,14cyclictest0-21swapper/022:40:540
1194199140,14cyclictest0-21swapper/022:35:250
1194199140,14cyclictest0-21swapper/022:08:010
1194199140,14cyclictest0-21swapper/021:55:290
1194199140,14cyclictest0-21swapper/021:16:170
1194199140,14cyclictest0-21swapper/021:05:310
1194199140,14cyclictest0-21swapper/021:00:190
1194199140,14cyclictest0-21swapper/020:45:400
1194199140,14cyclictest0-21swapper/020:35:370
1194199140,14cyclictest0-21swapper/020:20:140
1194199140,14cyclictest0-21swapper/019:31:240
1194199140,14cyclictest0-21swapper/000:25:160
1194199140,0cyclictest0-21swapper/021:20:360
1194199140,0cyclictest0-21swapper/020:56:020
1194199140,0cyclictest0-21swapper/020:07:130
1194199140,0cyclictest0-21swapper/019:47:450
1194199140,0cyclictest0-21swapper/019:41:440
1194199140,0cyclictest0-21swapper/019:18:220
1194199140,0cyclictest0-21swapper/000:12:150
11951991313,0cyclictest0-21swapper/320:30:253
1194699130,0cyclictest0-21swapper/223:56:402
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional