You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-15 - 12:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Tue Jul 15, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
332199310,30cyclictest20952-21awk22:05:012
3312993128,2cyclictest1108-21latency_hist23:40:000
332399300,29cyclictest12878-21cron19:30:013
332199300,2cyclictest10717-40mandb00:00:012
332199300,2cyclictest10717-40mandb00:00:012
3323992928,0cyclictest409-21apt-get22:30:133
332399290,28cyclictest20110-21cron00:20:003
332399290,28cyclictest0-21swapper/323:45:143
332399290,28cyclictest0-21swapper/320:00:153
3321992926,2cyclictest15474-21cron00:10:022
332199290,28cyclictest13723-21apt-get20:40:142
3317992927,1cyclictest0-21swapper/119:35:021
331799290,28cyclictest609-21dbus-daemon19:45:001
331799290,1cyclictest25068-21apt-get00:30:131
3323992828,0cyclictest4941-21apt-get21:30:153
3323992828,0cyclictest0-21swapper/322:10:133
3323992828,0cyclictest0-21swapper/320:35:163
332399280,0cyclictest0-21swapper/322:20:133
332399280,0cyclictest0-21swapper/320:55:123
332199280,28cyclictest0-21swapper/219:40:152
332199280,0cyclictest0-21swapper/223:30:122
332199280,0cyclictest0-21swapper/222:15:162
332199280,0cyclictest0-21swapper/221:40:102
332199280,0cyclictest0-21swapper/200:20:142
3317992828,0cyclictest10133-21apt-get22:50:131
3317992827,1cyclictest7264-21apt-get21:35:131
331799280,28cyclictest0-21swapper/122:40:131
331799280,27cyclictest0-21swapper/121:00:021
3312992828,0cyclictest0-21swapper/021:20:130
3312992828,0cyclictest0-21swapper/019:30:150
3312992828,0cyclictest0-21swapper/000:05:120
3312992827,1cyclictest10595-21munin-run19:25:020
331299280,28cyclictest31838-21perf20:10:020
331299280,28cyclictest0-21swapper/023:30:110
331299280,0cyclictest0-21swapper/021:45:130
331299280,0cyclictest0-21swapper/000:30:140
3323992727,0cyclictest0-21swapper/323:25:123
3323992727,0cyclictest0-21swapper/322:25:163
3323992726,1cyclictest0-21swapper/319:40:153
3321992727,0cyclictest0-21swapper/222:55:022
3321992727,0cyclictest0-21swapper/221:25:172
3321992727,0cyclictest0-21swapper/220:50:152
332199270,27cyclictest0-21swapper/220:05:122
332199270,27cyclictest0-21swapper/219:50:152
332199270,27cyclictest0-21swapper/200:35:142
332199270,0cyclictest0-21swapper/221:55:142
3317992727,0cyclictest0-21swapper/122:55:141
3317992727,0cyclictest0-21swapper/120:10:161
3312992727,0cyclictest0-21swapper/022:40:120
3312992727,0cyclictest0-21swapper/022:10:120
3312992727,0cyclictest0-21swapper/021:35:140
3312992727,0cyclictest0-21swapper/020:35:150
3312992727,0cyclictest0-21swapper/000:40:020
331299270,27cyclictest0-21swapper/020:45:150
3323992626,0cyclictest14252-21apt-get21:50:143
3323992626,0cyclictest0-21swapper/320:05:123
3321992626,0cyclictest6323-21apt-get23:50:132
3321992626,0cyclictest27984-21apt-get21:10:152
3321992626,0cyclictest0-21swapper/219:45:132
3317992626,0cyclictest0-21swapper/119:45:121
3317992626,0cyclictest0-21swapper/100:10:141
3312992626,0cyclictest0-21swapper/023:45:130
3312992626,0cyclictest0-21swapper/023:10:150
3312992626,0cyclictest0-21swapper/023:10:150
3312992626,0cyclictest0-21swapper/000:10:130
3323992525,0cyclictest0-21swapper/323:00:123
3323992525,0cyclictest0-21swapper/321:20:133
3323992523,1cyclictest9291-21cron21:40:003
3323992523,1cyclictest14848-21awk23:00:013
3321992525,0cyclictest26462-21perf23:25:022
3321992525,0cyclictest25656-21apt-get21:05:132
3321992525,0cyclictest0-21swapper/223:10:142
3321992525,0cyclictest0-21swapper/223:10:142
3321992525,0cyclictest0-21swapper/220:20:142
3317992525,0cyclictest0-21swapper/123:50:131
3317992525,0cyclictest0-21swapper/122:35:141
3317992525,0cyclictest0-21swapper/120:25:131
3312992525,0cyclictest0-21swapper/022:35:140
3312992525,0cyclictest0-21swapper/021:00:150
3312992525,0cyclictest0-21swapper/000:25:170
3312992525,0cyclictest0-21swapper/000:15:130
3323992424,0cyclictest22752-21apt-get00:25:183
3321992424,0cyclictest0-21swapper/220:35:152
3317992424,0cyclictest0-21swapper/122:05:131
3312992424,0cyclictest17426-21apt-get23:05:150
3312992424,0cyclictest0-21swapper/023:20:150
3312992424,0cyclictest0-21swapper/022:20:140
3312992422,1cyclictest15765-21basename20:45:000
3323992322,1cyclictest7811-21apt-get22:45:133
3321992323,0cyclictest0-21swapper/219:30:032
3321992322,1cyclictest2555-21cron22:35:002
3321992322,1cyclictest20690-21apt-get20:55:112
3321992321,1cyclictest27181-21munin-run20:00:012
3321992321,1cyclictest24099-21cron23:20:012
3317992323,0cyclictest0-21swapper/119:50:141
3312992323,0cyclictest0-21swapper/023:55:190
3312992323,0cyclictest0-21swapper/023:55:190
3312992323,0cyclictest0-21swapper/021:05:110
3323992222,0cyclictest0-21swapper/321:55:133
3323992222,0cyclictest0-21swapper/319:55:133
3323992222,0cyclictest0-21swapper/319:10:133
3321992222,0cyclictest26734-21apt-get23:25:132
3317992222,0cyclictest0-21swapper/123:15:151
3317992220,1cyclictest16318-21munin-run21:55:011
3312992222,0cyclictest0-21swapper/020:30:120
3312992222,0cyclictest0-21swapper/020:10:160
3312992220,1cyclictest0-21swapper/022:55:000
3323992121,0cyclictest0-21swapper/321:40:113
3323992121,0cyclictest0-21swapper/320:40:153
3321992121,0cyclictest3860-21apt-get19:10:122
3321992121,0cyclictest0-21swapper/219:25:132
3321992121,0cyclictest0-21swapper/219:20:142
3321992121,0cyclictest0-21swapper/219:15:152
3317992121,0cyclictest0-21swapper/119:35:141
3317992119,1cyclictest303-21systemd-journal21:20:001
3312992121,0cyclictest0-21swapper/022:05:130
3312992121,0cyclictest0-21swapper/022:00:000
3312992121,0cyclictest0-21swapper/021:50:140
3323992020,0cyclictest0-21swapper/322:15:173
3323992020,0cyclictest0-21swapper/300:20:143
3321992018,1cyclictest0-21swapper/220:15:012
3317992020,0cyclictest0-21swapper/120:50:151
3317992020,0cyclictest0-21swapper/119:20:151
3317992019,1cyclictest18919-21apt-get22:00:121
331299203,12cyclictest13-21ksoftirqd/023:40:010
3312992020,0cyclictest0-21swapper/021:20:000
3312992020,0cyclictest0-21swapper/020:55:130
3312992020,0cyclictest0-21swapper/020:00:160
3323991919,0cyclictest11077-21apt-get00:00:123
3323991917,1cyclictest0-21swapper/323:10:003
3317991919,0cyclictest0-21swapper/121:25:171
3323991818,0cyclictest19750-21apt-get23:10:143
3323991818,0cyclictest19750-21apt-get23:10:143
3323991818,0cyclictest0-21swapper/320:15:133
3321991818,0cyclictest0-21swapper/221:30:142
3317991815,2cyclictest21782-21sh23:15:011
3317991815,2cyclictest21782-21sh23:15:011
3323991714,2cyclictest17891-21sendmail19:40:003
332399170,17cyclictest0-21swapper/323:15:323
3321991717,0cyclictest0-21swapper/222:45:132
3321991715,1cyclictest609-21dbus-daemon20:30:002
3317991717,0cyclictest0-21swapper/123:05:141
3312991717,0cyclictest0-21swapper/023:15:140
3312991715,1cyclictest613-21in:imuxsock00:05:020
3323991616,0cyclictest0-21swapper/321:10:153
3323991614,1cyclictest6470-21munin-run20:24:593
332399160,2cyclictest303-21systemd-journal22:10:013
3317991616,0cyclictest10850-21apt-get19:25:141
3317991616,0cyclictest0-21swapper/121:55:141
3317991614,1cyclictest0-21swapper/122:30:131
3312991616,0cyclictest0-21swapper/022:15:170
3312991616,0cyclictest0-21swapper/019:10:130
3312991614,1cyclictest21509-21ntp_states19:45:180
331299160,15cyclictest8233-21df22:45:130
331299160,15cyclictest2475-21df_inode20:15:140
3323991515,0cyclictest0-21swapper/323:55:173
3323991515,0cyclictest0-21swapper/323:55:173
3323991513,1cyclictest11119-21perf20:35:003
332399150,1cyclictest0-21swapper/322:40:013
332399150,14cyclictest14038-21munin-run21:50:003
3321991515,0cyclictest0-21swapper/222:10:002
3321991514,1cyclictest15101-21apt-get23:00:112
3321991513,1cyclictest24793-21turbostat00:30:002
3317991515,0cyclictest0-21swapper/122:25:161
331799150,1cyclictest9674-21expr20:30:141
331799150,1cyclictest0-21swapper/123:55:211
331799150,1cyclictest0-21swapper/123:55:201
331799150,14cyclictest0-21swapper/123:30:201
3312991513,1cyclictest0-21swapper/023:00:120
331299150,14cyclictest0-21swapper/023:25:120
3323991414,0cyclictest0-21swapper/323:20:143
3323991414,0cyclictest0-21swapper/321:06:523
3323991414,0cyclictest0-21swapper/319:21:593
3323991412,1cyclictest14524-21ntp_states19:30:203
332399140,14cyclictest0-21swapper/323:50:223
332399140,14cyclictest0-21swapper/323:44:023
332399140,14cyclictest0-21swapper/323:30:163
332399140,14cyclictest0-21swapper/322:52:353
332399140,14cyclictest0-21swapper/322:40:183
332399140,14cyclictest0-21swapper/321:25:143
332399140,14cyclictest0-21swapper/321:15:053
332399140,14cyclictest0-21swapper/321:00:213
332399140,14cyclictest0-21swapper/320:46:453
332399140,14cyclictest0-21swapper/320:12:233
332399140,14cyclictest0-21swapper/319:52:033
332399140,14cyclictest0-21swapper/300:37:193
332399140,14cyclictest0-21swapper/300:32:173
332399140,0cyclictest0-21swapper/322:00:183
332399140,0cyclictest0-21swapper/320:52:183
332399140,0cyclictest0-21swapper/320:25:543
332399140,0cyclictest0-21swapper/300:10:593
3321991414,0cyclictest0-21swapper/200:12:492
3321991414,0cyclictest0-21swapper/200:00:122
332199140,14cyclictest0-21swapper/223:45:242
332199140,14cyclictest0-21swapper/223:42:402
332199140,14cyclictest0-21swapper/223:05:382
332199140,14cyclictest0-21swapper/222:54:582
332199140,14cyclictest0-21swapper/222:38:362
332199140,14cyclictest0-21swapper/222:24:182
332199140,14cyclictest0-21swapper/222:10:042
332199140,14cyclictest0-21swapper/221:50:392
332199140,14cyclictest0-21swapper/221:35:322
332199140,14cyclictest0-21swapper/221:21:422
332199140,14cyclictest0-21swapper/221:16:362
332199140,14cyclictest0-21swapper/221:04:212
332199140,14cyclictest0-21swapper/220:47:082
332199140,14cyclictest0-21swapper/220:30:332
332199140,14cyclictest0-21swapper/200:32:402
332199140,0cyclictest0-21swapper/223:35:092
332199140,0cyclictest0-21swapper/222:40:492
332199140,0cyclictest0-21swapper/222:27:452
332199140,0cyclictest0-21swapper/221:45:232
3317991414,0cyclictest0-21swapper/123:35:131
3317991414,0cyclictest0-21swapper/121:05:131
3317991414,0cyclictest0-21swapper/120:40:041
331799140,14cyclictest0-21swapper/123:27:081
331799140,14cyclictest0-21swapper/122:45:001
331799140,14cyclictest0-21swapper/122:20:591
331799140,14cyclictest0-21swapper/122:15:061
331799140,14cyclictest0-21swapper/121:20:321
331799140,14cyclictest0-21swapper/121:10:241
331799140,14cyclictest0-21swapper/120:45:101
331799140,14cyclictest0-21swapper/120:15:431
331799140,14cyclictest0-21swapper/120:05:181
331799140,14cyclictest0-21swapper/119:55:461
331799140,14cyclictest0-21swapper/100:17:451
331799140,14cyclictest0-21swapper/100:05:281
331799140,14cyclictest0-21swapper/100:01:591
331799140,0cyclictest0-21swapper/123:46:361
331799140,0cyclictest0-21swapper/123:43:161
331799140,0cyclictest0-21swapper/123:20:401
331799140,0cyclictest0-21swapper/123:00:271
331799140,0cyclictest0-21swapper/121:45:151
331799140,0cyclictest0-21swapper/121:42:311
331799140,0cyclictest0-21swapper/121:30:131
331799140,0cyclictest0-21swapper/120:55:121
331799140,0cyclictest0-21swapper/120:36:511
331799140,0cyclictest0-21swapper/120:20:201
331799140,0cyclictest0-21swapper/119:11:381
331799140,0cyclictest0-21swapper/100:37:371
331799140,0cyclictest0-21swapper/100:27:181
3312991414,0cyclictest0-21swapper/021:10:230
3312991414,0cyclictest0-21swapper/020:50:130
3312991414,0cyclictest0-21swapper/020:26:110
3312991414,0cyclictest0-21swapper/019:38:350
3312991414,0cyclictest0-21swapper/019:29:540
3312991414,0cyclictest0-21swapper/000:20:130
331299140,14cyclictest0-21swapper/022:34:220
331299140,14cyclictest0-21swapper/022:27:170
331299140,14cyclictest0-21swapper/022:02:000
331299140,14cyclictest0-21swapper/021:26:000
331299140,14cyclictest0-21swapper/019:51:190
331299140,0cyclictest0-21swapper/023:51:400
331299140,0cyclictest0-21swapper/022:55:080
331299140,0cyclictest0-21swapper/021:40:380
331299140,0cyclictest0-21swapper/020:20:260
331299140,0cyclictest0-21swapper/019:55:240
3323991313,0cyclictest0-21swapper/319:45:133
3323991313,0cyclictest0-21swapper/300:05:593
3321991313,0cyclictest0-21swapper/220:15:532
3321991313,0cyclictest0-21swapper/220:01:162
3321991313,0cyclictest0-21swapper/219:35:102
3321991313,0cyclictest0-21swapper/200:15:342
3317991313,0cyclictest0-21swapper/120:01:241
3317991313,0cyclictest0-21swapper/119:17:141
3317991313,0cyclictest0-21swapper/100:20:041
3312991313,0cyclictest0-21swapper/019:41:060
3312991313,0cyclictest0-21swapper/019:15:590
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional