You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-12 - 11:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Sat Jul 12, 2025 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1678599310,30cyclictest1310-21cron19:45:012
16789993027,2cyclictest611-21avahi-daemon00:25:003
1678599300,29cyclictest611-21avahi-daemon00:30:012
1678599300,29cyclictest29610-21cron20:45:002
16777993027,2cyclictest18745-21cron21:30:001
1677799300,29cyclictest17646-21munin-run20:20:011
1678999290,28cyclictest31650-21apt-get19:40:163
1678999290,28cyclictest28972-21apt-get23:00:023
1678999290,28cyclictest24062-21apt-get21:40:133
1678999290,28cyclictest0-21swapper/321:15:133
1678599290,28cyclictest23099-21cron23:55:012
1678599290,1cyclictest1-21systemd00:00:012
1677799290,28cyclictest0-21swapper/119:35:131
1677799290,28cyclictest0-21swapper/119:35:131
16775992927,2cyclictest2471-21sendmail-msp00:20:010
1677599290,28cyclictest8589-21apt-get20:00:140
1677599290,28cyclictest5602-21apt-get22:10:130
1677599290,28cyclictest22014-21munin-run22:45:010
1677599290,28cyclictest0-21swapper/019:40:170
16789992828,0cyclictest17552-21apt-get22:35:133
16789992827,1cyclictest22329-21perf20:29:593
16789992827,1cyclictest19039-21apt-get21:30:123
16789992826,1cyclictest12291-21cron22:25:003
1678999280,27cyclictest0-21swapper/322:40:153
1678999280,15cyclictest0-21swapper/322:51:323
1678999280,0cyclictest0-21swapper/322:30:133
1678999280,0cyclictest0-21swapper/319:15:023
16785992828,0cyclictest0-21swapper/200:00:142
1678599280,28cyclictest0-21swapper/219:45:162
1678599280,0cyclictest0-21swapper/219:55:162
16777992828,0cyclictest0-21swapper/100:15:141
1677799280,0cyclictest13228-21apt-get20:10:131
1677799280,0cyclictest0-21swapper/119:25:141
1677599280,0cyclictest0-21swapper/020:25:120
16789992725,1cyclictest609-21dbus-daemon20:00:013
1678999270,0cyclictest0-21swapper/323:40:113
1678999270,0cyclictest0-21swapper/300:30:143
16785992727,0cyclictest0-21swapper/223:20:122
16777992727,0cyclictest0-21swapper/119:10:121
16777992726,0cyclictest0-21swapper/121:45:121
16777992724,2cyclictest3637-21cron19:50:011
16775992727,0cyclictest0-21swapper/023:30:130
16775992727,0cyclictest0-21swapper/020:20:160
16775992727,0cyclictest0-21swapper/000:30:140
1677599270,27cyclictest0-21swapper/021:10:120
16789992626,0cyclictest26387-21apt-get21:45:123
16789992626,0cyclictest16999-21apt-get19:10:123
16785992626,0cyclictest0-21swapper/221:15:132
16785992626,0cyclictest0-21swapper/220:05:142
16785992626,0cyclictest0-21swapper/219:20:112
16785992626,0cyclictest0-21swapper/219:10:122
16777992626,0cyclictest0-21swapper/120:30:021
16777992626,0cyclictest0-21swapper/119:50:141
16775992626,0cyclictest2127-21apt-get20:55:120
16775992626,0cyclictest0-21swapper/022:00:140
16789992525,0cyclictest0-21swapper/320:40:143
16789992525,0cyclictest0-21swapper/320:00:143
16785992525,0cyclictest0-21swapper/222:45:132
16785992525,0cyclictest0-21swapper/222:35:132
16785992525,0cyclictest0-21swapper/200:15:142
16777992525,0cyclictest0-21swapper/121:55:161
16777992525,0cyclictest0-21swapper/121:15:141
16775992524,1cyclictest28187-21apt-get00:05:120
16775992522,2cyclictest6160-21sendmail-msp23:20:010
16789992424,0cyclictest0-21swapper/323:30:133
16789992424,0cyclictest0-21swapper/323:10:153
16785992424,0cyclictest24349-21apt-get19:25:142
16785992424,0cyclictest0-21swapper/220:10:132
16785992424,0cyclictest0-21swapper/219:15:142
16777992424,0cyclictest0-21swapper/123:20:001
16777992424,0cyclictest0-21swapper/100:25:141
16777992424,0cyclictest0-21swapper/100:00:131
16775992424,0cyclictest0-21swapper/022:30:120
16775992424,0cyclictest0-21swapper/021:30:110
16775992424,0cyclictest0-21swapper/019:20:110
16775992424,0cyclictest0-21swapper/019:15:010
16789992323,0cyclictest367-21apt-get00:15:143
16785992323,0cyclictest0-21swapper/220:20:002
16785992323,0cyclictest0-21swapper/219:35:132
16785992323,0cyclictest0-21swapper/219:35:132
16785992321,1cyclictest303-21systemd-journal21:30:002
16777992323,0cyclictest0-21swapper/123:25:121
16777992323,0cyclictest0-21swapper/123:10:151
16777992323,0cyclictest0-21swapper/121:40:121
16777992323,0cyclictest0-21swapper/119:15:141
16777992320,2cyclictest609-21dbus-daemon22:20:001
16775992323,0cyclictest32220-21apt-get20:50:130
16775992323,0cyclictest0-21swapper/021:05:120
16775992323,0cyclictest0-21swapper/000:35:120
16789992222,0cyclictest9719-21apt-get21:10:113
16789992222,0cyclictest22025-21apt-get19:20:113
16777992222,0cyclictest24592-21apt-get22:50:151
16777992222,0cyclictest0-21swapper/123:35:021
16775992222,0cyclictest0-21swapper/023:00:020
16775992222,0cyclictest0-21swapper/019:50:140
16789992121,0cyclictest9723-21apt-get00:35:133
16789992121,0cyclictest22906-21apt-get20:30:123
16789992121,0cyclictest0-21swapper/321:05:013
16789992121,0cyclictest0-21swapper/320:50:123
16789992121,0cyclictest0-21swapper/300:10:013
16777992121,0cyclictest0-21swapper/121:00:141
16777992121,0cyclictest0-21swapper/120:45:131
16777992119,1cyclictest27287-21cron20:40:011
16789992020,0cyclictest30772-21perf21:55:013
16789992020,0cyclictest0-21swapper/319:35:013
16785992018,1cyclictest6177-21perf23:20:012
16775992020,0cyclictest0-21swapper/023:50:140
16775992020,0cyclictest0-21swapper/021:40:000
16775992020,0cyclictest0-21swapper/020:30:110
16789991919,0cyclictest14390-21apt-get21:20:163
16789991919,0cyclictest0-21swapper/320:45:133
16789991919,0cyclictest0-21swapper/319:55:023
16785991919,0cyclictest0-21swapper/221:55:162
16785991919,0cyclictest0-21swapper/221:45:122
16785991919,0cyclictest0-21swapper/220:30:022
16785991919,0cyclictest0-21swapper/219:50:142
16777991919,0cyclictest20810-21perf23:50:011
16777991919,0cyclictest0-21swapper/122:45:131
16775991919,0cyclictest0-21swapper/021:00:010
16775991917,1cyclictest3853-21munin-run23:15:010
16789991818,0cyclictest0-21swapper/300:00:143
1678999180,18cyclictest0-21swapper/322:18:003
16785991817,0cyclictest1790-21apt-get23:10:152
16777991818,0cyclictest0-21swapper/122:25:121
16777991818,0cyclictest0-21swapper/122:10:131
16777991818,0cyclictest0-21swapper/120:40:141
16777991817,0cyclictest0-21swapper/100:20:121
16777991816,1cyclictest25640-21munin-run00:00:011
16775991818,0cyclictest0-21swapper/023:35:170
1678999170,17cyclictest0-21swapper/323:58:443
1678999170,17cyclictest0-21swapper/322:06:473
1678999170,17cyclictest0-21swapper/320:59:353
1678999170,17cyclictest0-21swapper/320:37:113
16785991717,0cyclictest0-21swapper/223:25:112
1678599170,11cyclictest0-21swapper/223:40:122
16777991717,0cyclictest0-21swapper/122:05:121
16777991717,0cyclictest0-21swapper/119:55:161
16775991717,0cyclictest0-21swapper/022:35:130
16775991717,0cyclictest0-21swapper/021:45:120
16789991616,0cyclictest0-21swapper/322:25:123
16789991614,1cyclictest5469-21switchtime23:15:213
1678999160,2cyclictest655-21latency_hist22:00:013
1678999160,16cyclictest0-21swapper/323:25:083
16785991616,0cyclictest0-21swapper/222:50:152
16785991616,0cyclictest0-21swapper/221:40:122
16785991615,0cyclictest0-21swapper/223:35:022
1678599160,2cyclictest22352-21basename20:30:002
16777991615,0cyclictest6454-21apt-get23:20:131
16777991614,1cyclictest4186-21apt-get21:00:001
16777991614,1cyclictest10722-21cut21:10:171
1677799160,15cyclictest16266-21ntp_states22:30:171
16775991616,0cyclictest0-21swapper/020:35:130
16775991614,1cyclictest4827-21munin-run00:25:010
16775991614,1cyclictest32662-21munin-run00:15:010
16775991614,1cyclictest30907-21munin-run21:55:010
16775991614,1cyclictest24326-21perf22:50:010
16775991614,1cyclictest0-21swapper/020:15:170
1677599160,15cyclictest25704-21/usr/sbin/munin21:40:220
1677599160,15cyclictest13084-21ntp_states21:15:190
1677599160,15cyclictest0-21swapper/021:55:220
16789991513,1cyclictest0-21swapper/320:05:163
1678999150,1cyclictest0-21swapper/320:15:213
1678999150,14cyclictest3665-21munin-run19:50:013
1678999150,14cyclictest19322-21sed23:45:143
16785991515,0cyclictest29901-21apt-get20:45:132
16785991514,1cyclictest0-21swapper/222:25:122
16785991513,1cyclictest13163-21munin-run23:35:002
1678599150,1cyclictest0-21swapper/221:00:152
1678599150,14cyclictest0-21swapper/220:35:182
16777991515,0cyclictest10909-21apt-get20:05:141
16777991514,1cyclictest22923-21kworker/1:221:21:591
16777991514,1cyclictest12876-21kworker/1:000:32:201
16777991513,1cyclictest30707-21tr00:10:141
1677799150,14cyclictest22661-21gltestperf19:20:121
1677799150,14cyclictest0-21swapper/123:50:191
16775991513,1cyclictest0-21swapper/022:25:180
1677599150,1cyclictest0-21swapper/023:45:190
1677599150,1cyclictest0-21swapper/019:30:200
16789991414,0cyclictest0-21swapper/322:45:173
1678999140,14cyclictest0-21swapper/323:07:323
1678999140,14cyclictest0-21swapper/322:56:113
1678999140,14cyclictest0-21swapper/322:11:593
1678999140,14cyclictest0-21swapper/322:00:423
1678999140,14cyclictest0-21swapper/321:28:443
1678999140,14cyclictest0-21swapper/319:39:413
1678999140,14cyclictest0-21swapper/319:39:403
1678999140,14cyclictest0-21swapper/319:27:093
1678999140,14cyclictest0-21swapper/300:25:543
1678999140,14cyclictest0-21swapper/300:12:403
1678999140,0cyclictest0-21swapper/323:35:113
1678999140,0cyclictest0-21swapper/320:14:283
16785991414,0cyclictest0-21swapper/223:47:402
16785991414,0cyclictest0-21swapper/200:05:122
1678599140,14cyclictest0-21swapper/222:56:492
1678599140,14cyclictest0-21swapper/222:41:062
1678599140,14cyclictest0-21swapper/222:20:302
1678599140,14cyclictest0-21swapper/222:15:432
1678599140,14cyclictest0-21swapper/222:10:162
1678599140,14cyclictest0-21swapper/222:02:162
1678599140,14cyclictest0-21swapper/221:52:422
1678599140,14cyclictest0-21swapper/221:36:012
1678599140,14cyclictest0-21swapper/219:31:352
1678599140,14cyclictest0-21swapper/200:36:352
1678599140,14cyclictest0-21swapper/200:30:492
1678599140,14cyclictest0-21swapper/200:11:142
1678599140,0cyclictest0-21swapper/223:05:232
1678599140,0cyclictest0-21swapper/223:01:192
1678599140,0cyclictest0-21swapper/222:05:322
1678599140,0cyclictest0-21swapper/221:13:122
1678599140,0cyclictest0-21swapper/220:21:052
16777991414,0cyclictest0-21swapper/123:33:201
16777991414,0cyclictest0-21swapper/123:00:431
16777991414,0cyclictest0-21swapper/100:35:401
16777991412,1cyclictest0-21swapper/119:40:231
1677799140,14cyclictest0-21swapper/123:43:101
1677799140,14cyclictest0-21swapper/122:55:071
1677799140,14cyclictest0-21swapper/122:43:071
1677799140,14cyclictest0-21swapper/122:20:431
1677799140,14cyclictest0-21swapper/122:00:271
1677799140,14cyclictest0-21swapper/121:38:581
1677799140,14cyclictest0-21swapper/121:31:261
1677799140,14cyclictest0-21swapper/121:05:121
1677799140,14cyclictest0-21swapper/120:51:111
1677799140,14cyclictest0-21swapper/120:23:391
1677799140,14cyclictest0-21swapper/120:01:221
1677799140,0cyclictest0-21swapper/123:05:201
1677799140,0cyclictest0-21swapper/122:35:361
1677799140,0cyclictest0-21swapper/121:52:051
1677799140,0cyclictest0-21swapper/119:30:451
1677799140,0cyclictest0-21swapper/100:05:151
16775991414,0cyclictest0-21swapper/023:25:070
16775991414,0cyclictest0-21swapper/020:40:130
16775991414,0cyclictest0-21swapper/019:26:490
1677599140,14cyclictest0-21swapper/023:40:530
1677599140,14cyclictest0-21swapper/022:55:510
1677599140,14cyclictest0-21swapper/022:53:480
1677599140,14cyclictest0-21swapper/022:20:380
1677599140,14cyclictest0-21swapper/022:16:470
1677599140,14cyclictest0-21swapper/022:05:320
1677599140,14cyclictest0-21swapper/021:25:210
1677599140,14cyclictest0-21swapper/021:20:430
1677599140,14cyclictest0-21swapper/020:49:520
1677599140,14cyclictest0-21swapper/020:08:430
1677599140,14cyclictest0-21swapper/019:35:520
1677599140,14cyclictest0-21swapper/019:35:520
1677599140,14cyclictest0-21swapper/000:25:020
1677599140,14cyclictest0-21swapper/000:01:490
1677599140,0cyclictest0-21swapper/023:59:170
1677599140,0cyclictest0-21swapper/023:20:060
1677599140,0cyclictest0-21swapper/020:10:040
1677599140,0cyclictest0-21swapper/019:58:030
1677599140,0cyclictest0-21swapper/019:47:580
1677599140,0cyclictest0-21swapper/019:11:580
16789991313,0cyclictest0-21swapper/323:50:183
16789991313,0cyclictest0-21swapper/323:21:413
16789991313,0cyclictest0-21swapper/321:01:573
16789991313,0cyclictest0-21swapper/320:20:563
16785991313,0cyclictest0-21swapper/222:34:042
16785991313,0cyclictest0-21swapper/220:55:512
16785991313,0cyclictest0-21swapper/220:52:172
16785991313,0cyclictest0-21swapper/220:00:332
1678599130,0cyclictest0-21swapper/221:30:282
1678599130,0cyclictest0-21swapper/221:22:472
1678599130,0cyclictest0-21swapper/221:05:532
16789991212,0cyclictest0-21swapper/321:35:463
16785991212,0cyclictest0-21swapper/200:22:222
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional