You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-06 - 11:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Sun Jul 06, 2025 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2825099310,0cyclictest0-21swapper/323:45:133
28250993028,1cyclictest303-21systemd-journal21:25:003
2823999300,29cyclictest8320-21cron20:45:000
28250992928,1cyclictest10113-21sendmail-msp19:40:013
2825099290,28cyclictest28114-21munin-run23:45:013
28245992926,2cyclictest19709-21sh20:00:012
2824599290,28cyclictest10205-21apt-key19:40:012
2824599290,28cyclictest0-21swapper/220:25:162
2824599290,1cyclictest10710-21apt-get00:15:142
28242992927,1cyclictest8908-21awk21:55:001
28242992927,1cyclictest2981-21gpg-connect-age00:00:021
2824299290,28cyclictest0-21swapper/121:25:131
28239992927,1cyclictest22060-21awk20:05:010
28250992826,1cyclictest13574-21cron22:05:003
2825099280,28cyclictest0-21swapper/320:15:133
2825099280,0cyclictest9196-21apt-get21:55:143
2825099280,0cyclictest20554-21apt-get21:10:153
2825099280,0cyclictest0-21swapper/321:05:133
28245992826,1cyclictest2749-21munin-run00:00:012
2824599280,27cyclictest12064-21apt-get23:10:132
2824599280,0cyclictest0-21swapper/221:00:112
2824299280,28cyclictest0-21swapper/119:15:031
2824299280,1cyclictest24955-21perf21:20:001
2824299280,0cyclictest0-21swapper/123:25:131
2824299280,0cyclictest0-21swapper/122:55:131
2824299280,0cyclictest0-21swapper/121:05:121
2824299280,0cyclictest0-21swapper/120:10:151
28239992828,0cyclictest0-21swapper/023:20:130
28239992827,1cyclictest7821-21perf00:10:010
2823999280,28cyclictest0-21swapper/021:00:000
2823999280,27cyclictest0-21swapper/019:45:130
2823999280,0cyclictest0-21swapper/023:55:140
2823999280,0cyclictest0-21swapper/021:45:110
28250992727,0cyclictest30698-21apt-get23:50:143
28250992727,0cyclictest10935-21apt-get20:50:123
28250992727,0cyclictest0-21swapper/300:00:023
28250992726,1cyclictest5080-21apt-get22:55:123
2825099270,27cyclictest0-21swapper/300:35:153
2825099270,0cyclictest0-21swapper/321:25:133
28245992727,0cyclictest0-21swapper/223:40:172
28245992727,0cyclictest0-21swapper/221:45:122
28245992727,0cyclictest0-21swapper/220:40:002
28245992727,0cyclictest0-21swapper/219:25:142
28245992726,1cyclictest16487-21apt-get22:10:152
2824599270,27cyclictest31401-21perf20:25:002
2824599270,0cyclictest13032-21apt-get19:45:132
28242992727,0cyclictest0-21swapper/122:45:161
28242992727,0cyclictest0-21swapper/119:40:151
28239992727,0cyclictest13859-21apt-get22:05:130
28239992727,0cyclictest0-21swapper/019:15:120
28239992725,1cyclictest0-21swapper/021:10:000
28250992626,0cyclictest0-21swapper/321:35:133
28250992626,0cyclictest0-21swapper/319:55:133
28250992626,0cyclictest0-21swapper/300:20:143
28250992623,3cyclictest0-21swapper/320:20:123
28245992626,0cyclictest0-21swapper/219:20:132
28245992626,0cyclictest0-21swapper/219:15:132
28245992626,0cyclictest0-21swapper/200:05:122
28245992625,1cyclictest10714-21apt-get19:40:152
28242992626,0cyclictest15355-21apt-get19:50:131
28242992625,0cyclictest31664-21apt-get20:25:171
28239992626,0cyclictest0-21swapper/022:35:140
28239992626,0cyclictest0-21swapper/022:10:020
28239992626,0cyclictest0-21swapper/021:00:110
28239992626,0cyclictest0-21swapper/019:20:130
28250992525,0cyclictest21378-21apt-get23:30:153
28250992525,0cyclictest0-21swapper/323:00:153
28250992525,0cyclictest0-21swapper/300:30:143
28245992525,0cyclictest14385-21apt-get23:15:132
28245992525,0cyclictest0-21swapper/222:00:152
28242992525,0cyclictest0-21swapper/122:25:131
28242992525,0cyclictest0-21swapper/121:00:111
28242992524,1cyclictest7819-21apt-get00:10:021
28239992525,0cyclictest0-21swapper/022:40:150
28239992525,0cyclictest0-21swapper/019:40:150
28239992525,0cyclictest0-21swapper/019:35:130
28250992424,0cyclictest0-21swapper/322:15:013
28250992424,0cyclictest0-21swapper/319:50:133
28250992424,0cyclictest0-21swapper/300:10:023
28250992423,1cyclictest5746-21apt-get19:30:163
28245992424,0cyclictest28478-21apt-get19:10:102
28245992424,0cyclictest20024-21apt-get20:00:152
28245992424,0cyclictest15679-21apt-get00:25:122
28245992424,0cyclictest0-21swapper/221:40:132
28245992423,1cyclictest32193-21apt-get21:35:132
28250992323,0cyclictest0-21swapper/322:25:133
28245992323,0cyclictest28122-21apt-get22:35:142
28245992323,0cyclictest21154-21apt-get22:20:132
28242992323,0cyclictest0-21swapper/122:10:011
28242992323,0cyclictest0-21swapper/121:40:131
28242992323,0cyclictest0-21swapper/119:55:131
28242992323,0cyclictest0-21swapper/119:30:161
28242992322,1cyclictest12999-21apt-get20:55:021
28239992323,0cyclictest0-21swapper/021:30:130
28239992323,0cyclictest0-21swapper/020:35:120
28239992323,0cyclictest0-21swapper/000:00:170
28239992322,1cyclictest6872-21apt-get21:50:120
28239992322,1cyclictest613-21in:imuxsock23:55:010
28242992222,0cyclictest13594-21perf22:05:011
28242992222,0cyclictest0-21swapper/122:50:131
28242992222,0cyclictest0-21swapper/122:10:151
28242992222,0cyclictest0-21swapper/121:20:121
28242992220,1cyclictest626-21gdbus19:25:011
28239992222,0cyclictest332-21apt-get22:45:150
28239992222,0cyclictest0-21swapper/023:15:130
28239992222,0cyclictest0-21swapper/020:50:120
28239992222,0cyclictest0-21swapper/019:25:140
28250992121,0cyclictest0-21swapper/323:35:143
28250992121,0cyclictest0-21swapper/321:15:123
28250992121,0cyclictest0-21swapper/319:15:033
28245992121,0cyclictest0-21swapper/221:55:142
28245992121,0cyclictest0-21swapper/220:55:132
28242992121,0cyclictest0-21swapper/121:35:121
28242992121,0cyclictest0-21swapper/119:10:111
28242992120,1cyclictest20325-21apt-get00:35:151
28250992020,0cyclictest0-21swapper/323:10:133
28250992020,0cyclictest0-21swapper/323:05:133
28250992020,0cyclictest0-21swapper/320:55:133
28245992020,0cyclictest0-21swapper/200:30:132
28242992020,0cyclictest0-21swapper/123:50:141
28242992020,0cyclictest0-21swapper/120:20:121
28239992018,1cyclictest27822-21cron22:34:590
2825099192,14cyclictest0-21swapper/300:18:013
28250991919,0cyclictest2176-21apt-get21:40:133
28250991919,0cyclictest0-21swapper/323:30:013
28250991919,0cyclictest0-21swapper/322:45:153
28239991919,0cyclictest0-21swapper/023:45:140
28239991917,1cyclictest7167-21munin-run23:00:010
28250991818,0cyclictest0-21swapper/320:05:143
28245991818,0cyclictest0-21swapper/220:30:132
28242991818,0cyclictest0-21swapper/120:05:141
28239991818,0cyclictest0-21swapper/022:15:140
28239991818,0cyclictest0-21swapper/021:10:140
2825099170,14cyclictest0-21swapper/319:26:553
28245991715,1cyclictest0-21swapper/223:50:012
28239991717,0cyclictest15679-21apt-get00:25:130
2825099163,13cyclictest0-21swapper/323:22:043
2825099163,13cyclictest0-21swapper/321:52:283
2825099163,13cyclictest0-21swapper/321:30:033
2825099163,13cyclictest0-21swapper/320:34:073
2825099163,13cyclictest0-21swapper/319:49:203
2825099163,13cyclictest0-21swapper/300:06:493
28250991616,0cyclictest0-21swapper/320:10:153
28250991614,1cyclictest0-21swapper/320:44:593
28245991616,0cyclictest0-21swapper/221:30:122
28245991615,1cyclictest6998-21anacron19:30:232
28245991614,1cyclictest0-21swapper/222:30:002
2824599160,15cyclictest17852-21pmu-power23:20:192
2824299162,14cyclictest1708-21apache222:40:251
28242991616,0cyclictest0-21swapper/123:35:141
28242991616,0cyclictest0-21swapper/121:55:141
28242991616,0cyclictest0-21swapper/100:30:141
28242991614,1cyclictest0-21swapper/122:17:001
28242991614,1cyclictest0-21swapper/100:20:201
28239991614,1cyclictest0-21swapper/023:05:180
2823999160,15cyclictest9620-21diskstats21:55:150
2823999160,15cyclictest24192-21if_enp1s0.822:25:160
2823999160,15cyclictest22424-21ntp_states23:30:200
2825099152,13cyclictest0-21swapper/320:00:323
28250991513,1cyclictest0-21swapper/322:20:143
2825099151,14cyclictest0-21swapper/322:37:163
2825099150,14cyclictest0-21swapper/320:25:253
28245991515,0cyclictest0-21swapper/222:40:152
28245991513,2cyclictest24666-21apt-get20:10:152
28245991513,1cyclictest611-21avahi-daemon21:30:012
2824599150,14cyclictest0-21swapper/220:55:012
28242991515,0cyclictest0-21swapper/123:05:121
2824299150,1cyclictest0-21swapper/120:15:151
2824299150,15cyclictest0-21swapper/123:15:491
28239991514,1cyclictest29072-21perf20:20:010
28239991513,1cyclictest0-21swapper/023:00:140
28239991513,1cyclictest0-21swapper/000:39:280
2823999150,14cyclictest0-21swapper/023:35:190
28250991414,0cyclictest0-21swapper/319:40:153
2825099140,14cyclictest0-21swapper/323:18:063
2825099140,14cyclictest0-21swapper/322:43:253
2825099140,14cyclictest0-21swapper/322:06:003
2825099140,14cyclictest0-21swapper/321:45:103
2825099140,14cyclictest0-21swapper/321:03:133
2825099140,14cyclictest0-21swapper/320:35:283
2825099140,14cyclictest0-21swapper/319:20:193
2825099140,14cyclictest0-21swapper/319:13:373
2825099140,14cyclictest0-21swapper/300:25:533
2825099140,14cyclictest0-21swapper/300:03:433
2825099140,0cyclictest0-21swapper/322:50:193
2825099140,0cyclictest0-21swapper/322:15:183
28245991414,0cyclictest0-21swapper/222:45:142
28245991414,0cyclictest0-21swapper/222:05:382
28245991412,1cyclictest7876-21needreboot21:50:172
28245991412,1cyclictest609-21dbus-daemon23:35:012
2824599140,14cyclictest0-21swapper/223:36:342
2824599140,14cyclictest0-21swapper/223:27:182
2824599140,14cyclictest0-21swapper/223:00:482
2824599140,14cyclictest0-21swapper/222:30:402
2824599140,14cyclictest0-21swapper/222:17:562
2824599140,14cyclictest0-21swapper/221:11:102
2824599140,14cyclictest0-21swapper/221:05:352
2824599140,14cyclictest0-21swapper/220:15:072
2824599140,14cyclictest0-21swapper/219:51:272
2824599140,14cyclictest0-21swapper/200:36:042
2824599140,14cyclictest0-21swapper/200:10:142
2824599140,0cyclictest0-21swapper/223:51:322
2824599140,0cyclictest0-21swapper/223:06:132
2824599140,0cyclictest0-21swapper/222:50:172
2824599140,0cyclictest0-21swapper/221:15:042
2824599140,0cyclictest0-21swapper/220:45:292
2824599140,0cyclictest0-21swapper/200:20:182
2824599140,0cyclictest0-21swapper/200:00:282
28242991414,0cyclictest0-21swapper/123:45:131
28242991414,0cyclictest0-21swapper/123:10:131
28242991414,0cyclictest0-21swapper/122:30:061
28242991414,0cyclictest0-21swapper/121:10:021
28242991414,0cyclictest0-21swapper/120:00:101
28242991414,0cyclictest0-21swapper/119:45:101
28242991414,0cyclictest0-21swapper/100:17:301
2824299140,14cyclictest0-21swapper/123:40:091
2824299140,14cyclictest0-21swapper/123:31:061
2824299140,14cyclictest0-21swapper/123:00:031
2824299140,14cyclictest0-21swapper/122:35:371
2824299140,14cyclictest0-21swapper/121:30:071
2824299140,14cyclictest0-21swapper/120:51:331
2824299140,14cyclictest0-21swapper/120:47:451
2824299140,14cyclictest0-21swapper/120:35:041
2824299140,14cyclictest0-21swapper/120:30:491
2824299140,14cyclictest0-21swapper/119:25:181
2824299140,14cyclictest0-21swapper/100:05:051
2824299140,0cyclictest6263-21/usr/sbin/munin20:40:231
2824299140,0cyclictest0-21swapper/123:21:061
2824299140,0cyclictest0-21swapper/122:23:461
2824299140,0cyclictest0-21swapper/121:45:281
2824299140,0cyclictest0-21swapper/119:35:061
2824299140,0cyclictest0-21swapper/100:25:111
2824299140,0cyclictest0-21swapper/100:00:101
28239991414,0cyclictest0-21swapper/023:40:170
28239991414,0cyclictest0-21swapper/021:35:040
28239991414,0cyclictest0-21swapper/020:20:060
28239991414,0cyclictest0-21swapper/020:11:150
28239991414,0cyclictest0-21swapper/020:07:300
28239991414,0cyclictest0-21swapper/019:34:240
28239991413,1cyclictest0-21swapper/020:25:160
2823999140,14cyclictest0-21swapper/023:25:100
2823999140,14cyclictest0-21swapper/022:54:250
2823999140,14cyclictest0-21swapper/021:40:210
2823999140,14cyclictest0-21swapper/021:21:440
2823999140,14cyclictest0-21swapper/020:47:330
2823999140,14cyclictest0-21swapper/020:30:050
2823999140,14cyclictest0-21swapper/000:15:030
2823999140,0cyclictest0-21swapper/023:11:070
2823999140,0cyclictest0-21swapper/022:21:200
2823999140,0cyclictest0-21swapper/022:02:230
2823999140,0cyclictest0-21swapper/021:26:380
2823999140,0cyclictest0-21swapper/021:15:320
2823999140,0cyclictest0-21swapper/019:55:350
2823999140,0cyclictest0-21swapper/019:51:420
2823999140,0cyclictest0-21swapper/019:11:470
2823999140,0cyclictest0-21swapper/000:20:230
2823999140,0cyclictest0-21swapper/000:10:170
28250991313,0cyclictest0-21swapper/322:30:393
28245991313,0cyclictest0-21swapper/222:55:572
28245991313,0cyclictest0-21swapper/221:22:052
28245991313,0cyclictest0-21swapper/220:06:202
28239991311,1cyclictest0-21swapper/000:30:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional