You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-16 - 08:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Tue Sep 16, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
324699300,29cyclictest11861-21apt-get22:55:132
324299300,29cyclictest626-21gdbus21:00:001
324199300,29cyclictest626-21gdbus23:05:010
324199300,29cyclictest626-21gdbus23:05:000
3248992927,1cyclictest9239-21cron22:50:013
324899290,28cyclictest22424-21munin-run20:59:593
324899290,28cyclictest0-21swapper/321:40:013
324899290,1cyclictest0-21swapper/322:25:013
3246992927,1cyclictest0-21swapper/220:50:012
324699290,28cyclictest2551-21munin-run23:45:012
324699290,28cyclictest24562-21apt-get00:30:142
3242992927,1cyclictest11048-21munin-run21:45:001
3241992927,1cyclictest609-21dbus-daemon00:30:000
324199290,28cyclictest19534-21perf19:45:010
324199290,1cyclictest14837-21awk19:35:010
324199290,1cyclictest0-21swapper/022:20:000
3248992826,1cyclictest626-21gdbus00:10:013
3248992826,1cyclictest27048-21cron21:09:593
3248992826,1cyclictest0-21swapper/320:20:003
324899280,27cyclictest0-21swapper/323:50:133
324899280,0cyclictest0-21swapper/323:25:133
324899280,0cyclictest0-21swapper/321:45:133
324699280,28cyclictest0-21swapper/200:10:152
324699280,27cyclictest0-21swapper/219:30:132
3242992827,1cyclictest12614-21apt-get00:05:141
3242992825,2cyclictest24738-21basename21:05:001
324299280,28cyclictest1133-21perf20:15:011
324299280,27cyclictest3751-21apt-get20:20:121
324299280,0cyclictest5799-21apt-get19:15:121
324299280,0cyclictest0-21swapper/122:15:131
3241992828,0cyclictest6076-21apt-get20:25:130
3241992828,0cyclictest0-21swapper/023:15:130
324199280,0cyclictest0-21swapper/020:15:140
3248992727,0cyclictest0-21swapper/319:25:143
3248992727,0cyclictest0-21swapper/300:25:123
324899270,27cyclictest0-21swapper/322:05:003
324899270,0cyclictest0-21swapper/322:55:133
324899270,0cyclictest0-21swapper/319:55:123
3246992727,0cyclictest18610-21apt-get22:00:162
3246992727,0cyclictest10731-21apt-get20:35:142
3246992727,0cyclictest10731-21apt-get20:35:142
3246992727,0cyclictest0-21swapper/223:55:122
3246992727,0cyclictest0-21swapper/223:25:142
3246992727,0cyclictest0-21swapper/221:20:122
3246992727,0cyclictest0-21swapper/220:00:132
3246992727,0cyclictest0-21swapper/200:20:142
3246992725,1cyclictest609-21dbus-daemon23:15:002
324699270,27cyclictest0-21swapper/223:45:122
3242992727,0cyclictest5142-21apt-get23:50:121
3242992727,0cyclictest0-21swapper/100:15:141
3242992725,1cyclictest30204-21cron23:35:011
324299270,27cyclictest0-21swapper/123:35:131
3241992727,0cyclictest25852-21apt-get23:25:140
3241992727,0cyclictest0-21swapper/022:35:150
3241992727,0cyclictest0-21swapper/022:10:120
324199270,27cyclictest0-21swapper/022:20:120
3248992626,0cyclictest0-21swapper/323:20:133
3248992626,0cyclictest0-21swapper/323:10:143
3248992626,0cyclictest0-21swapper/320:35:143
3248992626,0cyclictest0-21swapper/320:35:143
3248992626,0cyclictest0-21swapper/320:20:113
3248992626,0cyclictest0-21swapper/319:10:133
3248992625,1cyclictest30246-21apt-get22:25:133
3246992626,0cyclictest16982-21apt-get00:15:022
3246992626,0cyclictest0-21swapper/223:50:122
3246992626,0cyclictest0-21swapper/221:05:112
3246992626,0cyclictest0-21swapper/219:15:142
3246992625,0cyclictest0-21swapper/223:20:012
3242992626,0cyclictest0-21swapper/122:35:151
3242992626,0cyclictest0-21swapper/121:05:111
3242992626,0cyclictest0-21swapper/100:35:141
3242992625,1cyclictest2515-21cron23:45:001
3242992625,1cyclictest0-21swapper/100:20:141
3241992626,0cyclictest6952-21perf22:45:010
3241992626,0cyclictest13344-21apt-get21:50:010
3241992626,0cyclictest0-21swapper/023:10:150
3241992626,0cyclictest0-21swapper/020:50:160
3241992626,0cyclictest0-21swapper/019:35:130
3241992625,1cyclictest18586-21perf23:10:010
3248992525,0cyclictest0-21swapper/321:00:133
3246992525,0cyclictest0-21swapper/222:55:012
3246992525,0cyclictest0-21swapper/222:45:132
3246992525,0cyclictest0-21swapper/219:10:132
3242992525,0cyclictest32626-21apt-get22:30:131
3242992525,0cyclictest2809-21apt-get23:45:111
3241992525,0cyclictest0-21swapper/023:20:140
3241992525,0cyclictest0-21swapper/022:25:130
3246992424,0cyclictest27923-21apt-get22:20:122
3242992424,0cyclictest0-21swapper/120:35:141
3242992424,0cyclictest0-21swapper/120:35:141
3248992323,0cyclictest0-21swapper/320:35:003
3248992321,1cyclictest0-21swapper/323:00:143
3248992321,1cyclictest0-21swapper/323:00:143
3246992323,0cyclictest5823-21perf20:25:002
3246992323,0cyclictest17472-21apt-get19:40:142
3246992320,2cyclictest22389-21cron20:59:592
3242992323,0cyclictest0-21swapper/122:50:141
3242992321,1cyclictest15118-21basename20:45:001
3241992323,0cyclictest0-21swapper/021:45:130
3248992222,0cyclictest0-21swapper/323:55:033
3248992222,0cyclictest0-21swapper/322:10:143
3246992222,0cyclictest0-21swapper/222:34:592
324299226,11cyclictest22-21ksoftirqd/120:15:221
3242992222,0cyclictest12797-21apt-get19:30:131
3242992221,1cyclictest623-21polkitd22:25:001
324199222,20cyclictest29878-21kworker/0:223:43:580
3241992222,0cyclictest0-21swapper/022:05:110
3241992222,0cyclictest0-21swapper/021:55:160
3241992222,0cyclictest0-21swapper/020:40:110
3242992121,0cyclictest0-21swapper/100:00:131
3242992119,1cyclictest623-21polkitd00:00:011
3241992121,0cyclictest0-21swapper/021:10:130
3241992121,0cyclictest0-21swapper/020:30:100
3241992119,1cyclictest1720-21munin-run21:25:000
3248992020,0cyclictest0-21swapper/323:45:123
3248992019,1cyclictest28976-21perf00:40:023
3246992018,1cyclictest0-21swapper/220:15:002
3242992020,0cyclictest211rcuc/120:30:091
3242992020,0cyclictest0-21swapper/123:10:151
3248991919,0cyclictest0-21swapper/322:35:143
3248991919,0cyclictest0-21swapper/322:15:143
3248991917,1cyclictest0-21swapper/320:10:013
324699192,2cyclictest30308-21grep21:15:192
3246991919,0cyclictest25577-21apt-get22:15:142
3246991916,2cyclictest609-21dbus-daemon21:04:592
3242991919,0cyclictest0-21swapper/122:45:131
3242991919,0cyclictest0-21swapper/100:25:121
3241991919,0cyclictest0-21swapper/022:55:120
3241991919,0cyclictest0-21swapper/021:35:120
3241991919,0cyclictest0-21swapper/000:00:140
3241991917,1cyclictest28856-21munin-run20:05:020
3241991917,1cyclictest0-21swapper/000:10:010
3246991818,0cyclictest30502-21apt-get23:35:142
3246991816,1cyclictest30203-21cron23:35:012
3242991816,2cyclictest0-21swapper/120:45:131
3241991818,0cyclictest0-21swapper/021:30:130
3241991818,0cyclictest0-21swapper/021:25:120
3241991816,1cyclictest0-21swapper/019:55:010
3246991717,0cyclictest0-21swapper/200:05:132
3242991717,0cyclictest0-21swapper/122:00:161
3248991614,1cyclictest32640-21munin-run23:40:013
3246991616,0cyclictest2538-21apt-get22:35:142
3246991616,0cyclictest0-21swapper/221:45:002
3246991616,0cyclictest0-21swapper/200:35:152
324699160,15cyclictest8167-21latency_hist20:30:002
324699160,15cyclictest13531-21munin-run21:50:002
3242991616,0cyclictest0-21swapper/100:30:141
3242991614,1cyclictest15452-21tune2fs00:10:181
3242991614,1cyclictest11308-21apt-get21:45:121
324299160,15cyclictest25714-21cut23:25:011
3248991515,0cyclictest0-21swapper/323:15:123
3248991514,1cyclictest7853-21sendmail-msp19:20:023
3248991513,1cyclictest0-21swapper/320:55:013
3248991513,1cyclictest0-21swapper/320:00:193
324899150,1cyclictest0-21swapper/300:30:243
324899150,15cyclictest8468-21munin-node20:41:333
324899150,14cyclictest1105-21memory22:30:163
324899150,14cyclictest0-21swapper/323:05:193
3246991513,1cyclictest18105-21tail23:05:232
324699150,14cyclictest0-21swapper/219:50:542
3242991515,0cyclictest0-21swapper/121:20:121
3242991514,1cyclictest20933-21/usr/sbin/munin22:05:121
324299150,1cyclictest6716-21hddtemp_smartct20:25:151
324299150,14cyclictest4315-21apt-get21:30:131
3241991513,1cyclictest0-21swapper/019:25:150
3241991513,1cyclictest0-21swapper/000:15:230
324899140,14cyclictest0-21swapper/323:42:073
324899140,14cyclictest0-21swapper/323:30:463
324899140,14cyclictest0-21swapper/322:41:243
324899140,14cyclictest0-21swapper/321:51:593
324899140,14cyclictest0-21swapper/321:40:183
324899140,14cyclictest0-21swapper/321:26:133
324899140,14cyclictest0-21swapper/321:16:083
324899140,14cyclictest0-21swapper/320:49:553
324899140,14cyclictest0-21swapper/320:25:123
324899140,14cyclictest0-21swapper/319:41:053
324899140,14cyclictest0-21swapper/319:35:323
324899140,14cyclictest0-21swapper/300:20:073
324899140,14cyclictest0-21swapper/300:15:033
324899140,14cyclictest0-21swapper/300:01:303
324899140,0cyclictest0-21swapper/320:10:473
324899140,0cyclictest0-21swapper/319:50:133
324899140,0cyclictest0-21swapper/319:49:543
324899140,0cyclictest0-21swapper/319:30:373
3246991412,1cyclictest0-21swapper/221:25:182
324699140,14cyclictest0-21swapper/223:21:502
324699140,14cyclictest0-21swapper/222:26:462
324699140,14cyclictest0-21swapper/221:52:262
324699140,14cyclictest0-21swapper/221:38:452
324699140,14cyclictest0-21swapper/221:30:462
324699140,14cyclictest0-21swapper/220:52:482
324699140,14cyclictest0-21swapper/220:33:472
324699140,14cyclictest0-21swapper/220:05:012
324699140,14cyclictest0-21swapper/219:36:512
324699140,14cyclictest0-21swapper/219:26:492
324699140,14cyclictest0-21swapper/219:21:052
324699140,14cyclictest0-21swapper/200:25:562
324699140,14cyclictest0-21swapper/200:01:382
324699140,13cyclictest0-21swapper/221:55:082
324699140,0cyclictest0-21swapper/222:05:422
324699140,0cyclictest0-21swapper/221:14:242
324699140,0cyclictest0-21swapper/220:40:402
324699140,0cyclictest0-21swapper/220:17:272
3242991414,0cyclictest0-21swapper/123:25:011
3242991414,0cyclictest0-21swapper/122:11:421
3242991414,0cyclictest0-21swapper/121:50:031
3242991414,0cyclictest0-21swapper/121:13:111
3242991414,0cyclictest0-21swapper/120:04:091
3242991412,1cyclictest21953-21munin-run19:50:021
324299140,14cyclictest0-21swapper/123:05:011
324299140,14cyclictest0-21swapper/122:56:271
324299140,14cyclictest0-21swapper/122:25:461
324299140,14cyclictest0-21swapper/121:25:581
324299140,14cyclictest0-21swapper/121:15:191
324299140,14cyclictest0-21swapper/120:50:241
324299140,14cyclictest0-21swapper/119:40:191
324299140,14cyclictest0-21swapper/119:14:141
324299140,0cyclictest4891-21apt-get22:40:141
324299140,0cyclictest0-21swapper/123:15:071
324299140,0cyclictest0-21swapper/121:57:171
324299140,0cyclictest0-21swapper/121:38:321
324299140,0cyclictest0-21swapper/120:07:071
324299140,0cyclictest0-21swapper/119:55:081
324299140,0cyclictest0-21swapper/119:55:011
3241991414,0cyclictest0-21swapper/022:45:150
3241991414,0cyclictest0-21swapper/021:20:000
3241991414,0cyclictest0-21swapper/020:47:400
3241991414,0cyclictest0-21swapper/000:36:270
3241991412,1cyclictest10584-21ntp_states22:50:180
3241991412,1cyclictest0-21swapper/021:05:130
324199140,14cyclictest0-21swapper/023:55:310
324199140,14cyclictest0-21swapper/023:45:360
324199140,14cyclictest0-21swapper/023:35:260
324199140,14cyclictest0-21swapper/023:30:340
324199140,14cyclictest0-21swapper/020:55:200
324199140,14cyclictest0-21swapper/020:10:470
324199140,14cyclictest0-21swapper/020:06:580
324199140,14cyclictest0-21swapper/019:55:180
324199140,14cyclictest0-21swapper/019:20:440
324199140,14cyclictest0-21swapper/019:17:080
324199140,14cyclictest0-21swapper/000:20:300
324199140,0cyclictest0-21swapper/023:51:350
324199140,0cyclictest0-21swapper/022:32:160
324199140,0cyclictest0-21swapper/022:01:010
324199140,0cyclictest0-21swapper/021:40:140
324199140,0cyclictest0-21swapper/021:00:090
324199140,0cyclictest0-21swapper/020:36:130
324199140,0cyclictest0-21swapper/020:36:130
324199140,0cyclictest0-21swapper/020:20:190
324199140,0cyclictest0-21swapper/019:46:160
324199140,0cyclictest0-21swapper/019:12:230
324199140,0cyclictest0-21swapper/000:30:120
324199140,0cyclictest0-21swapper/000:10:290
3248991313,0cyclictest0-21swapper/322:50:103
3248991313,0cyclictest0-21swapper/321:56:463
3248991313,0cyclictest0-21swapper/321:20:443
3248991313,0cyclictest0-21swapper/321:10:123
3248991313,0cyclictest0-21swapper/319:20:023
3248991313,0cyclictest0-21swapper/300:11:013
324899130,0cyclictest0-21swapper/321:31:533
3246991313,0cyclictest0-21swapper/223:00:202
3246991313,0cyclictest0-21swapper/223:00:202
3246991313,0cyclictest0-21swapper/222:40:112
3246991313,0cyclictest0-21swapper/222:11:062
3246991313,0cyclictest0-21swapper/219:55:352
3246991313,0cyclictest0-21swapper/219:45:542
3242991313,0cyclictest0-21swapper/123:00:221
3242991313,0cyclictest0-21swapper/123:00:221
3242991313,0cyclictest0-21swapper/119:20:481
3242991212,0cyclictest0-21swapper/119:35:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional