You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 21:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Thu Nov 27, 2025 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2290399320,1cyclictest28228-21kworker/u8:212:25:102
2290399313,4cyclictest29870-21latency_hist07:25:012
2290399311,1cyclictest303-21systemd-journal11:15:002
2290399310,0cyclictest0-21swapper/211:40:122
2290299300,29cyclictest609-21dbus-daemon08:05:021
2290299300,29cyclictest10661-21cron11:20:011
2290199300,29cyclictest19708-21turbostat10:30:000
22907992925,4cyclictest0-21swapper/308:00:113
2290799290,28cyclictest2536-21apt-get12:10:143
2290799290,28cyclictest16533-21apt-get08:05:113
2290799290,1cyclictest14485-21apt-get12:35:113
2290399290,28cyclictest11866-21apt-get07:55:112
2290399290,28cyclictest0-21swapper/212:15:132
2290299290,28cyclictest0-21swapper/107:55:001
2290199290,28cyclictest31459-21load08:35:140
2290199290,28cyclictest2436-21apt-get07:35:110
2290199290,28cyclictest12163-21apt-get12:30:130
22907992828,0cyclictest0-21swapper/312:15:143
22907992827,1cyclictest19179-21perf09:20:003
2290799280,0cyclictest0-21swapper/307:30:123
22903992828,0cyclictest0-21swapper/207:30:122
2290399280,27cyclictest0-21swapper/212:10:142
22902992828,0cyclictest28186-21apt-get08:30:111
22902992827,0cyclictest20878-21apt-get11:40:121
2290299280,28cyclictest0-21swapper/107:55:111
2290299280,0cyclictest0-21swapper/108:40:101
22901992828,0cyclictest0-21swapper/008:05:120
2290199280,0cyclictest0-21swapper/010:10:140
22907992727,0cyclictest0-21swapper/311:40:133
22907992727,0cyclictest0-21swapper/310:35:123
22907992727,0cyclictest0-21swapper/308:55:123
22907992727,0cyclictest0-21swapper/308:10:113
22903992727,0cyclictest0-21swapper/212:35:122
22903992727,0cyclictest0-21swapper/208:05:112
2290399270,0cyclictest0-21swapper/210:15:132
22902992727,0cyclictest4460-21file07:39:491
22902992727,0cyclictest0-21swapper/110:45:141
22902992727,0cyclictest0-21swapper/108:05:121
22902992725,1cyclictest9247-21cron07:50:001
22902992725,1cyclictest1-21systemd10:10:001
22902992725,1cyclictest0-21swapper/111:35:001
22901992727,0cyclictest18531-21apt-get11:35:130
22901992726,1cyclictest3948-21apt-get11:05:120
2290199270,0cyclictest0-21swapper/011:50:120
22907992626,0cyclictest0-21swapper/312:25:113
22907992626,0cyclictest0-21swapper/308:30:123
22907992624,1cyclictest0-21swapper/310:50:013
22903992626,0cyclictest18531-21apt-get11:35:122
22902992626,0cyclictest0-21swapper/112:15:121
22902992626,0cyclictest0-21swapper/110:10:141
22902992626,0cyclictest0-21swapper/108:45:151
22902992626,0cyclictest0-21swapper/108:45:151
22901992626,0cyclictest3126-21apt-get08:45:150
22901992626,0cyclictest3126-21apt-get08:45:150
22901992624,1cyclictest11872-21cron12:30:010
22901992624,1cyclictest0-21swapper/008:55:010
22907992525,0cyclictest0-21swapper/310:15:133
22907992525,0cyclictest0-21swapper/308:20:113
22907992523,1cyclictest0-21swapper/307:35:123
22903992525,0cyclictest22320-21apt-get10:35:122
22903992525,0cyclictest0-21swapper/208:55:122
22903992525,0cyclictest0-21swapper/208:10:122
22903992524,1cyclictest19176-21munin-run09:19:592
22903992522,3cyclictest0-21swapper/208:00:102
22902992525,0cyclictest0-21swapper/112:00:111
22902992525,0cyclictest0-21swapper/110:15:141
22901992525,0cyclictest0-21swapper/009:00:100
22901992524,1cyclictest7774-21apt-get08:55:110
22907992421,2cyclictest15648-21basename11:30:013
22903992424,0cyclictest14226-21perf12:35:002
22903992424,0cyclictest0-21swapper/208:30:122
22901992422,1cyclictest0-21swapper/012:10:010
22907992323,0cyclictest0-21swapper/309:25:003
22907992323,0cyclictest0-21swapper/307:40:153
22903992323,0cyclictest0-21swapper/208:20:112
22902992323,0cyclictest0-21swapper/112:25:111
22902992323,0cyclictest0-21swapper/109:20:131
22902992323,0cyclictest0-21swapper/108:15:131
22901992321,1cyclictest3655-21cron11:05:010
22907992222,0cyclictest0-21swapper/307:55:123
22907992221,0cyclictest0-21swapper/309:55:123
22903992221,1cyclictest4896-21apt-get07:40:152
22903992221,1cyclictest29060-21perf10:50:012
22903992220,1cyclictest21507-21munin-run09:25:002
22903992219,2cyclictest15621-21perf11:30:012
22902992222,0cyclictest0-21swapper/111:05:121
22902992222,0cyclictest0-21swapper/107:30:131
22902992220,1cyclictest30858-21cron09:45:011
22901992222,0cyclictest0-21swapper/008:00:100
22901992219,2cyclictest609-21dbus-daemon09:09:590
22907992121,0cyclictest0-21swapper/308:40:123
22903992121,0cyclictest0-21swapper/207:35:122
22901992121,0cyclictest0-21swapper/012:00:100
22901992121,0cyclictest0-21swapper/008:15:120
22907992020,0cyclictest0-21swapper/310:25:103
22907992020,0cyclictest0-21swapper/309:30:133
22907992019,0cyclictest0-21swapper/310:50:123
22903992019,0cyclictest779-21apt-get08:40:112
22902992020,0cyclictest0-21swapper/112:10:131
22901992020,0cyclictest0-21swapper/007:45:110
22901992020,0cyclictest0-21swapper/007:40:130
22903991919,0cyclictest0-21swapper/209:55:122
22901991919,0cyclictest0-21swapper/012:35:120
22901991917,1cyclictest10660-21cron11:20:010
22907991818,0cyclictest0-21swapper/309:50:123
22903991818,0cyclictest0-21swapper/210:25:112
22903991818,0cyclictest0-21swapper/209:30:142
22902991818,0cyclictest0-21swapper/111:35:121
22902991816,1cyclictest0-21swapper/108:29:591
2290299180,8cyclictest0-21swapper/111:55:131
22901991818,0cyclictest32529-21apt-get07:30:110
22901991816,1cyclictest11584-21cron07:55:010
22907991717,0cyclictest31144-21apt-get09:45:123
22907991716,0cyclictest0-21swapper/311:50:113
2290299178,6cyclictest22-21ksoftirqd/111:00:201
22902991717,0cyclictest23535-21apt-get08:20:111
22902991717,0cyclictest18857-21apt-get08:10:121
22902991717,0cyclictest0-21swapper/110:50:111
22902991714,2cyclictest9249-21cron12:25:001
22901991717,0cyclictest0-21swapper/012:20:120
22907991616,0cyclictest0-21swapper/311:00:013
22907991616,0cyclictest0-21swapper/308:50:123
22907991616,0cyclictest0-21swapper/308:35:143
22907991614,1cyclictest0-21swapper/307:15:013
2290799160,2cyclictest12463-21cut10:15:003
22903991616,0cyclictest29319-21apt-get10:50:112
22903991616,0cyclictest0-21swapper/209:50:122
22903991614,1cyclictest12441-21munin-run10:15:002
22903991614,1cyclictest0-21swapper/211:05:152
22902991616,0cyclictest0-21swapper/112:35:121
22902991613,2cyclictest25258-21latency_hist07:15:001
22901991616,0cyclictest779-21apt-get08:40:110
22901991616,0cyclictest0-21swapper/007:55:120
22901991614,1cyclictest30258-21munin-run08:35:000
22901991614,1cyclictest23723-21grep08:20:110
22907991514,1cyclictest0-21swapper/310:43:123
22907991513,2cyclictest0-21swapper/311:15:093
22907991513,1cyclictest0-21swapper/312:00:093
2290799150,1cyclictest0-21swapper/307:50:213
2290799150,15cyclictest0-21swapper/311:34:543
2290799150,15cyclictest0-21swapper/311:20:303
2290799150,15cyclictest0-21swapper/310:32:083
2290799150,15cyclictest0-21swapper/307:15:583
2290799150,14cyclictest0-21swapper/311:09:393
2290799150,14cyclictest0-21swapper/310:06:423
22903991514,1cyclictest1303-21cron11:00:002
22903991513,1cyclictest8013-21irqstats12:20:152
2290399150,15cyclictest0-21swapper/211:51:082
2290399150,15cyclictest0-21swapper/209:44:372
2290399150,0cyclictest0-21swapper/209:11:252
2290399150,0cyclictest0-21swapper/208:46:012
2290399150,0cyclictest0-21swapper/208:46:002
22902991515,0cyclictest25581-21apt-get11:50:121
22902991515,0cyclictest19725-21perf10:30:011
22902991515,0cyclictest0-21swapper/108:55:121
22902991514,1cyclictest0-21swapper/109:37:221
2290299150,1cyclictest14635-21ntp_states11:25:231
2290299150,14cyclictest0-21swapper/107:15:231
22901991515,0cyclictest0-21swapper/010:45:150
22901991513,1cyclictest19248-21cstates08:10:130
2290199151,14cyclictest13-21ksoftirqd/009:44:070
2290199150,14cyclictest0-21swapper/010:35:190
2290199150,14cyclictest0-21swapper/009:45:110
2290199150,14cyclictest0-21swapper/009:35:010
22907991414,0cyclictest0-21swapper/308:25:113
22907991413,1cyclictest0-21swapper/311:35:083
22907991412,1cyclictest0-21swapper/307:25:143
2290799140,14cyclictest0-21swapper/312:20:163
2290799140,14cyclictest0-21swapper/312:05:123
2290799140,14cyclictest0-21swapper/311:10:233
2290799140,14cyclictest0-21swapper/311:00:103
2290799140,14cyclictest0-21swapper/310:01:093
2290799140,14cyclictest0-21swapper/309:41:223
2290799140,14cyclictest0-21swapper/309:38:033
2290799140,14cyclictest0-21swapper/308:45:433
2290799140,14cyclictest0-21swapper/308:45:433
2290799140,14cyclictest0-21swapper/308:15:033
2290799140,14cyclictest0-21swapper/307:49:133
2290799140,14cyclictest0-21swapper/307:20:283
2290799140,0cyclictest0-21swapper/311:55:013
2290799140,0cyclictest0-21swapper/311:47:133
2290799140,0cyclictest0-21swapper/310:20:363
2290799140,0cyclictest0-21swapper/309:25:363
2290799140,0cyclictest0-21swapper/309:11:103
22903991414,0cyclictest0-21swapper/211:30:492
22903991414,0cyclictest0-21swapper/209:45:122
22903991414,0cyclictest0-21swapper/208:50:132
22903991413,1cyclictest0-21swapper/210:22:382
22903991413,1cyclictest0-21swapper/208:35:202
2290399140,14cyclictest0-21swapper/212:05:572
2290399140,14cyclictest0-21swapper/212:00:152
2290399140,14cyclictest0-21swapper/211:55:442
2290399140,14cyclictest0-21swapper/211:20:362
2290399140,14cyclictest0-21swapper/211:16:272
2290399140,14cyclictest0-21swapper/211:02:112
2290399140,14cyclictest0-21swapper/210:40:092
2290399140,14cyclictest0-21swapper/210:31:562
2290399140,14cyclictest0-21swapper/210:00:102
2290399140,14cyclictest0-21swapper/209:36:202
2290399140,14cyclictest0-21swapper/209:29:502
2290399140,14cyclictest0-21swapper/209:01:052
2290399140,14cyclictest0-21swapper/208:15:422
2290399140,14cyclictest0-21swapper/207:45:362
2290399140,14cyclictest0-21swapper/207:25:122
2290399140,14cyclictest0-21swapper/207:13:442
2290399140,0cyclictest0-21swapper/210:09:012
2290399140,0cyclictest0-21swapper/209:06:152
2290399140,0cyclictest0-21swapper/207:50:042
2290399140,0cyclictest0-21swapper/207:17:412
22902991414,0cyclictest0-21swapper/112:05:311
22902991414,0cyclictest0-21swapper/111:20:501
22902991414,0cyclictest0-21swapper/109:55:141
22902991414,0cyclictest0-21swapper/109:00:311
22902991414,0cyclictest0-21swapper/108:54:221
22902991412,1cyclictest25319-21hddtemp_smartct10:40:141
2290299140,14cyclictest0-21swapper/112:30:231
2290299140,14cyclictest0-21swapper/110:55:531
2290299140,14cyclictest0-21swapper/110:30:591
2290299140,14cyclictest0-21swapper/110:20:321
2290299140,14cyclictest0-21swapper/109:51:131
2290299140,14cyclictest0-21swapper/109:30:441
2290299140,14cyclictest0-21swapper/109:27:141
2290299140,14cyclictest0-21swapper/109:06:521
2290299140,14cyclictest0-21swapper/108:35:111
2290299140,14cyclictest0-21swapper/107:40:581
2290299140,14cyclictest0-21swapper/107:20:501
2290299140,0cyclictest0-21swapper/111:45:201
2290299140,0cyclictest0-21swapper/111:11:291
2290299140,0cyclictest0-21swapper/110:35:481
2290299140,0cyclictest0-21swapper/110:00:021
2290299140,0cyclictest0-21swapper/109:45:201
2290299140,0cyclictest0-21swapper/109:12:211
2290299140,0cyclictest0-21swapper/107:26:121
2290199141,7cyclictest0-21swapper/009:10:120
22901991414,0cyclictest0-21swapper/011:40:330
22901991414,0cyclictest0-21swapper/011:25:360
22901991414,0cyclictest0-21swapper/010:40:350
22901991414,0cyclictest0-21swapper/010:31:320
22901991414,0cyclictest0-21swapper/009:35:300
22901991414,0cyclictest0-21swapper/009:20:170
22901991412,1cyclictest9058-21uname10:05:190
2290199140,14cyclictest0-21swapper/012:18:040
2290199140,14cyclictest0-21swapper/011:45:470
2290199140,14cyclictest0-21swapper/010:55:030
2290199140,14cyclictest0-21swapper/010:20:260
2290199140,14cyclictest0-21swapper/010:00:150
2290199140,14cyclictest0-21swapper/009:55:040
2290199140,14cyclictest0-21swapper/009:50:070
2290199140,14cyclictest0-21swapper/009:25:440
2290199140,14cyclictest0-21swapper/007:25:380
2290199140,14cyclictest0-21swapper/007:20:180
2290199140,14cyclictest0-21swapper/007:15:090
2290199140,0cyclictest12424-21apt-get10:15:020
2290199140,0cyclictest0-21swapper/012:10:080
2290199140,0cyclictest0-21swapper/011:55:180
2290199140,0cyclictest0-21swapper/011:30:250
2290199140,0cyclictest0-21swapper/011:20:400
2290199140,0cyclictest0-21swapper/011:10:240
2290199140,0cyclictest0-21swapper/010:50:530
2290199140,0cyclictest0-21swapper/009:15:150
2290199140,0cyclictest0-21swapper/008:27:090
2290199140,0cyclictest0-21swapper/007:12:560
22907991313,0cyclictest0-21swapper/309:00:193
2290799130,13cyclictest0-21swapper/309:07:363
22903991313,0cyclictest0-21swapper/211:45:572
2290399130,0cyclictest0-21swapper/208:27:292
22902991313,0cyclictest0-21swapper/109:19:491
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional