You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 10:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Fri Nov 21, 2025 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
356599310,29cyclictest303-21systemd-journal23:05:012
356599310,29cyclictest10939-40invoke-rc.d00:00:012
3559993128,2cyclictest1-21systemd00:00:010
356999300,29cyclictest17472-21cron19:40:013
356199300,29cyclictest19823-21idleruntime-cro19:45:011
356199300,1cyclictest303-21systemd-journal22:50:011
356999290,28cyclictest18492-21apt-get00:15:153
356599290,28cyclictest6117-21apt-get19:15:132
356599290,28cyclictest0-21swapper/220:05:012
3561992928,1cyclictest31172-21apt-get22:25:141
356199290,1cyclictest10502-21idleruntime-cro19:25:021
355999290,28cyclictest28850-21apt-get22:20:140
355999290,28cyclictest0-21swapper/000:25:010
355999290,1cyclictest0-21swapper/020:50:000
3569992827,1cyclictest11054-21cron20:35:003
356999280,27cyclictest0-21swapper/320:15:153
356999280,0cyclictest0-21swapper/320:45:143
3565992828,0cyclictest0-21swapper/223:15:122
3565992826,1cyclictest0-21swapper/219:35:012
356599280,27cyclictest19531-21apt-get22:00:122
356599280,0cyclictest29453-21apt-get23:30:122
356599280,0cyclictest0-21swapper/220:35:122
356599280,0cyclictest0-21swapper/219:25:132
3561992828,0cyclictest0-21swapper/100:35:141
3561992828,0cyclictest0-21swapper/100:00:131
356199280,28cyclictest1477-21perf23:40:011
356199280,28cyclictest0-21swapper/100:10:141
356199280,0cyclictest0-21swapper/121:25:121
356199280,0cyclictest0-21swapper/120:45:141
356199280,0cyclictest0-21swapper/119:50:121
3559992826,1cyclictest1759-21apt-get23:40:130
355999280,28cyclictest0-21swapper/019:35:140
355999280,27cyclictest0-21swapper/023:25:120
3569992727,0cyclictest25640-21apt-get21:05:123
3569992727,0cyclictest0-21swapper/323:45:123
3569992727,0cyclictest0-21swapper/323:30:123
3569992727,0cyclictest0-21swapper/322:50:133
3569992727,0cyclictest0-21swapper/322:05:123
3569992727,0cyclictest0-21swapper/320:20:143
3569992727,0cyclictest0-21swapper/319:55:133
3565992727,0cyclictest25788-21apt-get00:30:132
3565992727,0cyclictest0-21swapper/223:20:152
3565992727,0cyclictest0-21swapper/222:20:152
3565992726,0cyclictest0-21swapper/223:35:162
356599270,27cyclictest0-21swapper/221:45:132
356599270,0cyclictest0-21swapper/220:30:172
356599270,0cyclictest0-21swapper/220:10:162
356599270,0cyclictest0-21swapper/200:20:012
3561992727,0cyclictest14279-21apt-get21:50:011
3561992727,0cyclictest0-21swapper/121:20:141
3561992727,0cyclictest0-21swapper/120:50:131
3559992727,0cyclictest0-21swapper/020:15:150
3569992626,0cyclictest18056-21apt-get20:50:013
3569992625,1cyclictest12230-21apt-get21:45:133
3569992624,1cyclictest615-21rs:main3
3569992624,1cyclictest0-21swapper/300:00:013
3565992626,0cyclictest0-21swapper/222:35:132
3561992626,0cyclictest0-21swapper/123:50:131
3561992626,0cyclictest0-21swapper/123:25:121
3559992626,0cyclictest0-21swapper/000:05:120
3559992624,1cyclictest27664-21cron21:10:000
3569992525,0cyclictest0-21swapper/321:30:153
3569992523,1cyclictest611-21avahi-daemon20:10:013
3565992525,0cyclictest0-21swapper/222:50:132
3565992522,2cyclictest615-21rs:main2
3561992525,0cyclictest0-21swapper/123:05:151
3561992525,0cyclictest0-21swapper/122:40:131
3561992525,0cyclictest0-21swapper/121:35:131
3559992525,0cyclictest8137-21apt-get22:45:130
3559992525,0cyclictest31518-21perf23:35:010
3559992525,0cyclictest0-21swapper/021:50:130
3559992525,0cyclictest0-21swapper/021:45:130
3559992523,1cyclictest24157-21sendmail-msp23:20:000
3569992424,0cyclictest0-21swapper/323:10:123
3569992424,0cyclictest0-21swapper/319:25:133
3569992424,0cyclictest0-21swapper/300:10:143
3569992423,1cyclictest32057-21apt-get20:10:163
3569992423,1cyclictest29142-21cron20:05:013
3565992424,0cyclictest15441-21apt-get19:35:142
3561992422,1cyclictest26786-21cron20:00:001
3559992424,0cyclictest26500-21apt-get22:15:130
3559992424,0cyclictest11180-21apt-get00:00:130
3569992323,0cyclictest0-21swapper/322:00:123
3569992323,0cyclictest0-21swapper/320:35:123
3569992322,0cyclictest22104-21apt-get23:15:123
3565992323,0cyclictest16021-21apt-get20:45:142
3565992323,0cyclictest0-21swapper/219:45:122
3561992323,0cyclictest0-21swapper/121:00:121
3559992323,0cyclictest0-21swapper/021:10:120
3569992222,0cyclictest7562-21apt-get21:35:133
3569992222,0cyclictest0-21swapper/323:20:153
3569992222,0cyclictest0-21swapper/322:10:183
3569992222,0cyclictest0-21swapper/319:15:133
3569992220,1cyclictest15144-21cron19:35:013
3565992222,0cyclictest17188-21apt-get21:55:132
3565992222,0cyclictest0-21swapper/223:05:152
3559992222,0cyclictest0-21swapper/022:55:140
3559992221,1cyclictest21818-21sh23:15:000
3559992219,2cyclictest6416-21idleruntime-cro20:25:000
3569992120,0cyclictest0-21swapper/323:35:163
3565992121,0cyclictest28122-21apt-get00:35:142
3565992121,0cyclictest0-21swapper/223:45:122
3565992120,0cyclictest0-21swapper/222:10:182
3565992120,0cyclictest0-21swapper/200:10:152
3561992119,2cyclictest0-21swapper/120:00:141
3559992121,0cyclictest0-21swapper/021:40:120
3569992020,0cyclictest0-21swapper/322:35:133
3569992020,0cyclictest0-21swapper/322:20:153
3569992020,0cyclictest0-21swapper/300:30:133
3565992020,0cyclictest0-21swapper/219:55:132
3565992019,1cyclictest4972-21perf21:30:012
3565992019,1cyclictest271rcuc/223:45:012
3559992020,0cyclictest0-21swapper/023:00:120
3559992020,0cyclictest0-21swapper/020:25:130
3565991919,0cyclictest0-21swapper/220:50:012
3561991919,0cyclictest0-21swapper/120:05:131
3561991919,0cyclictest0-21swapper/119:25:131
3561991918,1cyclictest6148-21perf23:50:011
356199190,18cyclictest0-21swapper/100:15:151
3559991919,0cyclictest0-21swapper/022:35:130
3559991919,0cyclictest0-21swapper/022:00:120
3559991919,0cyclictest0-21swapper/020:40:150
3559991918,1cyclictest626-21gdbus00:15:010
3565991817,0cyclictest6421-21apt-get23:50:132
3561991818,0cyclictest22-21ksoftirqd/121:20:001
3561991818,0cyclictest0-21swapper/122:05:121
3561991818,0cyclictest0-21swapper/121:05:121
3559991818,0cyclictest0-21swapper/020:55:180
3559991818,0cyclictest0-21swapper/019:15:130
3559991816,1cyclictest23894-21cron22:10:010
356999174,12cyclictest607-21irqbalance22:43:163
3569991717,0cyclictest0-21swapper/319:45:123
3569991715,1cyclictest15736-21cron20:45:013
3565991717,0cyclictest0-21swapper/222:05:122
3565991717,0cyclictest0-21swapper/221:35:132
3565991717,0cyclictest0-21swapper/200:25:132
3565991715,1cyclictest29166-21sh23:30:012
3565991714,2cyclictest23028-21cron21:00:002
3561991717,0cyclictest0-21swapper/120:35:121
3559991717,0cyclictest0-21swapper/021:15:120
3559991710,7cyclictest11746-21munin-node22:43:570
3569991616,0cyclictest0-21swapper/323:05:153
3569991616,0cyclictest0-21swapper/321:55:133
3565991616,0cyclictest17783-21apt-get19:40:102
356599160,15cyclictest0-21swapper/220:15:192
3561991616,0cyclictest0-21swapper/119:45:121
3561991615,1cyclictest29990-21cron21:15:001
3561991615,1cyclictest0-21swapper/122:15:011
3559991616,0cyclictest0-21swapper/020:40:000
3559991615,1cyclictest5236-21apt-get21:30:150
3559991614,1cyclictest1726-21cron20:15:010
3559991614,1cyclictest0-21swapper/022:50:180
355999160,1cyclictest0-21swapper/000:20:010
3569991515,0cyclictest0-21swapper/300:35:143
3569991513,1cyclictest331rcuc/323:45:013
3569991513,1cyclictest31813-21hddtemp_smartct22:25:173
356999150,14cyclictest18835-21ntp_states19:40:153
356999150,14cyclictest11293-21grep21:40:203
356999150,14cyclictest0-21swapper/322:30:163
3565991515,0cyclictest0-21swapper/221:05:122
356599150,14cyclictest31693-21grep22:25:162
3561991513,1cyclictest96462sleep123:55:181
3561991513,1cyclictest0-21swapper/119:30:221
356199150,14cyclictest14979-21sed00:05:201
356199150,14cyclictest0-21swapper/121:55:211
3559991515,0cyclictest0-21swapper/023:20:150
3559991515,0cyclictest0-21swapper/000:30:130
3559991513,1cyclictest0-21swapper/020:50:070
355999150,1cyclictest29697-21/usr/sbin/munin20:05:190
355999150,1cyclictest0-21swapper/000:35:100
355999150,14cyclictest4310-21cstates23:45:120
3569991412,1cyclictest0-21swapper/323:50:133
356999140,14cyclictest0-21swapper/323:29:053
356999140,14cyclictest0-21swapper/322:47:463
356999140,14cyclictest0-21swapper/322:15:123
356999140,14cyclictest0-21swapper/321:28:323
356999140,14cyclictest0-21swapper/321:20:233
356999140,14cyclictest0-21swapper/321:11:083
356999140,14cyclictest0-21swapper/321:01:293
356999140,14cyclictest0-21swapper/320:55:203
356999140,14cyclictest0-21swapper/320:26:373
356999140,14cyclictest0-21swapper/300:25:473
356999140,14cyclictest0-21swapper/300:24:143
356999140,14cyclictest0-21swapper/300:02:243
356999140,0cyclictest0-21swapper/321:50:203
356999140,0cyclictest0-21swapper/321:19:003
356999140,0cyclictest0-21swapper/319:21:583
356999140,0cyclictest0-21swapper/319:11:303
3565991412,1cyclictest30811-21perl21:15:142
356599140,14cyclictest0-21swapper/222:59:362
356599140,14cyclictest0-21swapper/222:48:242
356599140,14cyclictest0-21swapper/222:42:012
356599140,14cyclictest0-21swapper/222:17:122
356599140,14cyclictest0-21swapper/221:51:282
356599140,14cyclictest0-21swapper/221:33:382
356599140,14cyclictest0-21swapper/221:22:472
356599140,14cyclictest0-21swapper/221:10:082
356599140,14cyclictest0-21swapper/220:26:482
356599140,14cyclictest0-21swapper/220:21:262
356599140,14cyclictest0-21swapper/220:06:262
356599140,14cyclictest0-21swapper/219:53:592
356599140,14cyclictest0-21swapper/219:20:122
356599140,14cyclictest0-21swapper/200:05:112
356599140,14cyclictest0-21swapper/200:01:322
356599140,0cyclictest0-21swapper/223:10:272
356599140,0cyclictest0-21swapper/222:32:332
356599140,0cyclictest0-21swapper/221:43:312
356599140,0cyclictest0-21swapper/219:11:292
356599140,0cyclictest0-21swapper/200:20:452
3561991414,0cyclictest0-21swapper/123:20:091
3561991414,0cyclictest0-21swapper/122:55:271
3561991414,0cyclictest0-21swapper/122:15:571
3561991414,0cyclictest0-21swapper/121:30:491
3561991414,0cyclictest0-21swapper/120:55:481
3561991414,0cyclictest0-21swapper/120:20:031
3561991414,0cyclictest0-21swapper/119:10:141
3561991414,0cyclictest0-21swapper/100:25:091
3561991412,1cyclictest0-21swapper/122:35:201
3561991412,1cyclictest0-21swapper/119:35:191
3561991411,2cyclictest15770-21tail23:00:141
356199140,14cyclictest0-21swapper/123:40:101
356199140,14cyclictest0-21swapper/123:30:031
356199140,14cyclictest0-21swapper/122:50:071
356199140,14cyclictest0-21swapper/122:30:221
356199140,14cyclictest0-21swapper/121:41:021
356199140,14cyclictest0-21swapper/120:40:171
356199140,14cyclictest0-21swapper/120:15:171
356199140,14cyclictest0-21swapper/120:10:351
356199140,14cyclictest0-21swapper/100:20:361
356199140,0cyclictest0-21swapper/123:15:141
356199140,0cyclictest0-21swapper/123:10:341
356199140,0cyclictest0-21swapper/122:20:281
356199140,0cyclictest0-21swapper/122:04:311
356199140,0cyclictest0-21swapper/121:47:231
356199140,0cyclictest0-21swapper/120:30:061
356199140,0cyclictest0-21swapper/120:25:191
356199140,0cyclictest0-21swapper/119:15:471
356199140,0cyclictest0-21swapper/100:30:241
3559991414,0cyclictest0-21swapper/023:50:080
3559991414,0cyclictest0-21swapper/023:36:140
3559991414,0cyclictest0-21swapper/021:55:050
3559991414,0cyclictest0-21swapper/020:00:140
3559991414,0cyclictest0-21swapper/000:26:130
3559991413,1cyclictest25928-21ps19:55:200
3559991412,1cyclictest0-21swapper/021:20:180
355999140,14cyclictest0-21swapper/023:06:120
355999140,14cyclictest0-21swapper/022:30:040
355999140,14cyclictest0-21swapper/021:37:150
355999140,14cyclictest0-21swapper/021:01:190
355999140,14cyclictest0-21swapper/020:30:010
355999140,0cyclictest0-21swapper/022:10:570
355999140,0cyclictest0-21swapper/021:25:190
355999140,0cyclictest0-21swapper/019:52:110
355999140,0cyclictest0-21swapper/019:46:360
355999140,0cyclictest0-21swapper/019:30:430
355999140,0cyclictest0-21swapper/019:20:450
355999140,0cyclictest0-21swapper/019:13:450
3569991313,0cyclictest0-21swapper/319:50:393
3569991313,0cyclictest0-21swapper/300:07:553
356999130,0cyclictest0-21swapper/322:55:203
356599130,13cyclictest0-21swapper/221:01:362
3559991313,0cyclictest0-21swapper/022:26:170
3559991313,0cyclictest0-21swapper/019:42:370
3559991313,0cyclictest0-21swapper/019:27:400
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional