You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 11:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5.osadl.org (updated Mon Nov 24, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2387499310,30cyclictest3700-21sendmail-msp23:00:023
2387399310,30cyclictest3942-21cron20:45:002
2387499300,29cyclictest16024-21cron00:35:013
23872993028,1cyclictest609-21dbus-daemon22:40:011
23874992927,1cyclictest5713-21sendmail-msp19:40:013
2387499290,28cyclictest0-21swapper/320:00:143
2387499290,1cyclictest32409-21apt-get00:00:133
23873992927,1cyclictest29720-21perf23:55:022
2387399290,1cyclictest0-21swapper/219:55:012
2387299290,28cyclictest22986-21apt-get21:25:151
2387299290,28cyclictest0-21swapper/123:05:121
2387299290,1cyclictest31730-21munin-run20:35:001
23871992927,1cyclictest15591-21sh21:10:000
2387199290,28cyclictest29986-21apt-get21:40:110
2387199290,28cyclictest24129-21apt-get19:10:140
2387499280,28cyclictest0-21swapper/319:40:143
2387499280,0cyclictest17961-21apt-get23:30:133
2387499280,0cyclictest0-21swapper/319:45:143
23873992828,0cyclictest0-21swapper/221:30:112
23873992828,0cyclictest0-21swapper/200:10:162
23873992827,1cyclictest0-21swapper/223:45:132
2387399280,0cyclictest0-21swapper/219:25:142
23872992827,0cyclictest4682-21apt-get00:10:161
2387299280,28cyclictest0-21swapper/121:40:111
2387299280,28cyclictest0-21swapper/120:45:111
2387299280,28cyclictest0-21swapper/100:00:121
23871992828,0cyclictest0-21swapper/020:55:110
23871992827,1cyclictest2097-21munin-run00:05:000
2387199280,0cyclictest0-21swapper/020:25:130
2387199280,0cyclictest0-21swapper/000:25:140
23874992727,0cyclictest20610-21apt-get21:20:123
23874992727,0cyclictest0-21swapper/321:05:143
23874992727,0cyclictest0-21swapper/319:10:153
23874992726,1cyclictest8645-21chrt23:10:133
2387499270,27cyclictest0-21swapper/319:25:013
2387499270,0cyclictest0-21swapper/319:55:133
23873992727,0cyclictest31738-21apt-get22:50:132
23873992727,0cyclictest0-21swapper/223:10:132
23873992727,0cyclictest0-21swapper/222:25:152
23873992727,0cyclictest0-21swapper/220:15:142
23873992725,1cyclictest609-21dbus-daemon22:00:012
2387399270,27cyclictest0-21swapper/222:00:142
2387399270,0cyclictest0-21swapper/222:10:132
23872992727,0cyclictest0-21swapper/123:35:121
23872992727,0cyclictest0-21swapper/123:10:131
23872992727,0cyclictest0-21swapper/119:50:131
2387299270,0cyclictest0-21swapper/100:25:141
23871992727,0cyclictest32311-21apt-get21:45:110
23871992727,0cyclictest0-21swapper/023:40:130
23871992727,0cyclictest0-21swapper/023:20:170
23871992727,0cyclictest0-21swapper/020:15:150
23871992724,3cyclictest0-21swapper/022:15:130
2387199270,27cyclictest0-21swapper/022:25:150
23874992625,1cyclictest0-21swapper/321:15:013
23873992626,0cyclictest25043-21perf21:30:002
23873992626,0cyclictest24129-21apt-get19:10:142
23873992626,0cyclictest0-21swapper/222:05:102
23873992626,0cyclictest0-21swapper/219:55:152
23873992624,1cyclictest8630-21munin-run20:55:012
23873992624,1cyclictest29364-21cron20:30:002
23872992626,0cyclictest11408-21perf00:25:011
23872992626,0cyclictest0-21swapper/122:00:131
23872992626,0cyclictest0-21swapper/121:55:001
23872992625,1cyclictest17649-21apt-get20:05:131
23871992626,0cyclictest0-21swapper/022:10:010
23871992626,0cyclictest0-21swapper/022:00:130
23871992626,0cyclictest0-21swapper/020:45:110
23871992625,1cyclictest63250irq/126-eno121:20:000
23871992625,0cyclictest20339-21apt-get23:35:110
23871992624,1cyclictest1643-21perf20:40:000
23874992525,0cyclictest0-21swapper/300:15:173
23874992524,1cyclictest609-21dbus-daemon21:45:003
23874992523,1cyclictest27093-21http23:50:013
23874992523,1cyclictest0-21swapper/320:25:013
23873992525,0cyclictest0-21swapper/222:30:122
23873992525,0cyclictest0-21swapper/220:30:112
23873992523,1cyclictest0-21swapper/223:25:132
23872992525,0cyclictest0-21swapper/123:45:011
23872992525,0cyclictest0-21swapper/122:55:131
23872992525,0cyclictest0-21swapper/121:05:131
23872992525,0cyclictest0-21swapper/120:15:141
23872992523,1cyclictest0-21swapper/122:55:011
23871992525,0cyclictest0-21swapper/021:25:130
23871992525,0cyclictest0-21swapper/020:35:000
23874992424,0cyclictest0-21swapper/320:05:143
23874992424,0cyclictest0-21swapper/319:30:133
23874992422,1cyclictest4545-21apt-get21:55:133
23874992421,2cyclictest22058-21cron20:15:013
23873992424,0cyclictest0-21swapper/221:05:132
23873992424,0cyclictest0-21swapper/219:20:132
23872992422,1cyclictest0-21swapper/122:05:101
23871992424,0cyclictest1330-21apt-get19:30:140
23871992424,0cyclictest0-21swapper/023:05:120
23871992423,1cyclictest26492-21sendmail-msp22:40:000
23874992323,0cyclictest22353-21apt-get20:15:143
23874992323,0cyclictest19782-21apt-get22:25:143
23874992323,0cyclictest0-21swapper/321:25:133
23873992323,0cyclictest4239-21apt-get20:45:112
23873992323,0cyclictest0-21swapper/219:30:132
23873992323,0cyclictest0-21swapper/200:05:152
23872992323,0cyclictest0-21swapper/121:30:121
23871992323,0cyclictest0-21swapper/023:50:130
23871992323,0cyclictest0-21swapper/022:05:100
23874992222,0cyclictest6316-21apt-get23:05:133
23874992222,0cyclictest29658-21apt-get20:30:103
23874992222,0cyclictest0-21swapper/300:25:143
23873992222,0cyclictest0-21swapper/222:20:132
23873992222,0cyclictest0-21swapper/221:50:132
23873992220,1cyclictest609-21dbus-daemon00:00:012
23872992222,0cyclictest0-21swapper/123:45:121
23872992222,0cyclictest0-21swapper/122:50:001
23872992220,1cyclictest8077-21munin-run19:45:021
23871992222,0cyclictest0-21swapper/023:10:130
23871992222,0cyclictest0-21swapper/000:10:160
23871992221,1cyclictest4279-21perf21:55:000
23871992220,1cyclictest11415-21munin-run00:25:010
23874992121,0cyclictest0-21swapper/321:00:143
23872992121,0cyclictest0-21swapper/122:15:121
23872992121,0cyclictest0-21swapper/119:20:131
23872992120,1cyclictest3983-21munin-run20:45:011
23871992121,0cyclictest0-21swapper/019:50:130
23874992020,0cyclictest13315-21apt-get23:20:163
23874992020,0cyclictest0-21swapper/323:40:133
23874992020,0cyclictest0-21swapper/319:20:133
23873992018,1cyclictest26744-21cron20:25:002
23873992018,1cyclictest0-21swapper/200:35:132
23872992018,1cyclictest29674-21cron21:40:021
23871992020,0cyclictest0-21swapper/022:55:130
23871992020,0cyclictest0-21swapper/020:05:130
23874991918,1cyclictest611-21avahi-daemon21:35:003
23874991918,1cyclictest0-21swapper/322:10:013
23873991919,0cyclictest0-21swapper/222:40:122
23872991919,0cyclictest0-21swapper/122:40:111
23872991919,0cyclictest0-21swapper/121:45:121
23872991919,0cyclictest0-21swapper/119:10:141
23872991918,1cyclictest31426-21apt-get19:25:141
23872991917,1cyclictest609-21dbus-daemon23:20:001
23871991917,1cyclictest31482-21munin-run22:50:000
23871991917,1cyclictest0-21swapper/022:55:010
23874991818,0cyclictest0-21swapper/320:45:123
23872991818,0cyclictest0-21swapper/123:50:021
23872991818,0cyclictest0-21swapper/123:05:011
23872991818,0cyclictest0-21swapper/119:30:131
23871991817,1cyclictest25315-21apt-get21:30:110
23874991717,0cyclictest0-21swapper/323:35:113
23873991715,1cyclictest9058-21cron00:20:012
23872991717,0cyclictest0-21swapper/122:25:141
2387499160,16cyclictest0-21swapper/322:50:153
23873991616,0cyclictest0-21swapper/221:45:132
23873991616,0cyclictest0-21swapper/200:20:122
2387399160,1cyclictest28-21ksoftirqd/223:09:022
23872991616,0cyclictest22089-21perf20:15:001
23872991616,0cyclictest0-21swapper/120:20:141
23872991614,1cyclictest0-21swapper/123:25:161
23872991614,1cyclictest0-21swapper/122:13:491
2387299160,15cyclictest18361-21cron00:40:011
2387299160,15cyclictest16400-21grep21:10:141
2387299160,15cyclictest0-21swapper/123:30:151
23871991616,0cyclictest28799-21apt-get19:20:130
23871991616,0cyclictest0-21swapper/023:45:120
23871991614,1cyclictest5686-21cron19:40:010
2387199160,15cyclictest0-21swapper/022:00:000
2387199160,15cyclictest0-21swapper/019:30:000
23874991513,2cyclictest5206-21perl00:10:193
23874991513,1cyclictest11455-21users22:05:203
2387499150,14cyclictest28133-21ntp_states22:40:173
2387499150,14cyclictest0-21swapper/321:50:143
2387499150,14cyclictest0-21swapper/319:15:143
23873991515,0cyclictest0-21swapper/220:00:132
23873991513,1cyclictest0-21swapper/223:20:212
2387299150,14cyclictest19685-21timerandwakeup21:15:191
2387299150,14cyclictest0-21swapper/120:35:161
23871991515,0cyclictest3979-21perf20:45:000
23874991414,0cyclictest0-21swapper/320:55:233
2387499140,14cyclictest0-21swapper/323:50:143
2387499140,14cyclictest0-21swapper/323:25:543
2387499140,14cyclictest0-21swapper/323:16:433
2387499140,14cyclictest0-21swapper/323:00:503
2387499140,14cyclictest0-21swapper/322:49:043
2387499140,14cyclictest0-21swapper/322:37:043
2387499140,14cyclictest0-21swapper/322:31:323
2387499140,14cyclictest0-21swapper/322:20:133
2387499140,14cyclictest0-21swapper/322:16:313
2387499140,14cyclictest0-21swapper/322:00:073
2387499140,14cyclictest0-21swapper/321:45:283
2387499140,14cyclictest0-21swapper/321:37:223
2387499140,14cyclictest0-21swapper/321:17:413
2387499140,14cyclictest0-21swapper/320:20:433
2387499140,14cyclictest0-21swapper/319:50:593
2387499140,14cyclictest0-21swapper/300:20:273
2387499140,14cyclictest0-21swapper/300:06:233
2387499140,0cyclictest0-21swapper/323:55:013
2387499140,0cyclictest0-21swapper/320:41:233
2387499140,0cyclictest0-21swapper/300:35:103
23873991414,0cyclictest0-21swapper/221:20:122
23873991412,1cyclictest0-21swapper/221:35:152
2387399140,14cyclictest28-21ksoftirqd/222:45:022
2387399140,14cyclictest0-21swapper/223:41:162
2387399140,14cyclictest0-21swapper/223:37:292
2387399140,14cyclictest0-21swapper/223:32:472
2387399140,14cyclictest0-21swapper/222:59:062
2387399140,14cyclictest0-21swapper/222:18:142
2387399140,14cyclictest0-21swapper/221:42:222
2387399140,14cyclictest0-21swapper/221:15:422
2387399140,14cyclictest0-21swapper/221:10:002
2387399140,14cyclictest0-21swapper/221:00:012
2387399140,14cyclictest0-21swapper/220:55:132
2387399140,14cyclictest0-21swapper/220:37:362
2387399140,14cyclictest0-21swapper/220:10:162
2387399140,14cyclictest0-21swapper/220:07:282
2387399140,14cyclictest0-21swapper/219:47:002
2387399140,14cyclictest0-21swapper/219:40:092
2387399140,14cyclictest0-21swapper/219:38:122
2387399140,14cyclictest0-21swapper/219:15:192
2387399140,14cyclictest0-21swapper/200:31:152
2387399140,14cyclictest0-21swapper/200:25:112
2387399140,14cyclictest0-21swapper/200:00:142
2387399140,0cyclictest0-21swapper/223:15:592
2387399140,0cyclictest0-21swapper/222:36:192
23872991414,0cyclictest0-21swapper/121:01:481
23872991414,0cyclictest0-21swapper/120:25:391
23872991414,0cyclictest0-21swapper/119:46:211
23872991414,0cyclictest0-21swapper/100:15:371
23872991414,0cyclictest0-21swapper/100:06:141
2387299140,14cyclictest0-21swapper/123:20:551
2387299140,14cyclictest0-21swapper/122:30:071
2387299140,14cyclictest0-21swapper/122:20:111
2387299140,14cyclictest0-21swapper/121:55:261
2387299140,14cyclictest0-21swapper/121:20:421
2387299140,14cyclictest0-21swapper/120:51:121
2387299140,14cyclictest0-21swapper/119:57:331
2387299140,14cyclictest0-21swapper/119:35:141
2387299140,0cyclictest0-21swapper/123:55:181
2387299140,0cyclictest0-21swapper/120:56:141
2387299140,0cyclictest0-21swapper/120:03:091
2387299140,0cyclictest0-21swapper/119:15:061
2387299140,0cyclictest0-21swapper/100:30:581
23871991414,0cyclictest0-21swapper/022:30:300
23871991414,0cyclictest0-21swapper/021:20:150
23871991414,0cyclictest0-21swapper/019:56:090
23871991414,0cyclictest0-21swapper/019:15:240
23871991414,0cyclictest0-21swapper/000:35:280
2387199140,14cyclictest0-21swapper/023:57:230
2387199140,14cyclictest0-21swapper/023:30:360
2387199140,14cyclictest0-21swapper/023:25:120
2387199140,14cyclictest0-21swapper/023:15:420
2387199140,14cyclictest0-21swapper/023:04:000
2387199140,14cyclictest0-21swapper/022:40:020
2387199140,14cyclictest0-21swapper/021:35:100
2387199140,14cyclictest0-21swapper/021:11:360
2387199140,14cyclictest0-21swapper/020:50:580
2387199140,14cyclictest0-21swapper/020:20:580
2387199140,14cyclictest0-21swapper/020:01:560
2387199140,14cyclictest0-21swapper/019:46:400
2387199140,14cyclictest0-21swapper/000:31:040
2387199140,14cyclictest0-21swapper/000:05:040
2387199140,0cyclictest0-21swapper/022:22:550
2387199140,0cyclictest0-21swapper/021:01:270
2387199140,0cyclictest0-21swapper/020:10:380
2387199140,0cyclictest0-21swapper/019:40:460
2387199140,0cyclictest0-21swapper/000:15:230
23874991313,0cyclictest0-21swapper/320:50:393
23873991313,0cyclictest0-21swapper/223:00:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional