You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 08:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Thu Nov 27, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26692993227,5cyclictest11848-21apt-get23:20:121
2668799320,31cyclictest0-21swapper/023:40:180
26687993125,5cyclictest13890-21cron23:25:010
2668799310,30cyclictest0-21swapper/020:55:170
2669299300,29cyclictest1598-21cron21:50:001
2669699290,28cyclictest24874-21munin-run20:15:012
2669699290,28cyclictest17690-21apt-get21:15:102
2669699290,1cyclictest5907-21cron19:35:002
2669299290,28cyclictest1900-21apt-get21:50:121
26687992927,1cyclictest303-21systemd-journal23:35:000
2668799290,28cyclictest12780-21munin-run21:05:000
26700992827,1cyclictest4797-21apt-get23:05:123
26700992827,1cyclictest4797-21apt-get23:05:113
26700992826,2cyclictest0-21swapper/323:45:123
26700992826,1cyclictest5235-21cron00:15:003
2670099280,27cyclictest9936-21perf00:25:003
2670099280,27cyclictest0-21swapper/321:35:103
2670099280,1cyclictest14847-21apt-get00:35:153
2670099280,0cyclictest0-21swapper/321:15:113
2670099280,0cyclictest0-21swapper/300:30:123
26696992828,0cyclictest30222-21apt-get22:50:132
26696992826,1cyclictest18570-21apt-get22:25:122
2669699280,0cyclictest0-21swapper/222:15:102
26692992828,0cyclictest6507-21apt-get19:35:141
26692992828,0cyclictest0-21swapper/123:45:111
26692992824,3cyclictest0-21swapper/121:35:011
2669299280,28cyclictest27322-21apt-get21:35:111
2669299280,28cyclictest11576-21apt-get22:10:121
2669299280,28cyclictest0-21swapper/121:05:111
2669299280,0cyclictest0-21swapper/123:25:151
26687992828,0cyclictest0-21swapper/022:10:120
26687992826,1cyclictest30237-21install00:00:020
26687992825,3cyclictest0-21swapper/020:05:140
26687992823,4cyclictest0-21swapper/019:35:010
2668799280,28cyclictest0-21swapper/019:30:130
2668799280,27cyclictest0-21swapper/022:50:130
26700992727,0cyclictest13501-21apt-get19:50:133
26700992727,0cyclictest0-21swapper/323:35:123
2670099270,27cyclictest0-21swapper/320:05:133
2670099270,0cyclictest0-21swapper/321:50:113
2670099270,0cyclictest0-21swapper/319:25:113
26696992727,0cyclictest0-21swapper/200:10:112
26696992726,1cyclictest0-21swapper/219:15:022
26696992726,0cyclictest0-21swapper/223:15:112
2669699270,0cyclictest29243-21apt-get19:15:112
26692992727,0cyclictest9499-21apt-get23:15:121
26692992727,0cyclictest0-21swapper/120:05:121
26692992727,0cyclictest0-21swapper/119:25:111
26692992727,0cyclictest0-21swapper/100:25:141
26692992726,1cyclictest9252-21apt-get22:05:111
2669299270,0cyclictest0-21swapper/123:35:011
26687992727,0cyclictest0-21swapper/023:15:120
26687992727,0cyclictest0-21swapper/023:10:120
26687992727,0cyclictest0-21swapper/022:05:010
26687992727,0cyclictest0-21swapper/021:40:000
26700992626,0cyclictest28197-21apt-get23:55:123
26700992626,0cyclictest0-21swapper/322:50:143
26700992626,0cyclictest0-21swapper/322:45:123
26700992624,1cyclictest0-21swapper/322:35:013
26696992626,0cyclictest6626-21apt-get22:00:142
26696992626,0cyclictest0-21swapper/221:10:112
26692992626,0cyclictest0-21swapper/120:05:011
26692992626,0cyclictest0-21swapper/100:20:131
26692992626,0cyclictest0-21swapper/100:10:121
26692992625,1cyclictest32507-21cron20:35:011
26692992624,1cyclictest30273-40mandb00:00:011
26692992623,3cyclictest0-21swapper/121:15:111
26687992626,0cyclictest0-21swapper/022:20:130
26687992626,0cyclictest0-21swapper/021:05:120
26687992626,0cyclictest0-21swapper/020:55:000
26687992626,0cyclictest0-21swapper/020:20:120
26700992525,0cyclictest0-21swapper/323:10:113
26700992525,0cyclictest0-21swapper/319:55:153
26696992525,0cyclictest31990-21apt-get21:45:122
26692992525,0cyclictest0-21swapper/122:45:131
26692992522,3cyclictest0-21swapper/123:05:111
26692992522,3cyclictest0-21swapper/123:05:111
26687992525,0cyclictest0-21swapper/019:50:120
26687992523,2cyclictest0-21swapper/000:05:120
26700992423,1cyclictest1208-21cron19:25:023
26696992424,0cyclictest0-21swapper/223:40:112
26692992424,0cyclictest22823-21apt-get20:10:141
26692992423,1cyclictest611-21avahi-daemon23:00:001
26687992424,0cyclictest0-21swapper/022:00:130
26687992424,0cyclictest0-21swapper/000:25:130
26687992422,1cyclictest609-21dbus-daemon21:49:590
26700992321,1cyclictest303-21systemd-journal22:15:013
26696992323,0cyclictest16498-21apt-get23:30:132
26687992323,0cyclictest0-21swapper/021:30:110
26700992222,0cyclictest0-21swapper/321:05:123
26700992222,0cyclictest0-21swapper/320:50:123
26696992222,0cyclictest8370-21apt-get20:55:102
26692992222,0cyclictest25145-21apt-get20:15:141
26700992121,0cyclictest0-21swapper/320:40:083
26700992121,0cyclictest0-21swapper/319:35:133
26700992120,1cyclictest611-21avahi-daemon23:30:003
26700992120,1cyclictest20611-21turbostat.cron22:30:003
26700992120,0cyclictest0-21swapper/300:05:123
26696992121,0cyclictest0-21swapper/222:55:132
26696992121,0cyclictest0-21swapper/219:20:142
26696992119,1cyclictest3532-21cron19:30:002
26692992121,0cyclictest22959-21perf22:35:021
26692992121,0cyclictest0-21swapper/122:00:001
26692992121,0cyclictest0-21swapper/100:35:141
26692992120,0cyclictest29668-21apt-get21:40:121
26687992121,0cyclictest0-21swapper/023:25:140
26687992121,0cyclictest0-21swapper/021:50:110
26687992121,0cyclictest0-21swapper/000:35:140
26700992020,0cyclictest0-21swapper/323:05:013
26700992020,0cyclictest0-21swapper/320:30:063
26696992020,0cyclictest0-21swapper/222:10:122
26692992020,0cyclictest0-21swapper/122:00:131
26692992020,0cyclictest0-21swapper/119:50:001
26687992020,0cyclictest0-21swapper/023:45:110
26687992016,3cyclictest0-21swapper/022:45:130
2668799200,19cyclictest0-21swapper/021:15:130
26700991919,0cyclictest0-21swapper/320:45:123
26696991919,0cyclictest10204-21apt-get00:25:152
26692991919,0cyclictest0-21swapper/121:25:021
26692991919,0cyclictest0-21swapper/120:45:111
26687991919,0cyclictest0-21swapper/019:25:120
26687991919,0cyclictest0-21swapper/000:20:120
26687991917,1cyclictest32505-21awk20:35:000
26700991818,0cyclictest0-21swapper/323:30:123
2670099180,18cyclictest0-21swapper/321:11:043
26696991818,0cyclictest0-21swapper/221:50:122
2669299184,7cyclictest6011-21/usr/sbin/munin20:50:151
26687991818,0cyclictest0-21swapper/020:05:010
26687991818,0cyclictest0-21swapper/000:10:120
26687991814,3cyclictest0-21swapper/023:05:120
26687991814,3cyclictest0-21swapper/023:05:120
2668799180,15cyclictest18843-21cstates22:25:130
2668799180,14cyclictest0-21swapper/020:15:160
26700991717,0cyclictest0-21swapper/321:25:113
26700991717,0cyclictest0-21swapper/320:20:113
26700991715,1cyclictest11532-21cron23:20:013
26700991715,1cyclictest0-21swapper/320:15:143
2670099170,17cyclictest0-21swapper/321:33:273
2670099170,17cyclictest0-21swapper/320:26:153
26696991717,0cyclictest0-21swapper/220:00:142
26696991715,1cyclictest12748-21sh21:04:592
26692991717,0cyclictest0-21swapper/123:35:111
26692991716,1cyclictest28948-21cron19:15:011
26687991715,1cyclictest2182-21sendmail-msp23:00:000
26700991616,0cyclictest0-21swapper/322:40:103
26700991613,2cyclictest6175-21apt-key19:35:003
26696991616,0cyclictest0-21swapper/219:45:122
2669299160,0cyclictest0-21swapper/121:20:111
2669299160,0cyclictest0-21swapper/120:40:181
26687991614,1cyclictest0-21swapper/022:35:020
26687991613,2cyclictest609-21dbus-daemon19:15:010
26700991515,0cyclictest0-21swapper/322:05:133
26700991513,1cyclictest0-21swapper/319:45:163
26700991513,1cyclictest0-21swapper/300:05:013
2670099150,1cyclictest0-21swapper/322:55:213
2670099150,14cyclictest31307-21latency_hist19:20:023
2669699156,5cyclictest28403-21fschecks_time22:45:162
26696991513,1cyclictest30252-21grep20:30:002
26696991513,1cyclictest17896-21users22:20:202
2669699150,1cyclictest23185-21tune2fs21:25:122
2669699150,1cyclictest0-21swapper/221:08:012
2669699150,14cyclictest6331-21irqstats00:15:162
26692991513,1cyclictest24268-21ntp_states22:35:181
26692991513,1cyclictest19475-21memory22:25:161
2669299150,15cyclictest0-21swapper/100:16:211
2669299150,14cyclictest0-21swapper/100:30:091
2669299150,0cyclictest0-21swapper/122:54:301
26687991515,0cyclictest0-21swapper/020:10:150
26687991514,1cyclictest0-21swapper/020:35:190
26687991514,1cyclictest0-21swapper/019:56:190
26687991514,1cyclictest0-21swapper/019:41:490
2668799151,14cyclictest13-21ksoftirqd/023:00:230
2668799150,15cyclictest0-21swapper/021:58:270
2668799150,15cyclictest0-21swapper/021:29:160
2668799150,15cyclictest0-21swapper/021:21:590
2668799150,15cyclictest0-21swapper/019:24:140
2668799150,14cyclictest0-21swapper/019:45:150
26700991413,1cyclictest0-21swapper/321:20:133
2670099140,14cyclictest0-21swapper/323:51:103
2670099140,14cyclictest0-21swapper/323:40:433
2670099140,14cyclictest0-21swapper/323:20:263
2670099140,14cyclictest0-21swapper/322:36:433
2670099140,14cyclictest0-21swapper/321:55:493
2670099140,14cyclictest0-21swapper/321:48:293
2670099140,14cyclictest0-21swapper/321:01:573
2670099140,14cyclictest0-21swapper/320:35:123
2670099140,14cyclictest0-21swapper/320:00:253
2670099140,14cyclictest0-21swapper/319:40:103
2670099140,14cyclictest0-21swapper/319:11:483
2670099140,14cyclictest0-21swapper/300:25:043
2670099140,14cyclictest0-21swapper/300:16:463
2670099140,0cyclictest0-21swapper/322:23:173
2670099140,0cyclictest0-21swapper/322:16:523
2670099140,0cyclictest0-21swapper/322:02:133
2670099140,0cyclictest0-21swapper/321:40:553
2670099140,0cyclictest0-21swapper/320:55:293
2670099140,0cyclictest0-21swapper/320:10:123
26696991414,0cyclictest0-21swapper/221:35:112
26696991414,0cyclictest0-21swapper/219:39:132
26696991414,0cyclictest0-21swapper/200:02:442
2669699140,14cyclictest0-21swapper/223:46:252
2669699140,14cyclictest0-21swapper/223:36:152
2669699140,14cyclictest0-21swapper/223:12:392
2669699140,14cyclictest0-21swapper/222:31:462
2669699140,14cyclictest0-21swapper/222:08:572
2669699140,14cyclictest0-21swapper/221:59:282
2669699140,14cyclictest0-21swapper/221:41:102
2669699140,14cyclictest0-21swapper/220:47:152
2669699140,14cyclictest0-21swapper/220:41:502
2669699140,14cyclictest0-21swapper/220:36:432
2669699140,14cyclictest0-21swapper/220:31:092
2669699140,14cyclictest0-21swapper/220:21:102
2669699140,14cyclictest0-21swapper/220:05:452
2669699140,14cyclictest0-21swapper/219:55:162
2669699140,14cyclictest0-21swapper/219:40:582
2669699140,14cyclictest0-21swapper/200:36:422
2669699140,14cyclictest0-21swapper/200:30:312
2669699140,0cyclictest0-21swapper/223:55:092
2669699140,0cyclictest0-21swapper/223:27:022
2669699140,0cyclictest0-21swapper/223:21:222
2669699140,0cyclictest0-21swapper/223:01:322
2669699140,0cyclictest0-21swapper/222:41:052
2669699140,0cyclictest0-21swapper/222:35:312
2669699140,0cyclictest0-21swapper/221:31:262
2669699140,0cyclictest0-21swapper/221:21:322
2669699140,0cyclictest0-21swapper/220:53:152
2669699140,0cyclictest0-21swapper/220:15:142
2669699140,0cyclictest0-21swapper/219:52:552
2669699140,0cyclictest0-21swapper/200:20:382
26692991414,0cyclictest0-21swapper/123:50:281
26692991414,0cyclictest0-21swapper/123:40:091
26692991414,0cyclictest0-21swapper/120:20:051
26692991414,0cyclictest0-21swapper/119:40:371
26692991413,1cyclictest0-21swapper/123:02:151
2669299140,14cyclictest0-21swapper/122:41:251
2669299140,14cyclictest0-21swapper/121:10:001
2669299140,14cyclictest0-21swapper/121:00:491
2669299140,14cyclictest0-21swapper/120:35:461
2669299140,14cyclictest0-21swapper/120:25:551
2669299140,14cyclictest0-21swapper/119:55:061
2669299140,14cyclictest0-21swapper/119:51:421
2669299140,14cyclictest0-21swapper/119:20:381
2669299140,14cyclictest0-21swapper/119:16:261
2669299140,0cyclictest0-21swapper/123:10:291
2669299140,0cyclictest0-21swapper/122:21:361
2669299140,0cyclictest0-21swapper/122:15:261
2669299140,0cyclictest0-21swapper/120:56:131
2669299140,0cyclictest0-21swapper/100:06:391
2669299140,0cyclictest0-21swapper/100:00:331
2668799142,4cyclictest0-21swapper/000:15:130
26687991414,0cyclictest0-21swapper/021:40:120
26687991414,0cyclictest0-21swapper/021:10:540
26687991414,0cyclictest0-21swapper/020:45:030
26687991414,0cyclictest0-21swapper/020:25:170
26687991413,1cyclictest0-21swapper/020:40:180
2668799140,14cyclictest0-21swapper/023:50:200
2668799140,14cyclictest0-21swapper/022:40:530
2668799140,14cyclictest0-21swapper/022:15:300
2668799140,14cyclictest0-21swapper/000:30:450
2668799140,0cyclictest0-21swapper/023:35:030
2668799140,0cyclictest0-21swapper/022:35:410
2668799140,0cyclictest0-21swapper/000:00:110
26696991313,0cyclictest0-21swapper/223:50:172
26696991313,0cyclictest0-21swapper/223:06:032
26696991313,0cyclictest0-21swapper/223:06:032
26696991312,1cyclictest1205-21cut00:05:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional