You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-13 - 07:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Sun Jul 13, 2025 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25461993028,1cyclictest17465-21cron21:10:001
2546199300,29cyclictest0-21swapper/123:55:151
2545799300,29cyclictest303-21systemd-journal19:50:010
2545799300,29cyclictest1715-21awk21:45:000
2546799290,28cyclictest8446-21apt-get20:50:133
2546799290,1cyclictest11631-21apt-get23:15:023
2546599290,28cyclictest8237-21apt-get00:15:022
2546599290,28cyclictest0-21swapper/200:00:012
25461992927,1cyclictest1-21systemd21:50:001
2546199290,28cyclictest0-21swapper/121:40:151
2546199290,1cyclictest28583-21awk23:50:001
25457992927,1cyclictest26868-21perf21:30:000
2545799290,1cyclictest13201-21cron00:25:000
25467992828,0cyclictest6654-21apt-get21:55:133
25467992826,1cyclictest19816-21munin-run21:14:593
2546799280,28cyclictest0-21swapper/320:00:143
2546799280,0cyclictest0-21swapper/323:30:163
2546599280,27cyclictest0-21swapper/220:45:142
2546199280,0cyclictest0-21swapper/120:55:141
25457992828,0cyclictest0-21swapper/020:05:150
25457992827,1cyclictest18662-21cron20:05:010
2545799280,28cyclictest0-21swapper/023:15:020
2545799280,28cyclictest0-21swapper/019:30:130
2545799280,0cyclictest0-21swapper/020:10:160
25467992727,0cyclictest7322-21apt-get19:40:173
25467992727,0cyclictest0-21swapper/323:50:133
25467992727,0cyclictest0-21swapper/322:50:153
25467992727,0cyclictest0-21swapper/322:47:433
25467992727,0cyclictest0-21swapper/320:10:173
25467992727,0cyclictest0-21swapper/300:20:173
25465992727,0cyclictest21271-21apt-get20:10:162
25465992727,0cyclictest0-21swapper/223:15:032
25465992727,0cyclictest0-21swapper/219:40:162
25461992727,0cyclictest0-21swapper/123:40:011
25461992727,0cyclictest0-21swapper/123:25:151
25461992727,0cyclictest0-21swapper/120:50:011
25461992727,0cyclictest0-21swapper/119:40:161
25461992727,0cyclictest0-21swapper/100:15:151
2546199270,0cyclictest11180-21apt-get00:20:161
25457992727,0cyclictest0-21swapper/023:55:150
25457992727,0cyclictest0-21swapper/022:35:150
25457992727,0cyclictest0-21swapper/022:30:150
25457992727,0cyclictest0-21swapper/021:20:130
2545799270,0cyclictest0-21swapper/020:15:150
25467992626,0cyclictest29756-21apt-get21:35:143
25467992626,0cyclictest0-21swapper/319:35:163
25467992626,0cyclictest0-21swapper/319:20:153
25467992626,0cyclictest0-21swapper/300:05:173
25467992626,0cyclictest0-21swapper/300:00:123
25465992626,0cyclictest1512-21apt-get00:00:122
25465992626,0cyclictest0-21swapper/222:55:152
25465992626,0cyclictest0-21swapper/222:50:152
25465992626,0cyclictest0-21swapper/221:55:132
25465992626,0cyclictest0-21swapper/221:10:122
25465992624,1cyclictest0-21swapper/221:10:002
25461992626,0cyclictest15820-21apt-get00:30:151
25461992626,0cyclictest0-21swapper/120:05:141
25457992626,0cyclictest18311-21apt-get22:20:140
25457992626,0cyclictest14546-21apt-get23:20:120
25457992626,0cyclictest0-21swapper/020:45:130
25467992525,0cyclictest0-21swapper/322:05:153
25467992525,0cyclictest0-21swapper/300:25:133
25465992525,0cyclictest0-21swapper/220:30:122
25465992525,0cyclictest0-21swapper/200:20:172
25461992525,0cyclictest0-21swapper/100:05:181
25457992525,0cyclictest0-21swapper/022:25:170
25457992525,0cyclictest0-21swapper/022:25:170
25467992424,0cyclictest0-21swapper/320:20:033
25467992422,1cyclictest0-21swapper/321:35:003
25465992424,0cyclictest0-21swapper/223:20:132
25465992424,0cyclictest0-21swapper/219:20:152
25461992424,0cyclictest0-21swapper/122:35:151
25461992424,0cyclictest0-21swapper/119:15:151
25461992424,0cyclictest0-21swapper/119:10:151
25461992424,0cyclictest0-21swapper/100:35:131
25461992422,1cyclictest6372-21latency_hist21:55:001
25457992424,0cyclictest0-21swapper/023:10:120
25457992424,0cyclictest0-21swapper/000:25:120
25467992323,0cyclictest0-21swapper/323:20:123
25467992323,0cyclictest0-21swapper/323:00:133
25467992323,0cyclictest0-21swapper/300:35:143
25465992323,0cyclictest25752-21apt-get19:10:152
25465992323,0cyclictest0-21swapper/223:40:132
25465992323,0cyclictest0-21swapper/221:00:142
25465992323,0cyclictest0-21swapper/219:45:142
25461992323,0cyclictest0-21swapper/122:10:011
25461992323,0cyclictest0-21swapper/119:45:141
25457992323,0cyclictest17873-21apt-get00:35:020
25457992323,0cyclictest0-21swapper/023:40:140
25457992323,0cyclictest0-21swapper/021:45:120
25457992323,0cyclictest0-21swapper/020:35:130
25465992222,0cyclictest18311-21apt-get22:20:162
25465992222,0cyclictest0-21swapper/221:30:052
25461992222,0cyclictest0-21swapper/121:30:051
25461992220,1cyclictest15562-21munin-run00:30:001
25457992222,0cyclictest0-21swapper/021:50:170
25457992220,1cyclictest1-21systemd23:35:000
25457992220,1cyclictest0-21swapper/019:15:000
25467992121,0cyclictest0-21swapper/323:35:163
25467992121,0cyclictest0-21swapper/322:15:153
25467992121,0cyclictest0-21swapper/319:15:153
25465992121,0cyclictest0-21swapper/223:50:022
25465992121,0cyclictest0-21swapper/223:05:012
25461992121,0cyclictest0-21swapper/120:10:151
25461992121,0cyclictest0-21swapper/119:20:161
25461992120,1cyclictest0-21swapper/122:30:151
25465992020,0cyclictest0-21swapper/223:30:162
25465992020,0cyclictest0-21swapper/222:10:122
25465992020,0cyclictest0-21swapper/221:15:112
25461992018,1cyclictest15703-21munin-run22:15:011
25467991919,0cyclictest0-21swapper/322:55:153
25467991919,0cyclictest0-21swapper/322:40:133
25467991918,1cyclictest626-21gdbus00:20:003
25467991918,0cyclictest0-21swapper/320:30:123
25465991919,0cyclictest16870-21apt-get23:25:162
25465991919,0cyclictest0-21swapper/221:35:152
25467991818,0cyclictest0-21swapper/300:30:153
25465991816,1cyclictest10511-21munin-run20:55:012
25467991717,0cyclictest0-21swapper/319:10:153
25465991717,0cyclictest0-21swapper/222:45:122
25465991717,0cyclictest0-21swapper/222:30:162
2546199170,16cyclictest12922-21if_enp1s0.823:15:171
25457991717,0cyclictest11960-21apt-get19:50:150
2545799170,16cyclictest6660-21runrttasks19:35:420
2546799165,9cyclictest23570-21apt-get23:40:023
25465991616,0cyclictest0-21swapper/220:55:152
25465991614,1cyclictest24450-21cron21:25:002
2546599160,2cyclictest9498-21grep22:00:172
25461991616,0cyclictest0-21swapper/122:20:161
25461991616,0cyclictest0-21swapper/122:15:161
25461991616,0cyclictest0-21swapper/121:10:121
2546199160,1cyclictest23809-21find21:20:221
2546199160,15cyclictest0-21swapper/123:35:191
25457991616,0cyclictest27432-21apt-get21:30:120
25457991614,1cyclictest28307-21sed22:40:140
2545799160,15cyclictest8696-21sed19:40:240
2545799160,15cyclictest0-21swapper/000:35:010
25467991515,0cyclictest32103-21apt-get21:40:163
25467991515,0cyclictest0-21swapper/323:05:143
25467991515,0cyclictest0-21swapper/320:15:163
25467991515,0cyclictest0-21swapper/319:50:143
25467991514,0cyclictest0-21swapper/323:25:173
2546799150,14cyclictest0-21swapper/321:15:193
25465991513,1cyclictest28497-21diskstats19:15:172
2546599150,1cyclictest0-21swapper/200:35:182
2546599150,1cyclictest0-21swapper/200:05:202
2546599150,14cyclictest0-21swapper/220:15:192
2546599150,14cyclictest0-21swapper/219:55:172
25461991515,0cyclictest0-21swapper/122:47:421
25461991514,1cyclictest1898-21kworker/1:021:03:511
25461991513,1cyclictest609-21dbus-daemon20:20:011
2546199150,1cyclictest3497-21/usr/sbin/munin20:40:141
25457991515,0cyclictest0-21swapper/023:25:150
25457991515,0cyclictest0-21swapper/021:55:130
25467991414,0cyclictest0-21swapper/322:10:123
25467991413,1cyclictest623-21polkitd20:40:003
25467991412,1cyclictest0-21swapper/323:10:173
2546799140,14cyclictest0-21swapper/322:38:173
2546799140,14cyclictest0-21swapper/322:29:593
2546799140,14cyclictest0-21swapper/322:29:583
2546799140,14cyclictest0-21swapper/321:51:513
2546799140,14cyclictest0-21swapper/321:45:073
2546799140,14cyclictest0-21swapper/321:26:023
2546799140,14cyclictest0-21swapper/320:46:073
2546799140,14cyclictest0-21swapper/320:40:383
2546799140,14cyclictest0-21swapper/320:25:383
2546799140,14cyclictest0-21swapper/320:07:523
2546799140,14cyclictest0-21swapper/319:50:003
2546799140,14cyclictest0-21swapper/319:30:163
2546799140,14cyclictest0-21swapper/319:28:203
2546799140,14cyclictest0-21swapper/300:10:533
2546799140,0cyclictest0-21swapper/322:30:073
2546799140,0cyclictest0-21swapper/322:03:413
2546799140,0cyclictest0-21swapper/321:20:503
25465991412,1cyclictest19993-21ntp_states20:05:212
25465991412,1cyclictest11639-21munin-run23:15:002
2546599140,14cyclictest0-21swapper/223:49:562
2546599140,14cyclictest0-21swapper/223:35:262
2546599140,14cyclictest0-21swapper/223:03:062
2546599140,14cyclictest0-21swapper/222:39:592
2546599140,14cyclictest0-21swapper/222:25:032
2546599140,14cyclictest0-21swapper/222:25:032
2546599140,14cyclictest0-21swapper/222:06:032
2546599140,14cyclictest0-21swapper/221:44:132
2546599140,14cyclictest0-21swapper/220:41:432
2546599140,14cyclictest0-21swapper/220:02:072
2546599140,14cyclictest0-21swapper/219:35:402
2546599140,14cyclictest0-21swapper/219:30:192
2546599140,14cyclictest0-21swapper/219:29:242
2546599140,14cyclictest0-21swapper/200:11:512
2546599140,0cyclictest0-21swapper/222:41:102
2546599140,0cyclictest0-21swapper/222:15:362
2546599140,0cyclictest0-21swapper/221:45:362
2546599140,0cyclictest0-21swapper/220:36:392
2546599140,0cyclictest0-21swapper/219:52:192
2546599140,0cyclictest0-21swapper/200:30:052
2546599140,0cyclictest0-21swapper/200:25:142
25461991414,0cyclictest0-21swapper/123:10:131
25461991414,0cyclictest0-21swapper/121:25:121
25461991414,0cyclictest0-21swapper/120:20:141
25461991414,0cyclictest0-21swapper/119:27:151
25461991412,1cyclictest6693-21munin-run23:05:011
25461991412,1cyclictest0-21swapper/121:35:081
2546199140,14cyclictest0-21swapper/123:50:501
2546199140,14cyclictest0-21swapper/123:21:221
2546199140,14cyclictest0-21swapper/123:05:181
2546199140,14cyclictest0-21swapper/122:50:461
2546199140,14cyclictest0-21swapper/122:41:461
2546199140,14cyclictest0-21swapper/122:26:371
2546199140,14cyclictest0-21swapper/122:26:371
2546199140,14cyclictest0-21swapper/122:03:151
2546199140,14cyclictest0-21swapper/121:59:431
2546199140,14cyclictest0-21swapper/121:15:481
2546199140,14cyclictest0-21swapper/120:37:581
2546199140,14cyclictest0-21swapper/120:30:261
2546199140,14cyclictest0-21swapper/119:54:181
2546199140,14cyclictest0-21swapper/119:30:051
2546199140,14cyclictest0-21swapper/100:00:241
2546199140,0cyclictest0-21swapper/123:32:311
2546199140,0cyclictest0-21swapper/122:56:031
2546199140,0cyclictest0-21swapper/120:51:251
2546199140,0cyclictest0-21swapper/120:25:311
2546199140,0cyclictest0-21swapper/120:00:211
2546199140,0cyclictest0-21swapper/119:37:251
25457991414,0cyclictest13114-21apt-get21:00:140
25457991414,0cyclictest0-21swapper/023:45:480
25457991414,0cyclictest0-21swapper/020:55:130
25457991414,0cyclictest0-21swapper/000:05:090
25457991412,1cyclictest28885-21cat23:50:020
25457991412,1cyclictest0-21swapper/019:25:200
2545799140,14cyclictest0-21swapper/023:36:370
2545799140,14cyclictest0-21swapper/023:00:580
2545799140,14cyclictest0-21swapper/022:55:530
2545799140,14cyclictest0-21swapper/022:51:280
2545799140,14cyclictest0-21swapper/022:45:290
2545799140,14cyclictest0-21swapper/022:18:540
2545799140,14cyclictest0-21swapper/022:05:240
2545799140,14cyclictest0-21swapper/022:03:190
2545799140,14cyclictest0-21swapper/021:05:370
2545799140,14cyclictest0-21swapper/020:50:200
2545799140,14cyclictest0-21swapper/020:42:320
2545799140,14cyclictest0-21swapper/020:31:570
2545799140,14cyclictest0-21swapper/000:10:020
2545799140,14cyclictest0-21swapper/000:02:120
2545799140,0cyclictest0-21swapper/023:05:500
2545799140,0cyclictest0-21swapper/021:10:580
2545799140,0cyclictest0-21swapper/020:20:460
2545799140,0cyclictest0-21swapper/019:55:290
2545799140,0cyclictest0-21swapper/019:15:500
25467991313,0cyclictest0-21swapper/323:56:013
25467991313,0cyclictest0-21swapper/323:45:073
25467991313,0cyclictest0-21swapper/321:05:133
25467991313,0cyclictest0-21swapper/321:00:203
25467991313,0cyclictest0-21swapper/320:55:223
25467991313,0cyclictest0-21swapper/319:56:283
25465991313,0cyclictest0-21swapper/220:20:222
25465991311,1cyclictest0-21swapper/221:25:032
2546599130,0cyclictest0-21swapper/220:27:042
25461991313,0cyclictest0-21swapper/119:55:151
25457991313,0cyclictest0-21swapper/022:10:180
25457991313,0cyclictest0-21swapper/021:18:540
25457991313,0cyclictest0-21swapper/020:26:400
25457991313,0cyclictest0-21swapper/000:15:280
2545799130,0cyclictest0-21swapper/021:35:140
25465991212,0cyclictest0-21swapper/221:50:072
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional