You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-29 - 01:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5.osadl.org (updated Sat Jun 28, 2025 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25705993229,2cyclictest303-21systemd-journal10:35:011
2570799310,30cyclictest303-21systemd-journal12:00:003
2570799300,29cyclictest570-21cron07:25:013
2570799300,29cyclictest3222-21cron07:30:013
2570799300,29cyclictest24527-21cron09:24:593
25705993028,1cyclictest16888-21cron11:25:011
2570799290,28cyclictest0-21swapper/310:35:153
2570799290,28cyclictest0-21swapper/310:35:153
25706992927,1cyclictest29485-21cron09:35:002
25706992926,2cyclictest26818-21awk11:45:012
2570699290,28cyclictest0-21swapper/207:25:142
2570599290,29cyclictest4054-21apt-get12:05:171
2570599290,28cyclictest2907-21apt-get10:55:141
2570599290,28cyclictest0-21swapper/108:35:171
25704992928,1cyclictest0-21swapper/010:25:170
25704992927,1cyclictest0-21swapper/010:15:000
2570499290,28cyclictest31290-21perf08:30:010
2570499290,28cyclictest0-21swapper/011:25:160
2570799280,28cyclictest0-21swapper/312:15:183
2570799280,28cyclictest0-21swapper/309:35:163
2570799280,0cyclictest0-21swapper/308:25:153
2570699280,0cyclictest29245-21apt-get08:25:152
2570699280,0cyclictest26925-21apt-get08:20:162
2570699280,0cyclictest18371-21apt-get12:35:142
2570699280,0cyclictest0-21swapper/211:10:162
25705992828,0cyclictest30936-21apt-get07:20:151
25704992828,0cyclictest0-21swapper/011:40:120
25704992828,0cyclictest0-21swapper/010:15:150
2570499280,0cyclictest0-21swapper/009:15:140
25707992727,0cyclictest0-21swapper/310:45:153
25707992727,0cyclictest0-21swapper/309:50:153
25706992727,0cyclictest6721-21apt-get09:55:132
25706992727,0cyclictest0-21swapper/212:30:132
25706992727,0cyclictest0-21swapper/211:30:142
25706992727,0cyclictest0-21swapper/209:40:162
25706992727,0cyclictest0-21swapper/209:00:142
25706992726,1cyclictest23630-21apt-get10:30:122
2570699270,0cyclictest0-21swapper/212:20:162
25705992727,0cyclictest0-21swapper/108:25:151
25704992727,0cyclictest0-21swapper/011:50:180
25704992727,0cyclictest0-21swapper/011:00:190
25704992727,0cyclictest0-21swapper/007:55:130
25704992725,1cyclictest7975-21cron07:40:020
2570499270,0cyclictest0-21swapper/007:10:180
25707992626,0cyclictest0-21swapper/311:15:183
25707992626,0cyclictest0-21swapper/308:10:143
25707992624,1cyclictest0-21swapper/310:25:013
25706992626,0cyclictest6193-21apt-get08:45:142
25706992626,0cyclictest17610-21apt-get08:00:152
25706992624,1cyclictest14982-21perf07:55:012
25705992626,0cyclictest0-21swapper/112:30:131
25705992626,0cyclictest0-21swapper/109:25:131
25705992626,0cyclictest0-21swapper/109:00:151
25705992626,0cyclictest0-21swapper/108:00:141
25705992625,1cyclictest12331-21apt-get12:20:221
25705992625,0cyclictest9897-21apt-get11:10:171
25704992626,0cyclictest8293-21apt-get07:40:140
25704992626,0cyclictest11042-21apt-get12:20:150
25704992625,1cyclictest24573-21apt-get08:15:170
25707992525,0cyclictest0-21swapper/312:30:143
25707992525,0cyclictest0-21swapper/311:45:153
25707992525,0cyclictest0-21swapper/311:20:023
25707992525,0cyclictest0-21swapper/310:05:143
25707992525,0cyclictest0-21swapper/310:00:173
25707992525,0cyclictest0-21swapper/308:40:143
25707992525,0cyclictest0-21swapper/308:30:143
25707992523,1cyclictest17531-21cron09:10:003
25707992522,2cyclictest303-21systemd-journal10:55:023
25705992523,1cyclictest13413-21cron10:10:001
25704992525,0cyclictest18371-21apt-get12:35:150
25704992525,0cyclictest0-21swapper/011:35:150
25704992525,0cyclictest0-21swapper/010:30:120
25704992525,0cyclictest0-21swapper/009:30:170
25707992424,0cyclictest2077-21apt-get09:45:143
25707992424,0cyclictest0-21swapper/311:35:163
25707992424,0cyclictest0-21swapper/309:10:133
25706992424,0cyclictest0-21swapper/208:10:132
25706992424,0cyclictest0-21swapper/207:30:132
25705992424,0cyclictest19930-21apt-get08:05:151
25705992424,0cyclictest0-21swapper/110:00:171
25705992424,0cyclictest0-21swapper/108:55:131
25705992424,0cyclictest0-21swapper/107:35:161
25705992422,1cyclictest31455-21cron11:55:001
25704992424,0cyclictest7578-21apt-get11:05:190
25704992424,0cyclictest0-21swapper/010:40:160
25704992424,0cyclictest0-21swapper/007:15:140
25707992323,0cyclictest0-21swapper/311:50:183
25707992323,0cyclictest0-21swapper/310:15:153
25707992323,0cyclictest0-21swapper/308:15:163
25706992323,0cyclictest13424-21apt-get10:10:022
25706992323,0cyclictest0-21swapper/210:55:142
25706992323,0cyclictest0-21swapper/207:45:162
25705992323,0cyclictest10615-21apt-get07:45:161
25705992323,0cyclictest0-21swapper/111:30:141
25705992323,0cyclictest0-21swapper/109:55:131
25705992323,0cyclictest0-21swapper/109:30:021
25705992321,1cyclictest0-21swapper/108:00:011
25704992323,0cyclictest0-21swapper/010:25:000
25707992222,0cyclictest1730-21apt-get12:00:143
25707992222,0cyclictest0-21swapper/312:20:233
25707992222,0cyclictest0-21swapper/311:00:193
25707992220,1cyclictest0-21swapper/310:00:013
25706992222,0cyclictest543-21apt-get10:50:182
25706992222,0cyclictest0-21swapper/212:05:172
25706992222,0cyclictest0-21swapper/208:05:152
25705992221,1cyclictest15503-21apt-get09:05:151
25704992222,0cyclictest0-21swapper/012:25:180
25704992222,0cyclictest0-21swapper/012:10:150
25706992121,0cyclictest0-21swapper/211:55:132
25706992121,0cyclictest0-21swapper/209:05:142
25706992121,0cyclictest0-21swapper/208:35:182
25705992121,0cyclictest0-21swapper/107:30:131
25704992121,0cyclictest20112-21apt-get11:30:130
25707992020,0cyclictest0-21swapper/310:10:143
25707992020,0cyclictest0-21swapper/307:40:133
25706992020,0cyclictest0-21swapper/211:25:032
25706992018,1cyclictest29148-21cron11:50:002
25705992020,0cyclictest0-21swapper/108:45:141
25704992018,1cyclictest21981-21perf08:10:010
25706991919,0cyclictest31567-21apt-get08:30:142
25706991919,0cyclictest10835-21apt-get08:55:132
25705991919,0cyclictest0-21swapper/108:50:131
25704991919,0cyclictest25964-21apt-get10:35:160
25704991919,0cyclictest25964-21apt-get10:35:160
25704991917,1cyclictest19857-21cron09:15:010
25704991917,1cyclictest0-21swapper/012:05:010
25707991816,1cyclictest0-21swapper/311:35:013
25706991818,0cyclictest0-21swapper/207:20:162
25705991817,1cyclictest31570-21taskset08:30:141
25704991818,0cyclictest0-21swapper/012:10:010
25704991818,0cyclictest0-21swapper/008:35:160
25704991817,0cyclictest0-21swapper/007:45:160
25707991717,0cyclictest0-21swapper/311:05:193
25705991717,0cyclictest0-21swapper/111:55:141
25705991717,0cyclictest0-21swapper/110:50:181
25705991717,0cyclictest0-21swapper/109:50:001
25704991715,1cyclictest609-21dbus-daemon08:44:590
25704991714,2cyclictest1226-21sh08:34:590
25707991614,1cyclictest16311-21ntp_states07:55:203
25707991613,2cyclictest303-21systemd-journal09:29:593
2570799160,1cyclictest0-21swapper/310:30:013
2570799160,15cyclictest10578-21/usr/sbin/munin08:55:013
25706991616,0cyclictest24816-21apt-get09:25:132
25706991615,1cyclictest0-21swapper/211:05:002
25706991614,1cyclictest10781-21munin-run12:20:022
2570699160,15cyclictest23078-21http10:30:002
25705991616,0cyclictest0-21swapper/107:25:131
25705991614,1cyclictest0-21swapper/111:35:221
25705991614,1cyclictest0-21swapper/109:15:011
2570599160,15cyclictest20119-21/usr/sbin/munin09:15:161
2570499160,15cyclictest23636-21pmu-power09:20:190
25707991515,0cyclictest28006-21apt-get07:15:023
25707991515,0cyclictest0-21swapper/312:25:183
25707991515,0cyclictest0-21swapper/310:40:153
2570799150,1cyclictest21731-21grep09:15:223
2570799150,1cyclictest12963-21grep09:00:013
2570799150,15cyclictest0-21swapper/308:07:493
2570799150,14cyclictest19559-21munin-run11:30:003
25706991513,1cyclictest14464-21ntp_states12:25:232
2570699150,1cyclictest0-21swapper/212:00:172
2570699150,14cyclictest0-21swapper/211:50:252
2570699150,14cyclictest0-21swapper/208:15:162
25705991513,1cyclictest0-21swapper/109:35:211
2570599150,14cyclictest15065-21ntp_states10:10:191
2570599150,0cyclictest0-21swapper/109:43:521
25704991515,0cyclictest6193-21apt-get08:45:130
25704991514,1cyclictest0-21swapper/010:08:180
25704991513,1cyclictest16121-21systemctl11:20:250
2570499150,14cyclictest7371-21smartctl09:55:160
2570499150,14cyclictest0-21swapper/011:15:450
2570799140,14cyclictest0-21swapper/312:10:253
2570799140,14cyclictest0-21swapper/312:05:013
2570799140,14cyclictest0-21swapper/311:40:283
2570799140,14cyclictest0-21swapper/310:58:053
2570799140,14cyclictest0-21swapper/310:32:173
2570799140,14cyclictest0-21swapper/309:40:133
2570799140,14cyclictest0-21swapper/309:33:083
2570799140,14cyclictest0-21swapper/308:46:443
2570799140,14cyclictest0-21swapper/308:20:203
2570799140,14cyclictest0-21swapper/307:31:033
2570799140,0cyclictest0-21swapper/312:40:013
2570799140,0cyclictest0-21swapper/311:12:023
2570799140,0cyclictest0-21swapper/309:00:173
2570799140,0cyclictest0-21swapper/308:00:423
25706991414,0cyclictest0-21swapper/208:50:132
2570699140,14cyclictest0-21swapper/211:21:062
2570699140,14cyclictest0-21swapper/211:17:202
2570699140,14cyclictest0-21swapper/211:06:502
2570699140,14cyclictest0-21swapper/210:44:252
2570699140,14cyclictest0-21swapper/210:36:522
2570699140,14cyclictest0-21swapper/210:36:512
2570699140,14cyclictest0-21swapper/210:20:282
2570699140,14cyclictest0-21swapper/210:15:032
2570699140,14cyclictest0-21swapper/210:05:062
2570699140,14cyclictest0-21swapper/209:52:462
2570699140,14cyclictest0-21swapper/209:35:352
2570699140,14cyclictest0-21swapper/208:41:122
2570699140,14cyclictest0-21swapper/207:55:022
2570699140,14cyclictest0-21swapper/207:40:572
2570699140,14cyclictest0-21swapper/207:37:292
2570699140,14cyclictest0-21swapper/207:11:362
2570699140,0cyclictest7371-21strings12:10:202
2570699140,0cyclictest0-21swapper/210:45:072
2570699140,0cyclictest0-21swapper/210:00:142
2570699140,0cyclictest0-21swapper/209:45:352
2570699140,0cyclictest0-21swapper/207:17:032
25705991414,0cyclictest0-21swapper/112:38:501
25705991414,0cyclictest0-21swapper/112:26:091
25705991414,0cyclictest0-21swapper/111:00:511
25705991414,0cyclictest0-21swapper/110:35:281
25705991414,0cyclictest0-21swapper/110:35:281
25705991414,0cyclictest0-21swapper/110:26:121
25705991414,0cyclictest0-21swapper/108:40:191
25705991414,0cyclictest0-21swapper/108:20:071
25705991414,0cyclictest0-21swapper/108:11:521
25705991414,0cyclictest0-21swapper/107:52:321
2570599140,14cyclictest0-21swapper/112:02:581
2570599140,14cyclictest0-21swapper/111:40:341
2570599140,14cyclictest0-21swapper/111:26:281
2570599140,14cyclictest0-21swapper/111:15:501
2570599140,14cyclictest0-21swapper/111:05:221
2570599140,14cyclictest0-21swapper/110:40:041
2570599140,14cyclictest0-21swapper/109:50:341
2570599140,14cyclictest0-21swapper/107:43:191
2570599140,14cyclictest0-21swapper/107:11:191
2570599140,0cyclictest0-21swapper/112:15:091
2570599140,0cyclictest0-21swapper/112:10:041
2570599140,0cyclictest0-21swapper/111:45:091
2570599140,0cyclictest0-21swapper/110:45:461
2570599140,0cyclictest0-21swapper/110:20:311
2570599140,0cyclictest0-21swapper/110:16:201
2570599140,0cyclictest0-21swapper/109:24:161
2570599140,0cyclictest0-21swapper/108:15:261
2570599140,0cyclictest0-21swapper/107:16:121
25704991414,0cyclictest0-21swapper/009:42:410
25704991414,0cyclictest0-21swapper/008:50:010
25704991414,0cyclictest0-21swapper/008:00:480
2570499140,14cyclictest0-21swapper/012:30:440
2570499140,14cyclictest0-21swapper/012:15:300
2570499140,14cyclictest0-21swapper/011:55:130
2570499140,14cyclictest0-21swapper/011:45:090
2570499140,14cyclictest0-21swapper/011:10:150
2570499140,14cyclictest0-21swapper/009:35:530
2570499140,14cyclictest0-21swapper/009:25:320
2570499140,14cyclictest0-21swapper/009:05:530
2570499140,14cyclictest0-21swapper/008:21:300
2570499140,14cyclictest0-21swapper/007:50:330
2570499140,14cyclictest0-21swapper/007:30:110
2570499140,14cyclictest0-21swapper/007:24:510
2570499140,0cyclictest0-21swapper/010:55:300
2570499140,0cyclictest0-21swapper/010:52:130
2570499140,0cyclictest0-21swapper/010:47:020
2570499140,0cyclictest0-21swapper/010:00:470
2570499140,0cyclictest0-21swapper/009:50:260
2570499140,0cyclictest0-21swapper/009:45:290
2570499140,0cyclictest0-21swapper/009:00:240
2570499140,0cyclictest0-21swapper/008:10:190
25707991313,0cyclictest0-21swapper/308:35:303
25707991313,0cyclictest0-21swapper/307:51:223
25707991313,0cyclictest0-21swapper/307:45:313
25707991313,0cyclictest0-21swapper/307:11:253
2570799130,0cyclictest0-21swapper/307:38:133
25706991313,0cyclictest0-21swapper/209:18:012
2570699130,0cyclictest0-21swapper/209:21:542
25704991313,0cyclictest0-21swapper/008:55:180
25704991313,0cyclictest0-21swapper/007:25:540
25706991212,0cyclictest0-21swapper/209:10:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional