You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 17:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Fri Nov 28, 2025 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2229999300,29cyclictest4758-21cron08:50:012
22300992927,1cyclictest609-21dbus-daemon12:10:003
2229999290,28cyclictest0-21swapper/208:15:122
2229999290,28cyclictest0-21swapper/207:15:112
2229499290,1cyclictest4763-21cron08:50:011
2229499290,1cyclictest15520-21munin-run12:40:011
22289992927,1cyclictest6208-21munin-run12:20:010
2228999290,28cyclictest32514-21apt-get08:40:110
2228999290,28cyclictest13814-21apt-get08:00:120
2228999290,28cyclictest0-21swapper/010:50:130
2228999290,28cyclictest0-21swapper/009:25:000
22300992826,1cyclictest0-21swapper/308:55:013
2230099280,27cyclictest0-21swapper/307:15:123
22299992828,0cyclictest17833-21apt-get11:35:132
22299992827,1cyclictest18460-21apt-get08:10:102
2229999280,27cyclictest0-21swapper/207:50:132
2229999280,1cyclictest0-21swapper/212:40:012
2229499280,28cyclictest0-21swapper/111:20:111
2229499280,0cyclictest24831-21apt-get07:15:111
2229499280,0cyclictest0-21swapper/107:50:131
22289992827,1cyclictest1537-21apt-get11:00:140
2228999280,1cyclictest22933-21munin-run08:20:010
2228999280,0cyclictest6189-21apt-get11:10:120
22300992727,0cyclictest0-21swapper/311:30:123
22300992727,0cyclictest0-21swapper/310:40:113
22300992727,0cyclictest0-21swapper/309:50:133
22300992727,0cyclictest0-21swapper/309:15:143
22300992725,1cyclictest3570-21cron11:05:013
22299992727,0cyclictest0-21swapper/209:15:132
22294992727,0cyclictest0-21swapper/111:10:121
22294992727,0cyclictest0-21swapper/108:10:101
22289992727,0cyclictest21424-21apt-get09:25:110
22289992727,0cyclictest21424-21apt-get09:25:110
22289992727,0cyclictest0-21swapper/010:20:100
22289992727,0cyclictest0-21swapper/009:55:000
22289992727,0cyclictest0-21swapper/007:40:140
2228999270,0cyclictest0-21swapper/012:05:140
2228999270,0cyclictest0-21swapper/010:30:130
2228999270,0cyclictest0-21swapper/009:00:120
22300992626,0cyclictest0-21swapper/310:00:123
22300992626,0cyclictest0-21swapper/309:10:103
22300992625,1cyclictest8259-21munin-run11:15:013
22299992626,0cyclictest0-21swapper/211:10:122
22299992625,0cyclictest0-21swapper/211:30:122
22294992626,0cyclictest24334-21apt-get10:40:111
22294992626,0cyclictest0-21swapper/109:50:131
22294992624,2cyclictest1493-21cron12:10:001
22294992624,1cyclictest303-21systemd-journal08:55:011
22289992626,0cyclictest0-21swapper/011:35:130
22289992624,1cyclictest3832-21cron12:15:010
22300992525,0cyclictest0-21swapper/311:15:123
22300992525,0cyclictest0-21swapper/309:05:133
22300992525,0cyclictest0-21swapper/308:55:113
22299992525,0cyclictest0-21swapper/210:40:112
22299992525,0cyclictest0-21swapper/209:50:132
22299992524,1cyclictest3568-21cron11:05:012
22299992523,1cyclictest7400-21munin-run10:05:002
22299992523,1cyclictest7089-21cron08:55:012
22294992525,0cyclictest0-21swapper/111:30:121
22294992525,0cyclictest0-21swapper/109:15:141
22294992524,1cyclictest7398-21perf10:05:001
22294992523,1cyclictest3579-21awk11:05:011
22289992525,0cyclictest0-21swapper/011:45:150
22289992525,0cyclictest0-21swapper/011:15:110
22289992525,0cyclictest0-21swapper/009:15:130
22289992525,0cyclictest0-21swapper/007:55:100
22289992523,1cyclictest303-21systemd-journal10:45:000
22300992424,0cyclictest0-21swapper/309:45:133
22300992424,0cyclictest0-21swapper/308:35:093
22300992424,0cyclictest0-21swapper/307:40:143
22300992422,1cyclictest15464-21cron12:40:013
22299992423,1cyclictest1496-21cron12:10:002
22294992424,0cyclictest0-21swapper/109:10:101
22294992423,1cyclictest30165-21apt-get08:35:091
22294992423,1cyclictest12047-21apt-get09:05:131
22289992424,0cyclictest21979-21apt-get10:35:100
22300992323,0cyclictest0-21swapper/312:20:133
22300992323,0cyclictest0-21swapper/312:15:123
22300992323,0cyclictest0-21swapper/310:25:133
22300992323,0cyclictest0-21swapper/310:15:113
22299992323,0cyclictest0-21swapper/211:15:122
22299992323,0cyclictest0-21swapper/209:10:102
22299992322,0cyclictest4499-21apt-get07:40:142
22294992323,0cyclictest8512-21apt-get11:15:121
22294992323,0cyclictest0-21swapper/108:55:111
22289992322,1cyclictest30494-21munin-run09:45:010
22289992321,1cyclictest29803-21apt-get07:25:120
22300992222,0cyclictest0-21swapper/311:20:113
22300992222,0cyclictest0-21swapper/308:30:113
22300992222,0cyclictest0-21swapper/307:35:133
22299992222,0cyclictest0-21swapper/209:05:132
22299992222,0cyclictest0-21swapper/208:55:112
22299992222,0cyclictest0-21swapper/208:35:092
22299992220,1cyclictest0-21swapper/208:30:112
22294992222,0cyclictest0-21swapper/109:45:131
22294992222,0cyclictest0-21swapper/107:40:141
22289992222,0cyclictest6822-21apt-get07:45:130
22289992222,0cyclictest0-21swapper/007:20:130
22300992121,0cyclictest0-21swapper/307:55:113
22300992120,0cyclictest9147-21apt-get07:50:133
22299992121,0cyclictest30754-21apt-get09:45:132
22299992121,0cyclictest0-21swapper/210:15:112
22299992120,0cyclictest0-21swapper/210:25:132
22294992121,0cyclictest4116-21apt-get12:15:121
22294992121,0cyclictest0-21swapper/112:20:131
22294992121,0cyclictest0-21swapper/110:25:131
22294992121,0cyclictest0-21swapper/110:15:111
22294992121,0cyclictest0-21swapper/108:30:111
22294992120,1cyclictest2042-21apt-get07:35:131
22289992119,1cyclictest0-21swapper/007:35:010
2230099208,1cyclictest151rcu_preempt11:25:173
22299992020,0cyclictest6468-21apt-get12:20:132
22299992020,0cyclictest0-21swapper/212:15:122
22299992019,0cyclictest0-21swapper/211:20:112
22294992019,1cyclictest11466-21apt-get07:55:111
22289992020,0cyclictest0-21swapper/010:10:130
22300991919,0cyclictest31601-21awk12:05:013
22300991917,1cyclictest609-21dbus-daemon09:30:003
22300991917,1cyclictest609-21dbus-daemon09:30:003
22299991919,0cyclictest0-21swapper/207:35:132
22299991917,1cyclictest31603-21cron12:05:012
22294991918,1cyclictest22-21ksoftirqd/112:05:011
22300991818,0cyclictest0-21swapper/311:50:123
22300991817,1cyclictest26383-21apt-get10:45:013
22300991816,1cyclictest303-21systemd-journal10:15:013
22299991818,0cyclictest0-21swapper/207:55:112
22294991815,2cyclictest303-21systemd-journal09:30:001
22294991815,2cyclictest303-21systemd-journal09:30:001
22300991717,0cyclictest0-21swapper/308:10:103
22294991714,2cyclictest12016-21awk10:15:011
22289991717,0cyclictest0-21swapper/009:10:000
22300991614,1cyclictest0-21swapper/309:35:173
22299991614,1cyclictest0-21swapper/212:10:172
22299991614,1cyclictest0-21swapper/210:55:012
22299991613,2cyclictest12019-21cron10:15:012
22294991616,0cyclictest0-21swapper/111:50:121
22294991615,0cyclictest0-21swapper/110:45:011
2229499160,15cyclictest9028-21cat07:50:011
2228999160,15cyclictest4567-21taskset08:47:400
2230099153,10cyclictest1796-21sendmail-mta11:40:043
2230099150,1cyclictest0-21swapper/310:22:493
22299991515,0cyclictest24891-21apt-get11:50:122
22299991514,1cyclictest0-21swapper/209:30:002
22299991514,1cyclictest0-21swapper/209:30:002
2229999150,14cyclictest0-21swapper/211:59:232
22294991514,1cyclictest0-21swapper/109:40:011
2229499150,5cyclictest0-21swapper/107:30:121
2229499150,14cyclictest0-21swapper/110:35:011
2228999157,8cyclictest31588-21munin-node11:30:520
22289991513,1cyclictest7110-21sh12:20:150
22289991513,1cyclictest31209-21ntp_states08:35:140
22289991512,2cyclictest5070-21munin-run10:00:000
2228999150,1cyclictest19504-21ntp_states08:10:160
2228999150,1cyclictest0-21swapper/009:10:120
22300991414,0cyclictest0-21swapper/312:33:193
22300991414,0cyclictest0-21swapper/309:02:133
22300991413,1cyclictest0-21swapper/310:55:193
2230099140,14cyclictest20161-21snmpd11:07:413
2230099140,14cyclictest0-21swapper/312:25:263
2230099140,14cyclictest0-21swapper/311:55:023
2230099140,14cyclictest0-21swapper/311:37:193
2230099140,14cyclictest0-21swapper/310:52:343
2230099140,14cyclictest0-21swapper/310:30:133
2230099140,14cyclictest0-21swapper/310:05:533
2230099140,14cyclictest0-21swapper/309:40:063
2230099140,14cyclictest0-21swapper/308:40:403
2230099140,14cyclictest0-21swapper/308:28:143
2230099140,14cyclictest0-21swapper/308:22:043
2230099140,14cyclictest0-21swapper/308:15:333
2230099140,14cyclictest0-21swapper/308:00:313
2230099140,14cyclictest0-21swapper/307:30:543
2230099140,14cyclictest0-21swapper/307:25:543
2230099140,14cyclictest0-21swapper/307:20:073
2230099140,14cyclictest0-21swapper/307:13:223
2230099140,0cyclictest0-21swapper/312:10:143
2230099140,0cyclictest0-21swapper/311:46:553
2230099140,0cyclictest0-21swapper/310:36:223
2230099140,0cyclictest0-21swapper/309:55:213
2230099140,0cyclictest0-21swapper/309:31:363
2230099140,0cyclictest0-21swapper/309:22:083
2230099140,0cyclictest0-21swapper/308:48:123
2230099140,0cyclictest0-21swapper/308:05:063
22299991414,0cyclictest0-21swapper/210:45:012
22299991413,0cyclictest27180-21apt-get07:20:132
2229999140,14cyclictest0-21swapper/212:32:152
2229999140,14cyclictest0-21swapper/211:25:362
2229999140,14cyclictest0-21swapper/211:05:532
2229999140,14cyclictest0-21swapper/210:56:172
2229999140,14cyclictest0-21swapper/210:33:202
2229999140,14cyclictest0-21swapper/210:20:392
2229999140,14cyclictest0-21swapper/210:07:452
2229999140,14cyclictest0-21swapper/209:58:192
2229999140,14cyclictest0-21swapper/209:43:162
2229999140,14cyclictest0-21swapper/209:35:332
2229999140,14cyclictest0-21swapper/209:30:252
2229999140,14cyclictest0-21swapper/209:22:162
2229999140,14cyclictest0-21swapper/209:03:102
2229999140,14cyclictest0-21swapper/208:41:282
2229999140,14cyclictest0-21swapper/208:27:012
2229999140,14cyclictest0-21swapper/208:20:382
2229999140,14cyclictest0-21swapper/208:05:412
2229999140,14cyclictest0-21swapper/208:00:222
2229999140,14cyclictest0-21swapper/207:25:302
2229999140,14cyclictest0-21swapper/207:11:502
2229999140,0cyclictest0-21swapper/212:25:502
2229999140,0cyclictest0-21swapper/211:45:382
2229999140,0cyclictest0-21swapper/211:40:022
2229999140,0cyclictest0-21swapper/210:35:312
2229999140,0cyclictest0-21swapper/207:47:132
2229999140,0cyclictest0-21swapper/207:33:192
22294991414,0cyclictest0-21swapper/112:31:131
22294991414,0cyclictest0-21swapper/112:25:061
22294991414,0cyclictest0-21swapper/112:10:121
22294991414,0cyclictest0-21swapper/109:55:231
22294991414,0cyclictest0-21swapper/108:25:351
22294991414,0cyclictest0-21swapper/107:25:271
22294991414,0cyclictest0-21swapper/107:20:131
2229499140,14cyclictest0-21swapper/111:55:411
2229499140,14cyclictest0-21swapper/111:45:551
2229499140,14cyclictest0-21swapper/111:40:031
2229499140,14cyclictest0-21swapper/111:35:441
2229499140,14cyclictest0-21swapper/111:05:261
2229499140,14cyclictest0-21swapper/110:20:251
2229499140,14cyclictest0-21swapper/110:05:181
2229499140,14cyclictest0-21swapper/109:40:551
2229499140,14cyclictest0-21swapper/109:20:551
2229499140,14cyclictest0-21swapper/109:01:111
2229499140,14cyclictest0-21swapper/108:40:341
2229499140,14cyclictest0-21swapper/108:20:441
2229499140,14cyclictest0-21swapper/108:06:191
2229499140,0cyclictest0-21swapper/111:25:361
2229499140,0cyclictest0-21swapper/110:55:271
2229499140,0cyclictest0-21swapper/110:50:061
2229499140,0cyclictest0-21swapper/110:30:201
2229499140,0cyclictest0-21swapper/109:30:251
2229499140,0cyclictest0-21swapper/108:15:381
2229499140,0cyclictest0-21swapper/108:00:061
2229499140,0cyclictest0-21swapper/107:11:501
22289991414,0cyclictest0-21swapper/010:45:100
22289991414,0cyclictest0-21swapper/010:25:080
22289991414,0cyclictest0-21swapper/009:30:270
2228999140,14cyclictest0-21swapper/012:01:270
2228999140,14cyclictest0-21swapper/011:50:100
2228999140,14cyclictest0-21swapper/011:40:050
2228999140,14cyclictest0-21swapper/011:25:460
2228999140,14cyclictest0-21swapper/011:21:190
2228999140,14cyclictest0-21swapper/011:06:110
2228999140,14cyclictest0-21swapper/010:56:220
2228999140,14cyclictest0-21swapper/009:45:490
2228999140,14cyclictest0-21swapper/009:35:030
2228999140,14cyclictest0-21swapper/008:57:110
2228999140,14cyclictest0-21swapper/008:30:000
2228999140,14cyclictest0-21swapper/008:27:440
2228999140,14cyclictest0-21swapper/008:05:350
2228999140,14cyclictest0-21swapper/007:51:070
2228999140,14cyclictest0-21swapper/007:35:100
2228999140,0cyclictest0-21swapper/012:35:250
2228999140,0cyclictest0-21swapper/012:32:260
2228999140,0cyclictest0-21swapper/012:25:220
2228999140,0cyclictest0-21swapper/011:55:020
2228999140,0cyclictest0-21swapper/010:15:270
2228999140,0cyclictest0-21swapper/010:05:110
2228999140,0cyclictest0-21swapper/010:00:240
2228999140,0cyclictest0-21swapper/008:51:260
2228999140,0cyclictest0-21swapper/008:20:070
2228999140,0cyclictest0-21swapper/007:15:090
2228999140,0cyclictest0-21swapper/007:12:070
22300991313,0cyclictest0-21swapper/307:45:283
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional