You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-03 - 18:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Wed Sep 03, 2025 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1900699321,30cyclictest14277-21cron11:35:013
19002993027,2cyclictest32150-21awk09:55:012
19006992927,2cyclictest30412-21perf11:00:003
1900699290,28cyclictest0-21swapper/307:15:113
19002992927,1cyclictest0-21swapper/209:50:012
1900299290,28cyclictest7314-21perf11:20:012
1900299290,28cyclictest609-21dbus-daemon07:15:002
1900299290,28cyclictest23119-21apt-get09:35:132
1900299290,28cyclictest10473-21apt-get12:35:112
1900299290,28cyclictest0-21swapper/210:20:112
18998992927,1cyclictest609-21dbus-daemon09:10:001
18998992927,1cyclictest13459-21perf09:14:591
1899899290,28cyclictest0-21swapper/111:15:011
18993992928,1cyclictest0-21swapper/010:10:010
1899399290,28cyclictest30944-21apt-get12:10:130
1899399290,28cyclictest15201-21cron08:10:020
19006992827,1cyclictest7302-21cron11:20:003
1900699280,27cyclictest18711-21apt-get10:35:103
1900699280,0cyclictest0-21swapper/312:15:163
18998992828,0cyclictest0-21swapper/110:20:111
18998992826,1cyclictest14297-21perf11:35:001
18998992826,1cyclictest0-21swapper/108:00:011
1899899280,28cyclictest0-21swapper/107:40:131
1899899280,0cyclictest0-21swapper/112:10:141
18993992827,1cyclictest16081-21apt-get09:20:120
18993992827,0cyclictest0-21swapper/009:00:130
1899399280,28cyclictest0-21swapper/010:15:120
1899399280,0cyclictest0-21swapper/012:05:130
1899399280,0cyclictest0-21swapper/011:00:130
1900699270,0cyclictest0-21swapper/311:55:133
1900699270,0cyclictest0-21swapper/309:30:003
19002992727,0cyclictest0-21swapper/211:55:142
19002992727,0cyclictest0-21swapper/211:35:002
19002992727,0cyclictest0-21swapper/208:15:132
19002992727,0cyclictest0-21swapper/207:15:112
1900299270,27cyclictest0-21swapper/208:00:002
1900299270,0cyclictest0-21swapper/209:14:592
18998992727,0cyclictest16911-21apt-get11:40:121
18998992727,0cyclictest0-21swapper/112:35:121
18998992727,0cyclictest0-21swapper/112:20:121
18998992727,0cyclictest0-21swapper/109:15:111
18993992727,0cyclictest0-21swapper/011:30:130
18993992727,0cyclictest0-21swapper/011:10:120
18993992727,0cyclictest0-21swapper/010:35:090
19006992626,0cyclictest0-21swapper/312:20:133
19006992626,0cyclictest0-21swapper/307:40:143
19006992623,2cyclictest303-21systemd-journal08:10:013
19002992626,0cyclictest29558-21apt-get08:40:132
19002992626,0cyclictest0-21swapper/212:00:142
19002992625,1cyclictest0-21swapper/212:10:142
18998992626,0cyclictest29856-21perf09:50:001
18998992625,1cyclictest609-21dbus-daemon09:55:001
18998992625,1cyclictest26297-21apt-get12:00:141
18998992625,1cyclictest23949-21apt-get11:55:141
18998992625,1cyclictest21562-21apt-get07:15:121
18993992624,1cyclictest24621-21munin-run08:30:000
19006992525,0cyclictest0-21swapper/311:40:013
19006992524,1cyclictest0-21swapper/308:15:133
19002992525,0cyclictest6763-21apt-get09:00:142
19002992525,0cyclictest0-21swapper/211:45:112
19002992524,0cyclictest20794-21apt-get09:30:112
19002992523,1cyclictest3269-21cron07:45:012
19002992523,1cyclictest303-21systemd-journal12:35:002
19002992523,1cyclictest17538-21idleruntime-cro08:15:022
18998992525,0cyclictest0-21swapper/108:15:121
19006992424,0cyclictest0-21swapper/312:10:143
19006992424,0cyclictest0-21swapper/311:50:143
19006992424,0cyclictest0-21swapper/311:00:123
19006992424,0cyclictest0-21swapper/310:20:103
19006992424,0cyclictest0-21swapper/309:00:143
19002992424,0cyclictest0-21swapper/207:30:152
18998992424,0cyclictest0-21swapper/109:00:131
18998992424,0cyclictest0-21swapper/108:40:141
18998992422,1cyclictest17528-21cron08:15:021
18993992424,0cyclictest0-21swapper/012:35:120
18993992424,0cyclictest0-21swapper/012:15:150
18993992424,0cyclictest0-21swapper/010:45:120
18993992424,0cyclictest0-21swapper/007:40:130
18993992422,1cyclictest9905-21apt-get12:35:010
19006992323,0cyclictest0-21swapper/312:35:113
19006992323,0cyclictest0-21swapper/312:05:123
19006992323,0cyclictest0-21swapper/311:40:123
19006992323,0cyclictest0-21swapper/310:15:113
19002992323,0cyclictest0-21swapper/208:50:122
19002992322,1cyclictest7592-21apt-get11:20:122
19002992322,1cyclictest3199-21apt-get12:20:132
19002992322,0cyclictest28621-21apt-get12:05:142
18998992323,0cyclictest0-21swapper/111:45:121
18998992323,0cyclictest0-21swapper/109:30:121
18998992323,0cyclictest0-21swapper/107:30:151
18998992322,1cyclictest9889-21cron12:35:001
18993992323,0cyclictest0-21swapper/011:15:110
19006992222,0cyclictest0-21swapper/308:39:593
19006992221,1cyclictest609-21dbus-daemon10:10:013
19002992222,0cyclictest0-21swapper/208:25:122
19002992221,1cyclictest7586-21munin-run12:30:002
19006992121,0cyclictest0-21swapper/308:55:123
19002992120,0cyclictest2922-21apt-get11:10:132
18998992121,0cyclictest2087-21apt-get08:50:121
18998992121,0cyclictest0-21swapper/111:20:121
18993992120,1cyclictest4158-21munin-run08:55:000
19006992020,0cyclictest0-21swapper/311:10:123
19006992020,0cyclictest0-21swapper/309:20:123
19006992018,1cyclictest0-21swapper/310:45:123
19002992019,1cyclictest2940-21munin-run12:20:022
18998992020,0cyclictest0-21swapper/112:05:131
18998992020,0cyclictest0-21swapper/108:25:121
18993992020,0cyclictest0-21swapper/011:40:130
18993992018,1cyclictest609-21dbus-daemon09:40:010
18993992018,1cyclictest30374-21cron11:00:010
18993992018,1cyclictest23100-21cron10:45:010
19002991919,0cyclictest24888-21apt-get08:30:152
19002991919,0cyclictest0-21swapper/209:05:152
18998991919,0cyclictest5245-21apt-get11:15:121
18998991919,0cyclictest0-21swapper/112:30:001
19002991818,0cyclictest0-21swapper/210:35:102
18998991818,0cyclictest0-21swapper/112:20:011
18998991818,0cyclictest0-21swapper/109:35:131
18998991818,0cyclictest0-21swapper/108:30:151
18993991818,0cyclictest0-21swapper/011:55:140
19006991717,0cyclictest0-21swapper/308:30:003
19006991715,1cyclictest0-21swapper/312:35:013
1900699170,9cyclictest23562-21fschecks_count09:35:143
19002991715,1cyclictest0-21swapper/211:10:012
18998991717,0cyclictest0-21swapper/110:35:091
18993991717,0cyclictest28566-21apt-get07:30:140
18993991717,0cyclictest0-21swapper/009:15:120
18993991717,0cyclictest0-21swapper/007:20:110
18993991717,0cyclictest0-21swapper/007:15:120
18993991716,1cyclictest16617-21sendmail-msp11:40:010
18993991716,1cyclictest1-21systemd09:45:000
18993991715,1cyclictest9632-21cron11:25:000
18993991715,1cyclictest0-21swapper/010:55:010
19006991614,1cyclictest0-21swapper/308:30:173
1900299165,5cyclictest607-21irqbalance08:07:072
18993991616,0cyclictest0-21swapper/008:15:120
18993991614,1cyclictest23683-21perf11:55:010
19006991513,1cyclictest0-21swapper/309:50:173
1900699150,14cyclictest0-21swapper/308:20:133
19002991513,1cyclictest0-21swapper/210:00:132
1900299150,1cyclictest25713-21apt-get10:50:092
1900299150,1cyclictest12073-21munin-run11:30:022
1900299150,14cyclictest0-21swapper/210:05:142
1900299150,14cyclictest0-21swapper/208:46:422
1900299150,14cyclictest0-21swapper/208:00:202
18998991513,1cyclictest15206-21grep11:35:181
18998991513,1cyclictest0-21swapper/110:30:171
18998991513,1cyclictest0-21swapper/109:30:011
1899899150,1cyclictest6790-21latency_hist10:10:001
1899899150,1cyclictest13595-21df_inode08:05:141
1899399150,14cyclictest0-21swapper/010:10:150
1899399150,12cyclictest607-21irqbalance09:31:560
19006991414,0cyclictest0-21swapper/310:25:163
19006991414,0cyclictest0-21swapper/309:33:333
19006991414,0cyclictest0-21swapper/309:05:513
19006991414,0cyclictest0-21swapper/308:46:393
19006991412,1cyclictest0-21swapper/309:55:233
1900699140,14cyclictest0-21swapper/312:03:063
1900699140,14cyclictest0-21swapper/311:47:563
1900699140,14cyclictest0-21swapper/311:23:263
1900699140,14cyclictest0-21swapper/309:41:083
1900699140,14cyclictest0-21swapper/309:15:513
1900699140,14cyclictest0-21swapper/308:50:213
1900699140,14cyclictest0-21swapper/308:40:003
1900699140,14cyclictest0-21swapper/308:02:063
1900699140,14cyclictest0-21swapper/307:57:333
1900699140,14cyclictest0-21swapper/307:50:053
1900699140,14cyclictest0-21swapper/307:36:363
1900699140,14cyclictest0-21swapper/307:20:543
1900699140,14cyclictest0-21swapper/307:12:203
1900699140,13cyclictest27778-21apt-get10:55:013
1900699140,0cyclictest0-21swapper/311:29:243
1900699140,0cyclictest0-21swapper/311:05:093
1900699140,0cyclictest0-21swapper/310:42:153
1900699140,0cyclictest0-21swapper/307:45:403
1900699140,0cyclictest0-21swapper/307:30:053
19002991414,0cyclictest32437-21apt-get09:55:132
1900299140,14cyclictest0-21swapper/211:40:152
1900299140,14cyclictest0-21swapper/211:35:362
1900299140,14cyclictest0-21swapper/210:30:172
1900299140,14cyclictest0-21swapper/210:17:452
1900299140,14cyclictest0-21swapper/209:41:062
1900299140,14cyclictest0-21swapper/209:29:052
1900299140,14cyclictest0-21swapper/209:19:562
1900299140,14cyclictest0-21swapper/208:57:032
1900299140,14cyclictest0-21swapper/208:37:152
1900299140,14cyclictest0-21swapper/208:20:132
1900299140,14cyclictest0-21swapper/207:52:372
1900299140,14cyclictest0-21swapper/207:35:062
1900299140,14cyclictest0-21swapper/207:24:432
1900299140,0cyclictest0-21swapper/210:10:002
1900299140,0cyclictest0-21swapper/207:49:152
1900299140,0cyclictest0-21swapper/207:25:402
18998991414,0cyclictest0-21swapper/110:40:201
18998991414,0cyclictest0-21swapper/110:10:011
18998991414,0cyclictest0-21swapper/109:55:431
18998991414,0cyclictest0-21swapper/107:52:451
18998991414,0cyclictest0-21swapper/107:35:331
1899899140,14cyclictest0-21swapper/111:25:131
1899899140,14cyclictest0-21swapper/111:07:181
1899899140,14cyclictest0-21swapper/110:50:091
1899899140,14cyclictest0-21swapper/110:29:411
1899899140,14cyclictest0-21swapper/108:39:091
1899899140,14cyclictest0-21swapper/107:21:041
1899899140,14cyclictest0-21swapper/107:11:591
1899899140,0cyclictest0-21swapper/111:50:181
1899899140,0cyclictest0-21swapper/111:00:271
1899899140,0cyclictest0-21swapper/110:50:001
1899899140,0cyclictest0-21swapper/110:00:031
1899899140,0cyclictest0-21swapper/109:40:041
1899899140,0cyclictest0-21swapper/109:20:101
1899899140,0cyclictest0-21swapper/108:56:221
1899899140,0cyclictest0-21swapper/108:46:201
1899899140,0cyclictest0-21swapper/108:23:051
1899899140,0cyclictest0-21swapper/108:00:161
1899899140,0cyclictest0-21swapper/107:45:141
1899899140,0cyclictest0-21swapper/107:26:121
18993991414,0cyclictest0-21swapper/010:20:100
18993991414,0cyclictest0-21swapper/009:51:030
18993991414,0cyclictest0-21swapper/009:49:090
18993991414,0cyclictest0-21swapper/008:35:170
18993991414,0cyclictest0-21swapper/007:45:410
18993991412,1cyclictest20056-21unixbench_multi09:25:220
1899399140,14cyclictest0-21swapper/012:27:500
1899399140,14cyclictest0-21swapper/011:45:510
1899399140,14cyclictest0-21swapper/011:25:210
1899399140,14cyclictest0-21swapper/010:31:560
1899399140,14cyclictest0-21swapper/010:25:530
1899399140,14cyclictest0-21swapper/010:01:250
1899399140,14cyclictest0-21swapper/009:10:190
1899399140,14cyclictest0-21swapper/008:55:330
1899399140,14cyclictest0-21swapper/008:46:340
1899399140,14cyclictest0-21swapper/008:30:070
1899399140,14cyclictest0-21swapper/007:55:590
1899399140,14cyclictest0-21swapper/007:50:020
1899399140,14cyclictest0-21swapper/007:12:500
1899399140,0cyclictest0-21swapper/012:01:390
1899399140,0cyclictest0-21swapper/009:59:450
1899399140,0cyclictest0-21swapper/009:06:280
1899399140,0cyclictest0-21swapper/008:41:170
1899399140,0cyclictest0-21swapper/008:20:070
1899399140,0cyclictest0-21swapper/008:10:010
1899399140,0cyclictest0-21swapper/007:35:380
1899399140,0cyclictest0-21swapper/007:25:290
19006991313,0cyclictest0-21swapper/310:01:073
19006991313,0cyclictest0-21swapper/309:45:143
19006991313,0cyclictest0-21swapper/309:10:213
19006991313,0cyclictest0-21swapper/308:10:033
1900699130,13cyclictest0-21swapper/310:30:043
1900699130,13cyclictest0-21swapper/307:25:503
1900699130,0cyclictest0-21swapper/312:25:033
1900699130,0cyclictest0-21swapper/310:10:423
19002991313,0cyclictest0-21swapper/211:50:062
19002991313,0cyclictest0-21swapper/211:02:142
19002991313,0cyclictest0-21swapper/210:55:062
19002991313,0cyclictest0-21swapper/210:28:092
19002991313,0cyclictest0-21swapper/209:20:252
1900299130,0cyclictest0-21swapper/210:45:452
1899899130,13cyclictest0-21swapper/110:15:401
18993991313,0cyclictest0-21swapper/011:07:440
18993991313,0cyclictest0-21swapper/008:00:160
19002991212,0cyclictest0-21swapper/210:40:372
18998991212,0cyclictest0-21swapper/110:55:051
18993991212,0cyclictest0-21swapper/012:22:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional