You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-09 - 21:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Fri May 09, 2025 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1365499333,1cyclictest303-21systemd-journal07:15:021
13664993027,2cyclictest25572-21sh08:45:013
1366499300,28cyclictest303-21systemd-journal12:15:013
13659993028,1cyclictest0-21swapper/210:15:212
1365499300,2cyclictest4429-21cron11:25:001
1366499290,29cyclictest34-21ksoftirqd/310:20:143
1366499290,28cyclictest0-21swapper/312:25:123
1366499290,28cyclictest0-21swapper/308:50:143
1366499290,1cyclictest0-21swapper/311:55:013
1365999290,28cyclictest0-21swapper/211:35:142
1365999290,28cyclictest0-21swapper/211:25:092
1365499290,28cyclictest30102-21apt-get11:10:141
1365499290,28cyclictest27264-21apt-get09:55:131
1365499290,1cyclictest609-21dbus-daemon11:45:011
1365099290,28cyclictest6978-21perf08:05:020
1366499280,0cyclictest0-21swapper/309:55:123
1365999280,28cyclictest0-21swapper/208:25:142
1365499280,0cyclictest18573-21apt-get07:20:131
1365499280,0cyclictest0-21swapper/111:00:141
13650992828,0cyclictest0-21swapper/011:35:150
13650992828,0cyclictest0-21swapper/010:35:130
13650992828,0cyclictest0-21swapper/008:40:130
1365099280,28cyclictest0-21swapper/008:05:140
1365099280,0cyclictest0-21swapper/008:25:130
13664992727,0cyclictest0-21swapper/312:00:153
13664992727,0cyclictest0-21swapper/311:45:163
13664992727,0cyclictest0-21swapper/310:05:123
13664992727,0cyclictest0-21swapper/309:25:103
13664992726,1cyclictest20810-21munin-run12:00:023
13664992725,1cyclictest24383-21munin-run09:50:003
13659992727,0cyclictest0-21swapper/212:00:162
13659992727,0cyclictest0-21swapper/208:05:132
13659992727,0cyclictest0-21swapper/207:50:132
1365999270,0cyclictest23537-21apt-get08:40:132
1365999270,0cyclictest0-21swapper/211:55:152
13654992727,0cyclictest0-21swapper/112:10:141
13654992727,0cyclictest0-21swapper/107:35:141
13654992725,1cyclictest0-21swapper/107:55:011
1365499270,0cyclictest0-21swapper/108:20:121
13650992727,0cyclictest0-21swapper/012:00:140
13650992727,0cyclictest0-21swapper/011:25:100
1365099270,27cyclictest0-21swapper/007:50:120
1365099270,0cyclictest0-21swapper/010:20:140
13664992626,0cyclictest0-21swapper/311:35:143
13664992626,0cyclictest0-21swapper/311:25:103
13664992626,0cyclictest0-21swapper/311:20:133
13664992626,0cyclictest0-21swapper/310:35:123
13664992626,0cyclictest0-21swapper/309:15:133
13664992626,0cyclictest0-21swapper/308:20:113
13654992626,0cyclictest0-21swapper/110:30:121
13654992626,0cyclictest0-21swapper/109:40:111
13654992626,0cyclictest0-21swapper/109:10:111
13650992626,0cyclictest0-21swapper/010:00:120
13650992626,0cyclictest0-21swapper/008:15:130
13664992525,0cyclictest7240-21apt-get08:05:133
13664992525,0cyclictest0-21swapper/312:30:133
13664992525,0cyclictest0-21swapper/310:45:153
13664992525,0cyclictest0-21swapper/309:50:113
13664992525,0cyclictest0-21swapper/309:00:123
13664992525,0cyclictest0-21swapper/308:45:133
13659992525,0cyclictest11877-21apt-get08:15:122
13659992524,1cyclictest29906-21apt-get10:00:132
13659992523,1cyclictest6954-21sh08:05:012
13654992525,0cyclictest0-21swapper/108:40:131
13650992525,0cyclictest0-21swapper/012:25:130
13650992525,0cyclictest0-21swapper/010:10:140
13650992525,0cyclictest0-21swapper/009:15:010
13650992524,1cyclictest13909-21apt-get07:10:130
13664992424,0cyclictest0-21swapper/312:05:033
13664992424,0cyclictest0-21swapper/310:55:133
13659992424,0cyclictest0-21swapper/212:25:122
13659992424,0cyclictest0-21swapper/210:10:152
13659992423,0cyclictest7469-21apt-get09:15:022
13654992424,0cyclictest30491-21apt-get08:55:111
13654992424,0cyclictest0-21swapper/111:15:121
13654992424,0cyclictest0-21swapper/111:05:121
13654992422,1cyclictest32695-21cron12:25:001
13650992424,0cyclictest0-21swapper/009:05:140
13650992421,2cyclictest26963-21cron09:55:000
13664992323,0cyclictest0-21swapper/309:30:123
13659992323,0cyclictest0-21swapper/209:05:152
13659992323,0cyclictest0-21swapper/207:10:142
13654992323,0cyclictest372-21apt-get09:00:131
13654992322,1cyclictest11227-21perf10:30:011
13654992322,0cyclictest0-21swapper/109:45:121
13659992221,1cyclictest24939-21apt-get09:50:122
13659992221,1cyclictest14091-21apt-get11:45:172
13659992220,1cyclictest32559-21munin-run08:59:592
13654992222,0cyclictest0-21swapper/108:00:121
13654992221,1cyclictest0-21swapper/112:15:121
13650992222,0cyclictest19997-21apt-get09:40:120
13650992222,0cyclictest0-21swapper/011:45:160
13650992222,0cyclictest0-21swapper/010:40:110
13650992222,0cyclictest0-21swapper/010:25:150
13650992222,0cyclictest0-21swapper/008:40:000
13650992222,0cyclictest0-21swapper/008:30:130
13650992222,0cyclictest0-21swapper/007:40:130
13650992221,1cyclictest32546-21perf09:00:000
13664992121,0cyclictest0-21swapper/308:00:023
13659992121,0cyclictest23274-21perf08:40:012
13659992121,0cyclictest16156-21apt-get10:40:102
13659992121,0cyclictest0-21swapper/209:40:112
13659992121,0cyclictest0-21swapper/208:30:142
13659992120,1cyclictest18485-21apt-get10:45:162
13659992120,1cyclictest15032-21apt-get09:30:122
13654992121,0cyclictest7093-21apt-get11:30:121
13654992121,0cyclictest16221-21apt-get07:15:101
13654992120,1cyclictest23121-21apt-get10:55:121
13650992121,0cyclictest0-21swapper/010:45:150
13650992121,0cyclictest0-21swapper/009:30:130
13650992118,2cyclictest303-21systemd-journal08:55:010
1366499203,6cyclictest28379-21cpu12:15:133
13664992020,0cyclictest0-21swapper/311:15:123
13664992020,0cyclictest0-21swapper/309:12:463
13664992020,0cyclictest0-21swapper/309:05:143
13664992019,1cyclictest27494-21awk11:05:013
13659992020,0cyclictest0-21swapper/210:25:142
13659992020,0cyclictest0-21swapper/207:40:142
13654992020,0cyclictest0-21swapper/107:40:141
13654992020,0cyclictest0-21swapper/107:30:141
13654992019,1cyclictest17664-21apt-get09:35:141
13650992018,1cyclictest2533-21perf09:04:590
13664991919,0cyclictest0-21swapper/307:40:573
13659991917,1cyclictest609-21dbus-daemon08:55:002
13659991917,1cyclictest2536-21munin-run09:05:002
13650991919,0cyclictest0-21swapper/012:05:130
13650991919,0cyclictest0-21swapper/010:50:130
13664991818,0cyclictest0-21swapper/310:50:133
13659991818,0cyclictest0-21swapper/212:05:132
13659991818,0cyclictest0-21swapper/210:50:142
13654991818,0cyclictest0-21swapper/110:00:131
1366499170,17cyclictest0-21swapper/311:07:123
1366499170,17cyclictest0-21swapper/310:44:473
1366499170,17cyclictest0-21swapper/308:30:283
1366499170,17cyclictest0-21swapper/307:45:393
1366499170,17cyclictest0-21swapper/307:23:173
1366499170,17cyclictest0-21swapper/307:12:043
1366499170,0cyclictest0-21swapper/311:40:473
13654991717,0cyclictest0-21swapper/110:50:131
13654991717,0cyclictest0-21swapper/109:50:021
13650991717,0cyclictest0-21swapper/012:15:130
13664991614,1cyclictest20902-21memory09:40:153
13664991614,1cyclictest13938-21sendmail-msp08:20:003
1366499160,0cyclictest0-21swapper/309:37:393
13654991616,0cyclictest0-21swapper/112:35:131
13654991613,2cyclictest6803-21idleruntime-cro11:30:001
13650991616,0cyclictest0-21swapper/011:55:140
13650991616,0cyclictest0-21swapper/011:50:140
1365099160,15cyclictest607-21irqbalance09:23:510
13664991513,1cyclictest21484-21gltestperf07:25:153
1366499150,1cyclictest6502-21awk08:00:223
1366499150,15cyclictest44-21kcompactd007:34:273
1366499150,0cyclictest0-21swapper/312:36:483
13659991515,0cyclictest0-21swapper/212:15:122
13659991514,1cyclictest6849-21apt-get10:20:132
13659991514,0cyclictest16407-21apt-get11:50:152
13659991513,1cyclictest0-21swapper/211:00:222
1365999150,14cyclictest6662-21find12:35:212
1365999150,14cyclictest0-21swapper/207:15:152
13654991513,1cyclictest21080-21tr07:25:141
1365499150,1cyclictest0-21swapper/109:30:171
13650991514,1cyclictest0-21swapper/011:00:210
13650991513,1cyclictest0-21swapper/008:20:110
13650991513,1cyclictest0-21swapper/007:55:180
1365099150,1cyclictest0-21swapper/012:35:200
1365099150,14cyclictest0-21swapper/011:40:140
13664991414,0cyclictest0-21swapper/311:10:453
13664991414,0cyclictest0-21swapper/308:25:133
13664991414,0cyclictest0-21swapper/308:10:113
13664991412,1cyclictest583-21diskstats07:50:143
13664991412,1cyclictest0-21swapper/311:30:133
1366499140,14cyclictest0-21swapper/312:23:513
1366499140,14cyclictest0-21swapper/310:31:013
1366499140,14cyclictest0-21swapper/310:25:443
1366499140,14cyclictest0-21swapper/310:16:543
1366499140,14cyclictest0-21swapper/310:11:133
1366499140,14cyclictest0-21swapper/310:00:583
1366499140,14cyclictest0-21swapper/308:59:563
1366499140,14cyclictest0-21swapper/308:35:303
1366499140,14cyclictest0-21swapper/307:38:373
1366499140,14cyclictest0-21swapper/307:15:073
1366499140,0cyclictest0-21swapper/309:20:123
13659991414,0cyclictest13819-21apt-get10:35:122
13659991414,0cyclictest0-21swapper/211:07:122
13659991414,0cyclictest0-21swapper/209:57:202
13659991414,0cyclictest0-21swapper/208:46:292
13659991412,1cyclictest14234-21cpu08:20:122
1365999140,14cyclictest0-21swapper/212:30:112
1365999140,14cyclictest0-21swapper/212:20:122
1365999140,14cyclictest0-21swapper/211:41:162
1365999140,14cyclictest0-21swapper/211:20:252
1365999140,14cyclictest0-21swapper/211:18:252
1365999140,14cyclictest0-21swapper/211:12:212
1365999140,14cyclictest0-21swapper/210:55:142
1365999140,14cyclictest0-21swapper/210:30:062
1365999140,14cyclictest0-21swapper/210:06:192
1365999140,14cyclictest0-21swapper/209:46:142
1365999140,14cyclictest0-21swapper/209:35:392
1365999140,14cyclictest0-21swapper/209:25:142
1365999140,14cyclictest0-21swapper/209:20:492
1365999140,14cyclictest0-21swapper/208:10:122
1365999140,14cyclictest0-21swapper/207:55:282
1365999140,14cyclictest0-21swapper/207:37:562
1365999140,14cyclictest0-21swapper/207:34:012
1365999140,14cyclictest0-21swapper/207:26:212
1365999140,14cyclictest0-21swapper/207:20:022
1365999140,0cyclictest0-21swapper/212:10:112
1365999140,0cyclictest0-21swapper/211:30:162
1365999140,0cyclictest0-21swapper/209:10:362
1365999140,0cyclictest0-21swapper/207:46:522
13654991414,0cyclictest0-21swapper/112:30:271
13654991414,0cyclictest0-21swapper/111:45:491
13654991414,0cyclictest0-21swapper/110:47:201
13654991414,0cyclictest0-21swapper/110:10:201
13654991414,0cyclictest0-21swapper/109:25:241
13654991414,0cyclictest0-21swapper/108:36:031
1365499140,14cyclictest0-21swapper/112:06:151
1365499140,14cyclictest0-21swapper/112:00:391
1365499140,14cyclictest0-21swapper/111:56:191
1365499140,14cyclictest0-21swapper/111:52:101
1365499140,14cyclictest0-21swapper/111:36:021
1365499140,14cyclictest0-21swapper/110:40:111
1365499140,14cyclictest0-21swapper/110:35:291
1365499140,14cyclictest0-21swapper/110:20:581
1365499140,14cyclictest0-21swapper/110:15:391
1365499140,14cyclictest0-21swapper/109:15:361
1365499140,14cyclictest0-21swapper/108:25:181
1365499140,14cyclictest0-21swapper/108:11:041
1365499140,14cyclictest0-21swapper/108:06:231
1365499140,14cyclictest0-21swapper/107:55:481
1365499140,0cyclictest0-21swapper/110:06:161
1365499140,0cyclictest0-21swapper/109:20:531
1365499140,0cyclictest0-21swapper/109:05:461
1365499140,0cyclictest0-21swapper/108:53:411
1365499140,0cyclictest0-21swapper/108:45:081
1365499140,0cyclictest0-21swapper/108:30:561
1365499140,0cyclictest0-21swapper/108:17:111
1365499140,0cyclictest0-21swapper/107:45:081
13650991414,0cyclictest0-21swapper/011:20:570
13650991414,0cyclictest0-21swapper/010:05:070
13650991414,0cyclictest0-21swapper/007:31:380
1365099140,14cyclictest0-21swapper/012:31:570
1365099140,14cyclictest0-21swapper/012:23:390
1365099140,14cyclictest0-21swapper/011:30:130
1365099140,14cyclictest0-21swapper/011:10:090
1365099140,14cyclictest0-21swapper/009:36:540
1365099140,14cyclictest0-21swapper/009:25:080
1365099140,14cyclictest0-21swapper/008:45:270
1365099140,14cyclictest0-21swapper/008:11:380
1365099140,14cyclictest0-21swapper/007:46:530
1365099140,0cyclictest17127-21memory07:15:140
1365099140,0cyclictest0-21swapper/012:10:050
1365099140,0cyclictest0-21swapper/011:17:290
1365099140,0cyclictest0-21swapper/011:05:040
1365099140,0cyclictest0-21swapper/010:55:260
1365099140,0cyclictest0-21swapper/010:30:250
1365099140,0cyclictest0-21swapper/010:15:320
1365099140,0cyclictest0-21swapper/009:55:370
1365099140,0cyclictest0-21swapper/009:46:040
1365099140,0cyclictest0-21swapper/009:10:410
1365099140,0cyclictest0-21swapper/007:35:110
1365099140,0cyclictest0-21swapper/007:21:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional