You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-06 - 17:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Sun Jul 06, 2025 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
125799300,29cyclictest24554-21awk11:25:002
1249993028,1cyclictest0-21swapper/010:00:000
124999300,29cyclictest29608-21cron08:10:010
124999300,29cyclictest24557-21cron11:25:000
1260992928,1cyclictest3291-21apt-get10:40:133
126099290,28cyclictest25258-21apt-get08:00:133
126099290,1cyclictest21385-21apt-get12:25:123
125799290,29cyclictest611-21avahi-daemon08:10:012
125799290,28cyclictest0-21swapper/208:25:122
125799290,1cyclictest24968-21sendmail-msp08:00:012
1254992928,1cyclictest27285-21cron08:05:011
125499290,28cyclictest6802-21apt-get11:55:131
125499290,28cyclictest29489-21apt-get11:35:151
125499290,28cyclictest11831-21apt-get08:40:121
124999290,28cyclictest22916-21apt-get07:55:150
124999290,28cyclictest0-21swapper/010:25:120
1260992828,0cyclictest2460-21apt-get08:20:113
1260992828,0cyclictest0-21swapper/309:00:133
1260992827,1cyclictest2991-21apt-get09:30:113
126099280,28cyclictest0-21swapper/310:50:133
126099280,27cyclictest0-21swapper/307:15:123
126099280,0cyclictest0-21swapper/308:15:163
1257992828,0cyclictest28657-21apt-get10:25:122
1257992827,0cyclictest15950-21apt-get07:40:152
1257992826,1cyclictest609-21dbus-daemon10:00:002
125799280,0cyclictest20591-21apt-get07:50:142
125499280,28cyclictest0-21swapper/109:05:131
125499280,0cyclictest0-21swapper/107:20:141
1249992827,0cyclictest0-21swapper/011:05:130
1249992826,1cyclictest9488-21apt-get08:35:120
124999280,28cyclictest0-21swapper/010:35:110
124999280,28cyclictest0-21swapper/007:40:150
124999280,0cyclictest0-21swapper/009:15:130
1260992727,0cyclictest0-21swapper/310:10:133
1260992727,0cyclictest0-21swapper/309:40:143
1260992727,0cyclictest0-21swapper/309:35:143
1260992727,0cyclictest0-21swapper/309:10:123
1260992727,0cyclictest0-21swapper/308:45:143
126099270,0cyclictest23768-21apt-get09:05:133
126099270,0cyclictest0-21swapper/307:35:133
1257992727,0cyclictest0-21swapper/211:25:172
1257992727,0cyclictest0-21swapper/211:05:132
1257992727,0cyclictest0-21swapper/210:35:102
1257992727,0cyclictest0-21swapper/208:35:132
1257992726,1cyclictest0-21swapper/210:05:002
125799270,0cyclictest28414-21apt-get09:15:132
1254992727,0cyclictest0-21swapper/112:25:141
1254992727,0cyclictest0-21swapper/111:50:161
1254992727,0cyclictest0-21swapper/110:10:131
1254992727,0cyclictest0-21swapper/109:20:161
1254992727,0cyclictest0-21swapper/108:15:161
1254992725,1cyclictest1534-21munin-run11:45:011
125499270,0cyclictest0-21swapper/112:00:031
125499270,0cyclictest0-21swapper/108:50:031
1249992727,0cyclictest19088-21perf10:05:000
1249992727,0cyclictest0-21swapper/008:20:020
1249992727,0cyclictest0-21swapper/007:30:000
124999270,0cyclictest0-21swapper/011:25:180
1260992626,0cyclictest0-21swapper/312:15:143
1260992626,0cyclictest0-21swapper/307:35:003
1257992624,1cyclictest25738-21cron12:35:012
1254992626,0cyclictest0-21swapper/110:40:131
1249992626,0cyclictest0-21swapper/008:40:120
1249992626,0cyclictest0-21swapper/008:30:120
1249992625,1cyclictest626-21gdbus12:35:010
1249992625,1cyclictest0-21swapper/011:30:120
1260992525,0cyclictest0-21swapper/312:05:133
1260992525,0cyclictest0-21swapper/312:00:043
1260992523,1cyclictest12101-21munin-run09:50:003
1260992523,1cyclictest0-21swapper/307:25:013
1257992525,0cyclictest0-21swapper/208:20:022
1257992525,0cyclictest0-21swapper/207:30:002
1257992524,1cyclictest7164-21apt-get08:30:132
1254992525,0cyclictest0-21swapper/112:10:151
1254992523,1cyclictest11562-21perf08:40:001
1260992424,0cyclictest29489-21apt-get11:35:133
1260992424,0cyclictest0-21swapper/310:00:123
1257992424,0cyclictest0-21swapper/208:40:122
1257992423,0cyclictest11176-21apt-get07:30:142
1254992424,0cyclictest0-21swapper/110:50:141
1254992423,1cyclictest19104-21apt-get08:55:141
1249992424,0cyclictest0-21swapper/011:45:140
1249992424,0cyclictest0-21swapper/010:30:130
1249992424,0cyclictest0-21swapper/007:30:150
1249992422,1cyclictest22208-21sh11:20:000
1260992323,0cyclictest0-21swapper/311:45:143
1257992323,0cyclictest27166-21apt-get11:30:122
1257992323,0cyclictest0-21swapper/210:30:132
1257992321,1cyclictest0-21swapper/211:20:002
1254992323,0cyclictest9218-21perf08:35:001
1254992323,0cyclictest0-21swapper/109:25:131
1254992323,0cyclictest0-21swapper/108:10:141
1249992323,0cyclictest0-21swapper/011:00:130
1249992323,0cyclictest0-21swapper/010:55:120
1260992222,0cyclictest0-21swapper/310:15:133
1257992222,0cyclictest1797-21apt-get11:45:152
1257992221,1cyclictest10564-21apt-get10:55:132
1254992222,0cyclictest0-21swapper/109:05:001
1254992222,0cyclictest0-21swapper/107:45:131
1254992220,1cyclictest609-21dbus-daemon11:05:011
1260992121,0cyclictest0-21swapper/311:40:143
1257992121,0cyclictest0-21swapper/211:00:142
1249992120,1cyclictest16154-21apt-get12:15:030
1260992020,0cyclictest14681-21apt-get09:55:113
1260992020,0cyclictest0-21swapper/308:30:113
1254992020,0cyclictest30718-21perf10:30:011
1254992020,0cyclictest0-21swapper/109:40:141
1254992019,1cyclictest0-21swapper/110:25:011
1249992020,0cyclictest21447-21apt-get09:00:140
1249992020,0cyclictest0-21swapper/012:20:150
126099196,0cyclictest34-21ksoftirqd/312:14:323
1260991919,0cyclictest640-21apt-get09:25:133
1257991919,0cyclictest19068-21apt-get12:20:142
1257991919,0cyclictest0-21swapper/209:00:132
125799190,6cyclictest0-21swapper/212:00:142
1249991919,0cyclictest0-21swapper/010:20:150
1249991918,1cyclictest352-21perf09:25:000
1260991818,0cyclictest0-21swapper/311:55:153
1260991816,1cyclictest0-21swapper/312:25:013
126099180,0cyclictest0-21swapper/309:15:233
1257991818,0cyclictest0-21swapper/212:15:022
1257991818,0cyclictest0-21swapper/210:20:152
1257991817,0cyclictest271rcuc/209:25:012
1249991817,1cyclictest0-21swapper/010:15:120
1260991715,1cyclictest12613-21sh11:00:013
126099170,0cyclictest0-21swapper/311:52:103
1254991717,0cyclictest0-21swapper/111:10:151
1249991717,0cyclictest12360-21apt-get09:50:140
1260991616,0cyclictest34-21ksoftirqd/310:45:133
1260991616,0cyclictest0-21swapper/311:10:153
126099160,15cyclictest5471-21gltestperf08:25:143
1257991616,0cyclictest0-21swapper/210:15:132
1257991616,0cyclictest0-21swapper/209:50:132
1257991615,1cyclictest11772-21apt-get12:05:132
1254991616,0cyclictest0-21swapper/111:00:011
1254991614,1cyclictest0-21swapper/108:50:001
125499160,15cyclictest28631-21ntp_states08:05:191
1249991616,0cyclictest0-21swapper/012:05:130
1249991616,0cyclictest0-21swapper/007:35:140
1249991614,1cyclictest0-21swapper/010:40:170
124999160,1cyclictest0-21swapper/011:55:010
124999160,1cyclictest0-21swapper/008:45:180
124999160,15cyclictest1670-21cut09:25:170
1260991515,0cyclictest0-21swapper/312:30:123
1260991515,0cyclictest0-21swapper/308:55:143
1260991513,1cyclictest31401-21df_inode10:30:143
1260991513,1cyclictest28403-21munin-run10:25:023
126099150,14cyclictest25330-21fschecks_count11:25:193
1257991515,0cyclictest0-21swapper/207:35:132
1257991513,1cyclictest0-21swapper/209:50:002
125799150,7cyclictest0-21swapper/210:40:122
125799150,1cyclictest6542-21perf11:55:012
125799150,1cyclictest15205-21ntp_states08:45:182
125799150,14cyclictest18487-21sed11:10:172
125799150,14cyclictest0-21swapper/209:25:172
1254991514,1cyclictest25749-21kworker/1:207:12:171
1254991514,1cyclictest19345-21apt-get10:05:121
1254991513,1cyclictest5087-21cron09:35:001
1254991513,1cyclictest19687-21grep12:20:161
125499150,4cyclictest0-21swapper/109:15:131
125499150,1cyclictest15662-21perf07:40:011
125499150,14cyclictest0-21swapper/110:30:131
1249991515,0cyclictest0-21swapper/010:10:170
1249991515,0cyclictest0-21swapper/007:20:020
1249991513,1cyclictest12115-21latency_hist09:50:000
124999150,15cyclictest18490-21gltestperf11:10:170
1260991413,1cyclictest0-21swapper/311:05:013
1260991413,0cyclictest34-21ksoftirqd/307:50:153
126099140,14cyclictest19006-21modprobe07:45:163
126099140,14cyclictest0-21swapper/311:31:423
126099140,14cyclictest0-21swapper/311:10:013
126099140,14cyclictest0-21swapper/310:35:163
126099140,14cyclictest0-21swapper/308:38:313
126099140,14cyclictest0-21swapper/308:05:573
126099140,14cyclictest0-21swapper/307:11:413
126099140,0cyclictest0-21swapper/312:37:383
126099140,0cyclictest0-21swapper/310:05:243
1257991414,0cyclictest0-21swapper/210:10:182
1257991414,0cyclictest0-21swapper/207:20:022
1257991413,1cyclictest27138-21ntp_states09:10:172
125799140,14cyclictest0-21swapper/211:59:222
125799140,14cyclictest0-21swapper/211:42:532
125799140,14cyclictest0-21swapper/211:36:282
125799140,14cyclictest0-21swapper/209:30:182
125799140,14cyclictest0-21swapper/209:07:062
125799140,14cyclictest0-21swapper/208:16:242
125799140,14cyclictest0-21swapper/207:45:212
125799140,0cyclictest6370-21strings09:35:172
125799140,0cyclictest0-21swapper/212:35:152
125799140,0cyclictest0-21swapper/212:25:152
125799140,0cyclictest0-21swapper/212:14:162
125799140,0cyclictest0-21swapper/210:52:302
125799140,0cyclictest0-21swapper/208:55:222
125799140,0cyclictest0-21swapper/208:54:452
125799140,0cyclictest0-21swapper/208:10:362
125799140,0cyclictest0-21swapper/207:16:132
125799140,0cyclictest0-21swapper/207:11:592
1254991414,0cyclictest0-21swapper/111:31:331
1254991414,0cyclictest0-21swapper/107:55:151
1254991412,1cyclictest17578-21latency_hist11:10:011
1254991412,1cyclictest0-21swapper/108:20:141
125499140,14cyclictest0-21swapper/112:30:371
125499140,14cyclictest0-21swapper/112:17:471
125499140,14cyclictest0-21swapper/111:45:361
125499140,14cyclictest0-21swapper/111:28:431
125499140,14cyclictest0-21swapper/111:22:381
125499140,14cyclictest0-21swapper/111:15:051
125499140,14cyclictest0-21swapper/110:39:371
125499140,14cyclictest0-21swapper/110:16:441
125499140,14cyclictest0-21swapper/109:37:471
125499140,14cyclictest0-21swapper/108:27:461
125499140,14cyclictest0-21swapper/107:53:131
125499140,14cyclictest0-21swapper/107:15:281
125499140,0cyclictest0-21swapper/112:38:201
125499140,0cyclictest0-21swapper/112:05:511
125499140,0cyclictest0-21swapper/110:03:461
125499140,0cyclictest0-21swapper/109:56:421
125499140,0cyclictest0-21swapper/109:10:211
125499140,0cyclictest0-21swapper/107:40:091
125499140,0cyclictest0-21swapper/107:25:221
124999143,9cyclictest607-21irqbalance10:49:300
1249991414,0cyclictest0-21swapper/012:35:210
1249991414,0cyclictest0-21swapper/012:10:150
1249991414,0cyclictest0-21swapper/011:40:130
1249991414,0cyclictest0-21swapper/009:35:190
1249991414,0cyclictest0-21swapper/008:56:020
1249991414,0cyclictest0-21swapper/008:10:200
124999140,14cyclictest0-21swapper/012:25:180
124999140,14cyclictest0-21swapper/012:00:110
124999140,14cyclictest0-21swapper/011:36:140
124999140,14cyclictest0-21swapper/010:05:170
124999140,14cyclictest0-21swapper/009:30:150
124999140,14cyclictest0-21swapper/008:25:130
124999140,14cyclictest0-21swapper/008:16:100
124999140,0cyclictest0-21swapper/011:55:520
124999140,0cyclictest0-21swapper/010:50:180
124999140,0cyclictest0-21swapper/009:40:030
124999140,0cyclictest0-21swapper/009:10:120
124999140,0cyclictest0-21swapper/009:05:430
124999140,0cyclictest0-21swapper/008:53:550
124999140,0cyclictest0-21swapper/008:01:580
124999140,0cyclictest0-21swapper/007:45:260
124999140,0cyclictest0-21swapper/007:15:100
124999140,0cyclictest0-21swapper/007:11:430
1260991313,0cyclictest0-21swapper/311:20:183
1260991313,0cyclictest0-21swapper/311:15:203
1260991313,0cyclictest0-21swapper/310:25:163
1260991313,0cyclictest0-21swapper/309:22:023
1260991313,0cyclictest0-21swapper/308:50:253
1260991313,0cyclictest0-21swapper/308:40:143
1260991313,0cyclictest0-21swapper/308:10:153
1260991313,0cyclictest0-21swapper/307:28:373
1260991312,1cyclictest0-21swapper/307:40:173
126099130,0cyclictest0-21swapper/309:51:113
1257991313,0cyclictest0-21swapper/208:00:462
125799130,13cyclictest0-21swapper/209:41:532
125799130,0cyclictest0-21swapper/210:05:162
1254991313,0cyclictest0-21swapper/110:45:351
1254991313,0cyclictest0-21swapper/109:51:031
1254991313,0cyclictest0-21swapper/109:46:281
1254991313,0cyclictest0-21swapper/107:30:201
1260991111,0cyclictest0-21swapper/307:56:313
1257991111,0cyclictest0-21swapper/210:45:572
1249991010,0cyclictest0-21swapper/007:50:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional