You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-13 - 04:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Sat Sep 13, 2025 00:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
176962203187,11sleep10-21swapper/119:05:061
196522197180,12sleep30-21swapper/319:06:373
196262190173,12sleep20-21swapper/219:06:162
196192188171,12sleep00-21swapper/019:06:090
21432440,0sleep00-21swapper/023:11:380
169082440,0sleep10-21swapper/122:46:321
200362120,0sleep10-21swapper/122:00:131
91752100,0sleep10-21swapper/121:55:001
78302100,1sleep20-21swapper/221:37:492
320872100,0sleep00-21swapper/022:22:060
234102100,0sleep30-21swapper/300:10:543
201179981,5cyclictest0-21swapper/319:55:143
201079972,4cyclictest0-21swapper/123:25:121
201079961,3cyclictest0-21swapper/123:45:121
201079961,3cyclictest0-21swapper/121:55:121
201029962,1cyclictest515-21in:imuxsock22:05:000
3985250,0sleep10-21swapper/122:08:181
32478250,0sleep032480-21latency_hist22:55:000
23865250,0sleep20-21swapper/223:22:452
23518250,0sleep00-21swapper/000:27:290
201179955,0cyclictest22678-21kworker/3:219:53:273
201179955,0cyclictest12977-21kworker/3:123:26:113
201179955,0cyclictest12977-21kworker/3:121:56:373
201179952,2cyclictest0-21swapper/320:35:133
201179950,5cyclictest0-21swapper/300:26:373
201179950,4cyclictest0-21swapper/300:05:133
201119950,5cyclictest0-21swapper/222:52:172
201119950,5cyclictest0-21swapper/222:40:022
201119950,5cyclictest0-21swapper/221:33:512
201119950,5cyclictest0-21swapper/200:20:122
201119950,0cyclictest0-21swapper/222:10:392
201079952,2cyclictest0-21swapper/122:10:121
201079951,3cyclictest0-21swapper/122:25:121
201079951,3cyclictest0-21swapper/121:15:121
201079951,3cyclictest0-21swapper/100:10:131
201079951,2cyclictest0-21swapper/122:30:151
201079951,2cyclictest0-21swapper/119:15:121
201079951,2cyclictest0-21swapper/100:35:111
201079951,2cyclictest0-21swapper/100:15:121
201029954,1cyclictest28687-21ssh00:14:140
201029950,5cyclictest0-21swapper/022:57:320
201029950,5cyclictest0-21swapper/021:44:050
201029950,0cyclictest0-21swapper/000:21:390
201179944,0cyclictest12977-21kworker/3:123:15:003
201179944,0cyclictest12977-21kworker/3:122:30:113
201179944,0cyclictest12977-21kworker/3:122:07:483
201179944,0cyclictest0-21swapper/322:00:143
201179944,0cyclictest0-21swapper/321:17:363
201179944,0cyclictest0-21swapper/300:17:013
201179942,1cyclictest26580-21ssh21:30:313
201179942,1cyclictest0-21swapper/320:50:113
201179941,3cyclictest7431-21unixbench-2d23:30:203
201179941,3cyclictest5110-21awk21:20:143
201179941,3cyclictest19160-21cat20:10:153
201179941,1cyclictest0-21swapper/321:00:143
201179941,1cyclictest0-21swapper/320:00:133
201179940,4cyclictest27202-21ssh22:20:123
201179940,4cyclictest19405-21ssh23:53:073
201179940,4cyclictest16064-21apt-get21:10:113
201179940,4cyclictest0-21swapper/323:57:503
201179940,4cyclictest0-21swapper/323:42:523
201179940,4cyclictest0-21swapper/323:15:133
201179940,4cyclictest0-21swapper/323:05:153
201179940,4cyclictest0-21swapper/323:00:133
201179940,4cyclictest0-21swapper/322:56:393
201179940,4cyclictest0-21swapper/322:50:103
201179940,4cyclictest0-21swapper/322:46:283
201179940,4cyclictest0-21swapper/322:39:573
201179940,4cyclictest0-21swapper/322:25:123
201179940,4cyclictest0-21swapper/322:10:123
201179940,4cyclictest0-21swapper/321:50:123
201179940,4cyclictest0-21swapper/321:47:003
201179940,4cyclictest0-21swapper/321:40:133
201179940,4cyclictest0-21swapper/321:39:413
201179940,4cyclictest0-21swapper/321:25:153
201179940,4cyclictest0-21swapper/321:05:123
201179940,4cyclictest0-21swapper/319:40:123
201179940,4cyclictest0-21swapper/319:25:133
201179940,4cyclictest0-21swapper/300:31:563
201179940,3cyclictest6230-21diskstats00:35:143
201179940,3cyclictest2956-21/usr/sbin/munin23:45:183
201179940,3cyclictest27401-21cat19:20:203
201179940,3cyclictest2599-21ssh22:40:013
201179940,3cyclictest24183-21ssh22:18:263
201179940,3cyclictest22940-21ssh23:38:463
201179940,3cyclictest10675-21ls21:00:003
201179940,3cyclictest0-21swapper/320:20:123
201179940,3cyclictest0-21swapper/319:30:113
201119944,0cyclictest0-21swapper/221:49:162
201119944,0cyclictest0-21swapper/200:31:042
201119944,0cyclictest0-21swapper/200:11:522
201119943,1cyclictest4496-21grep23:45:182
201119943,1cyclictest15855-21diskstats22:30:162
201119941,2cyclictest19770-21ssh21:44:002
201119941,2cyclictest0-21swapper/219:15:122
201119941,1cyclictest0-21swapper/200:00:092
201119940,4cyclictest17214-21ssh00:08:182
201119940,4cyclictest0-21swapper/223:52:542
201119940,4cyclictest0-21swapper/223:40:132
201119940,4cyclictest0-21swapper/223:18:452
201119940,4cyclictest0-21swapper/223:10:122
201119940,4cyclictest0-21swapper/222:59:242
201119940,4cyclictest0-21swapper/222:38:142
201119940,4cyclictest0-21swapper/222:25:022
201119940,4cyclictest0-21swapper/222:00:432
201119940,4cyclictest0-21swapper/221:28:182
201119940,4cyclictest0-21swapper/221:20:102
201119940,4cyclictest0-21swapper/220:25:132
201119940,4cyclictest0-21swapper/200:15:122
201119940,3cyclictest8273-21cat20:55:002
201119940,3cyclictest5658-21ssh00:35:122
201119940,3cyclictest28840-21hddtemp_smartct23:25:152
201119940,3cyclictest26948-21ssh22:20:022
201119940,3cyclictest10508-21ssh23:00:132
201119940,0cyclictest0-21swapper/223:56:172
201119940,0cyclictest0-21swapper/220:44:572
201079944,0cyclictest0-21swapper/123:22:301
201079944,0cyclictest0-21swapper/123:07:311
201079944,0cyclictest0-21swapper/122:52:321
201079942,1cyclictest0-21swapper/119:30:111
201079941,2cyclictest0-21swapper/123:55:121
201079941,2cyclictest0-21swapper/122:40:121
201079941,2cyclictest0-21swapper/121:35:171
201079941,2cyclictest0-21swapper/121:30:121
201079941,2cyclictest0-21swapper/121:00:141
201079941,2cyclictest0-21swapper/120:55:121
201079941,2cyclictest0-21swapper/120:40:091
201079941,2cyclictest0-21swapper/120:25:121
201079941,2cyclictest0-21swapper/120:20:121
201079941,2cyclictest0-21swapper/120:10:131
201079941,2cyclictest0-21swapper/119:40:121
201079941,2cyclictest0-21swapper/119:35:121
201079941,2cyclictest0-21swapper/100:30:141
201079941,2cyclictest0-21swapper/100:25:101
201079941,1cyclictest0-21swapper/120:05:141
201079941,1cyclictest0-21swapper/119:10:111
201079940,4cyclictest0-21swapper/121:23:191
201079940,3cyclictest0-21swapper/121:25:151
201079940,2cyclictest0-21swapper/123:40:111
201079940,1cyclictest0-21swapper/119:55:141
201079940,0cyclictest0-21swapper/123:02:171
201079940,0cyclictest0-21swapper/122:37:331
201029944,0cyclictest0-21swapper/021:12:290
201029944,0cyclictest0-21swapper/020:19:580
201029943,1cyclictest8350-21/usr/sbin/munin19:50:190
201029943,1cyclictest6110-21grep21:20:200
201029943,1cyclictest23224-21/usr/sbin/munin20:20:140
201029943,1cyclictest1974-21kworker/0:222:17:370
201029943,1cyclictest1973-21ntp_states20:40:150
201029941,3cyclictest1974-21kworker/0:221:05:170
201029941,2cyclictest714-21snmpd22:45:130
201029940,4cyclictest27741-21ssh23:08:390
201029940,4cyclictest0-21swapper/023:56:460
201029940,4cyclictest0-21swapper/023:52:080
201029940,4cyclictest0-21swapper/023:35:130
201029940,4cyclictest0-21swapper/023:15:130
201029940,4cyclictest0-21swapper/021:25:300
201029940,4cyclictest0-21swapper/019:35:130
201029940,4cyclictest0-21swapper/019:25:130
201029940,4cyclictest0-21swapper/000:07:110
201029940,3cyclictest8578-21sh23:30:590
201029940,3cyclictest679-21latency_hist19:35:010
201029940,3cyclictest26014-21perl22:35:150
201029940,3cyclictest21479-21ntp_states19:10:160
201029940,3cyclictest19968-21ssh22:32:020
201029940,3cyclictest11098-21sh22:44:110
201029940,3cyclictest0-21swapper/020:00:130
201029940,1cyclictest25939-21/usr/sbin/munin19:20:220
201029940,1cyclictest25441-21/usr/sbin/munin23:40:130
201029940,1cyclictest23446-21/usr/sbin/munin19:15:170
201029940,1cyclictest17968-21/usr/sbin/munin23:20:150
201029940,1cyclictest15782-21/usr/sbin/munin20:05:140
201029940,0cyclictest0-21swapper/023:45:590
201029940,0cyclictest0-21swapper/023:03:310
201029940,0cyclictest0-21swapper/022:11:260
201179932,1cyclictest714-21snmpd19:35:033
201179932,1cyclictest23017-21open_inodes19:15:003
201179932,1cyclictest21083-21cpuspeed_turbos20:15:123
201179932,1cyclictest16153-21expr20:05:153
201179931,2cyclictest0-21swapper/319:10:113
201179930,3cyclictest692-21apt-get20:40:093
201179930,3cyclictest26363-21perl20:25:153
201179930,3cyclictest1109-21grep00:00:123
201179930,3cyclictest0-21swapper/323:20:123
201179930,3cyclictest0-21swapper/320:45:123
201179930,3cyclictest0-21swapper/320:30:153
201179930,3cyclictest0-21swapper/319:45:103
201179930,3cyclictest0-21swapper/300:20:133
201119933,0cyclictest17835-21kworker/2:119:25:522
201119933,0cyclictest0-21swapper/223:30:142
201119932,1cyclictest0-21swapper/220:05:142
201119931,2cyclictest0-21swapper/223:05:132
201119931,1cyclictest0-21swapper/220:35:132
201119931,1cyclictest0-21swapper/220:15:112
201119931,1cyclictest0-21swapper/220:00:132
201119931,0cyclictest0-21swapper/200:25:092
201119930,3cyclictest8314-21apt-get20:55:122
201119930,3cyclictest6435-21uniq19:45:132
201119930,3cyclictest31734-21sh21:50:032
201119930,3cyclictest17460-21ntp_states21:10:172
201119930,3cyclictest10124-21df21:55:142
201119930,3cyclictest0-21swapper/223:35:052
201119930,3cyclictest0-21swapper/222:45:082
201119930,3cyclictest0-21swapper/222:15:102
201119930,3cyclictest0-21swapper/222:05:042
201119930,3cyclictest0-21swapper/221:15:012
201119930,3cyclictest0-21swapper/221:05:152
201119930,3cyclictest0-21swapper/221:00:142
201119930,3cyclictest0-21swapper/220:45:122
201119930,3cyclictest0-21swapper/220:30:132
201119930,3cyclictest0-21swapper/220:20:022
201119930,3cyclictest0-21swapper/220:10:132
201119930,3cyclictest0-21swapper/219:57:322
201119930,3cyclictest0-21swapper/219:50:112
201119930,3cyclictest0-21swapper/219:40:122
201119930,3cyclictest0-21swapper/219:35:082
201119930,3cyclictest0-21swapper/219:30:032
201119930,3cyclictest0-21swapper/219:20:142
201119930,3cyclictest0-21swapper/219:10:112
201079933,0cyclictest0-21swapper/122:15:071
201079931,2cyclictest0-21swapper/122:20:111
201079931,2cyclictest0-21swapper/119:45:111
201079931,1cyclictest0-21swapper/122:55:131
201079931,1cyclictest0-21swapper/121:45:151
201079931,1cyclictest0-21swapper/121:10:111
201079931,1cyclictest0-21swapper/121:05:121
201079931,1cyclictest0-21swapper/120:50:011
201079931,1cyclictest0-21swapper/120:45:121
201079931,1cyclictest0-21swapper/120:15:111
201079931,1cyclictest0-21swapper/120:00:121
201079931,1cyclictest0-21swapper/119:50:111
201079931,1cyclictest0-21swapper/119:20:131
201079931,1cyclictest0-21swapper/100:20:121
201079930,2cyclictest0-21swapper/123:50:111
201079930,2cyclictest0-21swapper/123:30:111
201079930,2cyclictest0-21swapper/120:35:131
201079930,1cyclictest0-21swapper/100:00:101
201029932,1cyclictest1974-21kworker/0:221:00:010
201029932,1cyclictest1974-21kworker/0:220:50:010
201029932,1cyclictest1974-21kworker/0:219:55:010
201029931,1cyclictest0-21swapper/022:25:010
201029930,3cyclictest32623-21sh00:00:020
201029930,3cyclictest31865-21sh21:50:090
201029930,3cyclictest31471-21hddtemp_smartct20:35:160
201029930,3cyclictest26132-21apt-get21:15:010
201029930,3cyclictest25921-21/usr/sbin/munin21:30:190
201029930,3cyclictest1902-21ssh21:35:140
201029930,3cyclictest0-21swapper/022:05:140
201029930,3cyclictest0-21swapper/021:55:120
201029930,3cyclictest0-21swapper/021:45:070
201029930,3cyclictest0-21swapper/020:55:120
201029930,3cyclictest0-21swapper/020:45:030
201029930,3cyclictest0-21swapper/020:30:130
201029930,3cyclictest0-21swapper/020:25:130
201029930,3cyclictest0-21swapper/020:10:120
201029930,3cyclictest0-21swapper/019:45:100
201029930,3cyclictest0-21swapper/019:40:130
201029930,3cyclictest0-21swapper/000:35:060
201029930,3cyclictest0-21swapper/000:30:140
201029930,2cyclictest30157-21ssh00:14:590
201029930,1cyclictest27924-21/usr/sbin/munin23:25:140
201079922,0cyclictest0-21swapper/100:05:071
201079921,1cyclictest0-21swapper/123:10:111
201079921,1cyclictest0-21swapper/120:30:131
201079920,1cyclictest7865-21chrt23:15:081
201079920,1cyclictest0-21swapper/123:35:131
201079920,1cyclictest0-21swapper/121:40:131
201079920,1cyclictest0-21swapper/119:25:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional