You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-18 - 10:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Tue Nov 18, 2025 00:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
128572201186,10sleep10-21swapper/119:07:121
129122185167,13sleep00-21swapper/019:07:510
126982181164,12sleep30-21swapper/319:05:263
129712174156,13sleep20-21swapper/219:08:382
247072430,0sleep00-21swapper/021:33:320
290272390,0sleep10-21swapper/100:18:411
13302100,0sleep20-21swapper/222:10:172
132669991,4cyclictest19044-21perf20:25:000
3496280,0sleep00-21swapper/000:38:350
132669982,3cyclictest31613-21perf20:50:000
132669982,3cyclictest28975-21awk19:39:590
1056280,0sleep10-21swapper/121:37:441
132789970,6cyclictest0-21swapper/220:50:132
132789970,1cyclictest14190-21ntp_states23:05:212
30002260,0sleep329995-21apt-get21:20:123
132839960,5cyclictest31845-21apt-get19:45:013
132839960,5cyclictest0-21swapper/319:50:143
12586260,0sleep10-21swapper/122:32:091
132839951,3cyclictest6330-21sed22:45:213
132839950,5cyclictest0-21swapper/300:30:123
132839950,4cyclictest24213-21apt-get19:30:013
132789955,0cyclictest0-21swapper/223:00:072
132789954,1cyclictest0-21swapper/220:41:352
132789951,2cyclictest0-21swapper/219:35:132
132789950,5cyclictest11409-21ssh21:42:572
132789950,5cyclictest0-21swapper/223:29:562
132789950,5cyclictest0-21swapper/200:35:142
132789950,4cyclictest14295-21apt-get20:15:132
132789950,4cyclictest0-21swapper/220:00:122
132789950,0cyclictest18000-21ssh23:23:592
132789950,0cyclictest0-21swapper/221:16:222
132709951,2cyclictest0-21swapper/123:55:121
132709951,2cyclictest0-21swapper/123:30:121
132709951,2cyclictest0-21swapper/122:50:121
132709951,2cyclictest0-21swapper/121:30:131
132709951,2cyclictest0-21swapper/121:00:131
132709951,2cyclictest0-21swapper/100:10:111
132669950,5cyclictest18416-21ssh00:13:160
132669950,5cyclictest0-21swapper/023:57:410
132669950,5cyclictest0-21swapper/022:49:010
132669950,5cyclictest0-21swapper/020:15:040
132669950,5cyclictest0-21swapper/000:28:050
132669950,4cyclictest21909-21apt-get20:30:010
132669950,1cyclictest9515-21basename23:20:000
9955240,0sleep20-21swapper/200:25:162
132839944,0cyclictest10409-21sh21:25:513
132839943,1cyclictest4121-21munin-run20:59:593
132839943,1cyclictest30004-21/usr/sbin/munin23:30:133
132839943,1cyclictest24398-21/usr/sbin/munin20:35:203
132839943,1cyclictest17955-21cat23:40:173
132839942,2cyclictest0-21swapper/322:00:163
132839942,1cyclictest11960-21wc00:10:123
132839940,4cyclictest9032-21apt-get00:25:123
132839940,4cyclictest19998-21perl20:25:163
132839940,4cyclictest18226-21df22:35:143
132839940,4cyclictest0-21swapper/323:35:123
132839940,4cyclictest0-21swapper/323:05:003
132839940,4cyclictest0-21swapper/322:55:143
132839940,4cyclictest0-21swapper/322:50:133
132839940,4cyclictest0-21swapper/322:14:193
132839940,4cyclictest0-21swapper/321:52:023
132839940,4cyclictest0-21swapper/321:43:183
132839940,4cyclictest0-21swapper/321:35:153
132839940,4cyclictest0-21swapper/321:10:163
132839940,4cyclictest0-21swapper/321:00:153
132839940,4cyclictest0-21swapper/320:15:203
132839940,4cyclictest0-21swapper/320:10:133
132839940,4cyclictest0-21swapper/300:23:113
132839940,4cyclictest0-21swapper/300:00:113
132839940,3cyclictest7824-21sh00:07:493
132839940,3cyclictest5676-21ssh21:55:523
132839940,3cyclictest4403-21sh23:16:463
132839940,3cyclictest30055-21sh23:45:483
132839940,3cyclictest28527-21sh00:35:023
132839940,3cyclictest24606-21sh21:33:283
132839940,3cyclictest24497-21/usr/sbin/munin22:05:223
132839940,3cyclictest24497-21/usr/sbin/munin22:05:223
132839940,3cyclictest24338-21ssh21:16:513
132839940,3cyclictest23309-21sh21:49:093
132839940,3cyclictest20096-21sh23:57:333
132839940,3cyclictest19787-21latency_hist22:20:003
132839940,3cyclictest16121-21ntp_states19:15:023
132839940,3cyclictest13183-21sh22:32:323
132839940,2cyclictest22620-21/usr/sbin/munin23:10:143
132839940,1cyclictest3507-21hddtemp_smartct23:00:163
132839940,1cyclictest29357-21/usr/sbin/munin20:45:193
132839940,1cyclictest29193-21/usr/sbin/munin19:40:223
132839940,1cyclictest20194-21/usr/sbin/munin23:25:163
132789944,0cyclictest0-21swapper/223:55:592
132789944,0cyclictest0-21swapper/222:40:282
132789944,0cyclictest0-21swapper/222:27:312
132789942,1cyclictest20105-21ssh22:20:112
132789941,1cyclictest0-21swapper/221:00:122
132789941,1cyclictest0-21swapper/220:05:142
132789940,4cyclictest31437-21munin-run19:45:002
132789940,4cyclictest0-21swapper/223:50:152
132789940,4cyclictest0-21swapper/223:45:062
132789940,4cyclictest0-21swapper/222:55:312
132789940,4cyclictest0-21swapper/222:30:352
132789940,4cyclictest0-21swapper/222:15:172
132789940,4cyclictest0-21swapper/222:05:142
132789940,4cyclictest0-21swapper/222:05:142
132789940,4cyclictest0-21swapper/222:00:122
132789940,4cyclictest0-21swapper/221:55:132
132789940,4cyclictest0-21swapper/221:50:152
132789940,4cyclictest0-21swapper/221:45:122
132789940,4cyclictest0-21swapper/221:35:052
132789940,4cyclictest0-21swapper/221:30:202
132789940,4cyclictest0-21swapper/221:10:162
132789940,4cyclictest0-21swapper/220:45:132
132789940,4cyclictest0-21swapper/220:35:152
132789940,4cyclictest0-21swapper/220:20:122
132789940,4cyclictest0-21swapper/200:10:112
132789940,4cyclictest0-21swapper/200:05:112
132789940,4cyclictest0-21swapper/200:00:102
132789940,3cyclictest22626-21ssh23:10:112
132789940,3cyclictest22324-21ssh00:31:122
132789940,3cyclictest15190-21ssh22:50:132
132789940,3cyclictest0-21swapper/221:25:162
132789940,3cyclictest0-21swapper/221:20:132
132709944,0cyclictest0-21swapper/123:36:571
132709941,2cyclictest0-21swapper/123:25:151
132709941,2cyclictest0-21swapper/123:00:131
132709941,2cyclictest0-21swapper/122:45:161
132709941,2cyclictest0-21swapper/122:25:011
132709941,2cyclictest0-21swapper/121:55:141
132709941,2cyclictest0-21swapper/121:40:121
132709941,2cyclictest0-21swapper/121:20:131
132709941,2cyclictest0-21swapper/121:05:141
132709941,2cyclictest0-21swapper/120:55:161
132709941,2cyclictest0-21swapper/120:40:131
132709941,2cyclictest0-21swapper/120:30:121
132709941,2cyclictest0-21swapper/120:20:111
132709941,2cyclictest0-21swapper/119:55:141
132709941,2cyclictest0-21swapper/119:50:141
132709941,2cyclictest0-21swapper/119:45:151
132709941,2cyclictest0-21swapper/119:40:151
132709941,2cyclictest0-21swapper/119:25:121
132709941,2cyclictest0-21swapper/119:10:141
132709941,2cyclictest0-21swapper/100:35:151
132709941,1cyclictest0-21swapper/123:40:151
132709941,1cyclictest0-21swapper/122:20:121
132709941,1cyclictest0-21swapper/122:00:121
132709940,4cyclictest0-21swapper/123:53:241
132709940,4cyclictest0-21swapper/123:22:411
132709940,4cyclictest0-21swapper/121:51:281
132709940,3cyclictest0-21swapper/123:15:141
132709940,2cyclictest0-21swapper/121:25:161
132709940,0cyclictest0-21swapper/100:00:051
132669944,0cyclictest0-21swapper/023:26:240
132669944,0cyclictest0-21swapper/022:05:310
132669944,0cyclictest0-21swapper/022:05:310
132669944,0cyclictest0-21swapper/021:20:150
132669944,0cyclictest0-21swapper/000:20:400
132669944,0cyclictest0-21swapper/000:05:510
132669941,2cyclictest19068-21cat19:20:010
132669940,4cyclictest9272-21diskmemload22:55:140
132669940,4cyclictest21493-21apt-get20:29:590
132669940,4cyclictest0-21swapper/023:43:500
132669940,4cyclictest0-21swapper/022:51:060
132669940,4cyclictest0-21swapper/022:42:490
132669940,4cyclictest0-21swapper/022:35:130
132669940,4cyclictest0-21swapper/022:30:130
132669940,4cyclictest0-21swapper/022:20:120
132669940,4cyclictest0-21swapper/021:25:460
132669940,4cyclictest0-21swapper/021:05:430
132669940,4cyclictest0-21swapper/020:02:150
132669940,4cyclictest0-21swapper/000:15:120
132669940,3cyclictest9272-21diskmemload21:35:150
132669940,3cyclictest3152-21df23:00:140
132669940,3cyclictest26202-21ssh21:50:180
132669940,3cyclictest24720-21latency_hist21:50:000
132669940,1cyclictest9666-21latency_hist22:15:000
132669940,1cyclictest31428-21latency_hist19:45:000
132669940,1cyclictest14731-21munin-run21:45:010
132669940,0cyclictest0-21swapper/023:08:310
132669940,0cyclictest0-21swapper/022:02:280
132839931,1cyclictest21562-21apt-get19:25:133
132839931,1cyclictest20099-21apt-get22:20:123
132839931,1cyclictest0-21swapper/320:40:133
132839930,3cyclictest9505-21apt-get23:20:013
132839930,3cyclictest9348-21apt-get20:05:133
132839930,3cyclictest7979-21if_eth121:05:183
132839930,3cyclictest4391-21apt19:55:153
132839930,3cyclictest29947-21cat22:25:023
132839930,3cyclictest27353-21sh22:40:033
132839930,3cyclictest26701-21apt19:35:133
132839930,3cyclictest17246-21expr20:20:133
132839930,3cyclictest14643-21ntpq19:10:203
132839930,3cyclictest0-21swapper/323:50:113
132839930,3cyclictest0-21swapper/320:50:163
132839930,3cyclictest0-21swapper/320:30:113
132839930,3cyclictest0-21swapper/320:00:133
132839930,3cyclictest0-21swapper/319:20:153
132839930,1cyclictest21675-21ssh00:15:123
132789933,0cyclictest31-21ksoftirqd/219:15:002
132789932,1cyclictest714-21snmpd19:25:082
132789932,1cyclictest13062-21tr20:10:182
132789931,1cyclictest17113-21cron22:35:012
132789930,3cyclictest5096-21grep19:55:172
132789930,3cyclictest5087-21ssh22:45:102
132789930,3cyclictest31359-21ssh00:20:042
132789930,3cyclictest19792-21perl19:20:172
132789930,3cyclictest1921-21apt-get19:50:142
132789930,3cyclictest17295-21ssh23:40:072
132789930,3cyclictest0-21swapper/223:35:112
132789930,3cyclictest0-21swapper/223:30:032
132789930,3cyclictest0-21swapper/223:15:012
132789930,3cyclictest0-21swapper/221:05:102
132789930,3cyclictest0-21swapper/220:55:162
132789930,3cyclictest0-21swapper/220:30:012
132789930,3cyclictest0-21swapper/220:25:132
132789930,3cyclictest0-21swapper/219:45:142
132789930,3cyclictest0-21swapper/219:30:122
132789930,3cyclictest0-21swapper/219:10:142
132789930,1cyclictest21683-21apt-get00:15:122
132709932,1cyclictest0-21swapper/100:25:131
132709931,2cyclictest0-21swapper/120:10:141
132709931,1cyclictest0-21swapper/123:14:071
132709931,1cyclictest0-21swapper/122:40:161
132709931,1cyclictest0-21swapper/122:05:141
132709931,1cyclictest0-21swapper/122:05:131
132709931,1cyclictest0-21swapper/121:45:121
132709931,1cyclictest0-21swapper/121:15:131
132709931,1cyclictest0-21swapper/120:50:131
132709931,1cyclictest0-21swapper/120:45:131
132709931,1cyclictest0-21swapper/120:25:131
132709931,1cyclictest0-21swapper/120:15:131
132709931,1cyclictest0-21swapper/119:30:011
132709931,1cyclictest0-21swapper/119:15:121
132709931,1cyclictest0-21swapper/100:30:121
132709931,1cyclictest0-21swapper/100:20:121
132709931,1cyclictest0-21swapper/100:05:121
132709930,2cyclictest32762-21chrt23:47:311
132709930,2cyclictest25182-21chrt22:38:501
132709930,2cyclictest0-21swapper/122:15:171
132709930,2cyclictest0-21swapper/121:10:151
132669932,1cyclictest714-21snmpd23:10:120
132669931,2cyclictest3841-21cat21:55:180
132669931,1cyclictest0-21swapper/023:35:120
132669931,1cyclictest0-21swapper/020:55:160
132669931,1cyclictest0-21swapper/019:10:140
132669930,3cyclictest5892-21irqstats23:50:190
132669930,3cyclictest30012-21apt-get23:30:100
132669930,3cyclictest29545-21apt-get22:25:020
132669930,3cyclictest10172-21ssh21:10:170
132669930,3cyclictest0-21swapper/023:45:100
132669930,3cyclictest0-21swapper/023:20:030
132669930,3cyclictest0-21swapper/022:15:060
132669930,3cyclictest0-21swapper/021:15:130
132669930,3cyclictest0-21swapper/021:00:130
132669930,3cyclictest0-21swapper/020:50:120
132669930,3cyclictest0-21swapper/020:40:130
132669930,3cyclictest0-21swapper/020:35:160
132669930,3cyclictest0-21swapper/020:10:130
132669930,3cyclictest0-21swapper/020:05:140
132669930,3cyclictest0-21swapper/019:55:050
132669930,3cyclictest0-21swapper/019:50:140
132669930,3cyclictest0-21swapper/019:45:010
132669930,3cyclictest0-21swapper/019:30:010
132669930,3cyclictest0-21swapper/019:25:130
132669930,3cyclictest0-21swapper/019:20:150
132669930,3cyclictest0-21swapper/000:30:120
132669930,3cyclictest0-21swapper/000:00:070
132709922,0cyclictest0-21swapper/119:35:161
132709921,1cyclictest0-21swapper/123:05:011
132709921,1cyclictest0-21swapper/120:05:141
132709920,1cyclictest32534-21chrt22:10:081
132709920,1cyclictest0-21swapper/122:55:131
132709920,1cyclictest0-21swapper/120:35:161
132709920,1cyclictest0-21swapper/120:00:121
132709920,1cyclictest0-21swapper/119:20:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional