You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 13:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Sun Nov 23, 2025 00:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
215912202186,11sleep10-21swapper/119:08:271
215552192166,21sleep00-21swapper/019:07:590
216852187171,11sleep30-21swapper/319:09:433
216912171154,12sleep20-21swapper/219:09:452
170642480,0sleep10-21swapper/100:08:001
141122450,0sleep30-21swapper/323:34:093
109662450,0sleep10-21swapper/123:15:321
36242410,0sleep10-21swapper/121:50:381
309152410,0sleep10-21swapper/122:20:231
193982410,0sleep00-21swapper/000:25:180
28332360,0sleep10-21swapper/122:55:191
43222110,0sleep20-21swapper/223:12:382
12182100,0sleep10-21swapper/100:15:581
218879992,3cyclictest15055-21awk21:05:020
219019960,6cyclictest0-21swapper/322:25:133
218879960,3cyclictest4939-21munin-run00:35:000
218879960,3cyclictest12587-21perf21:00:010
17319260,0sleep317322-21gltestperf22:30:143
219019955,0cyclictest24437-21kworker/3:122:14:243
219019950,5cyclictest0-21swapper/321:49:043
219019950,5cyclictest0-21swapper/321:20:133
219019950,4cyclictest2925-21apt-get19:35:133
219019950,4cyclictest24237-21ssh21:12:583
219019950,4cyclictest17778-21apt-get20:05:143
219019950,3cyclictest0-21swapper/323:20:083
218969955,0cyclictest0-21swapper/223:07:012
218969950,5cyclictest31092-21ssh22:05:122
218969950,5cyclictest23764-21unixbench_multi19:10:232
218969950,5cyclictest0-21swapper/223:20:082
218969950,5cyclictest0-21swapper/221:32:092
218969950,5cyclictest0-21swapper/200:35:302
218969950,5cyclictest0-21swapper/200:30:072
218929951,2cyclictest0-21swapper/120:40:121
218929950,5cyclictest0-21swapper/122:43:521
218929950,5cyclictest0-21swapper/100:10:091
218929950,5cyclictest0-21swapper/100:02:251
218879955,0cyclictest0-21swapper/021:26:430
218879953,1cyclictest5457-21ssh00:35:120
218879950,5cyclictest0-21swapper/022:29:250
218879950,5cyclictest0-21swapper/021:31:570
218879950,4cyclictest1133-21ssh21:50:130
218879950,0cyclictest0-21swapper/023:28:290
218879950,0cyclictest0-21swapper/023:10:010
218879950,0cyclictest0-21swapper/022:17:120
3929240,0sleep00-21swapper/000:17:400
25611240,3sleep30-21swapper/322:18:233
22418240,0sleep20-21swapper/223:38:082
22222240,0sleep10-21swapper/122:49:221
219019944,0cyclictest24437-21kworker/3:123:55:123
219019944,0cyclictest24437-21kworker/3:123:10:243
219019944,0cyclictest24437-21kworker/3:121:18:253
219019944,0cyclictest24437-21kworker/3:100:06:243
219019944,0cyclictest0-21swapper/323:51:263
219019944,0cyclictest0-21swapper/321:44:343
219019943,1cyclictest28680-21irqstats20:25:183
219019943,1cyclictest25217-21/usr/sbin/munin20:20:193
219019943,1cyclictest13632-21hddtemp_smartct21:00:153
219019942,1cyclictest714-21snmpd20:14:593
219019942,1cyclictest12819-21/usr/sbin/munin19:55:213
219019941,3cyclictest55950irq/130-eth022:02:363
219019941,3cyclictest4142-21sh21:50:573
219019941,2cyclictest0-21swapper/323:05:113
219019941,1cyclictest0-21swapper/320:35:133
219019940,4cyclictest32672-21apt-get19:30:133
219019940,4cyclictest25941-21basename21:30:123
219019940,4cyclictest0-21swapper/323:15:133
219019940,4cyclictest0-21swapper/322:57:313
219019940,4cyclictest0-21swapper/322:45:123
219019940,4cyclictest0-21swapper/321:55:143
219019940,4cyclictest0-21swapper/321:05:143
219019940,4cyclictest0-21swapper/320:45:023
219019940,4cyclictest0-21swapper/320:40:223
219019940,4cyclictest0-21swapper/320:00:143
219019940,4cyclictest0-21swapper/319:25:223
219019940,4cyclictest0-21swapper/300:30:373
219019940,4cyclictest0-21swapper/300:21:453
219019940,4cyclictest0-21swapper/300:03:363
219019940,3cyclictest8755-21basename19:45:153
219019940,3cyclictest6008-21df00:35:133
219019940,3cyclictest4398-21perl21:35:183
219019940,3cyclictest4281-21sh22:07:343
219019940,3cyclictest3854-21ssh00:17:373
219019940,3cyclictest3503-21sh23:45:073
219019940,3cyclictest32332-21sh23:26:233
219019940,3cyclictest28250-21df19:20:133
219019940,3cyclictest27926-21ssh22:35:203
219019940,3cyclictest25313-21sh00:28:413
219019940,3cyclictest24936-21ls19:15:013
219019940,3cyclictest20711-21/usr/sbin/munin00:10:193
219019940,3cyclictest1612-21sh22:22:233
219019940,3cyclictest1217-21chrt23:43:573
219019940,3cyclictest11048-21perl19:50:143
219019940,1cyclictest7839-21/usr/sbin/munin20:50:143
219019940,1cyclictest15957-21/usr/sbin/munin21:25:233
219019940,0cyclictest0-21swapper/323:38:223
218969944,0cyclictest0-21swapper/223:47:032
218969944,0cyclictest0-21swapper/222:52:292
218969944,0cyclictest0-21swapper/221:41:552
218969944,0cyclictest0-21swapper/220:21:442
218969944,0cyclictest0-21swapper/219:16:152
218969944,0cyclictest0-21swapper/200:08:352
218969944,0cyclictest0-21swapper/200:03:122
218969943,1cyclictest17123-21grep20:00:222
218969942,1cyclictest32424-21cron19:30:012
218969941,2cyclictest0-21swapper/219:40:142
218969940,4cyclictest28796-21ssh21:15:162
218969940,4cyclictest0-21swapper/223:55:142
218969940,4cyclictest0-21swapper/223:52:072
218969940,4cyclictest0-21swapper/223:40:122
218969940,4cyclictest0-21swapper/223:25:132
218969940,4cyclictest0-21swapper/223:17:202
218969940,4cyclictest0-21swapper/223:00:022
218969940,4cyclictest0-21swapper/222:55:132
218969940,4cyclictest0-21swapper/222:38:002
218969940,4cyclictest0-21swapper/222:30:122
218969940,4cyclictest0-21swapper/222:25:132
218969940,4cyclictest0-21swapper/222:24:392
218969940,4cyclictest0-21swapper/222:15:002
218969940,4cyclictest0-21swapper/221:53:022
218969940,4cyclictest0-21swapper/221:45:232
218969940,4cyclictest0-21swapper/220:55:122
218969940,4cyclictest0-21swapper/220:40:042
218969940,4cyclictest0-21swapper/220:30:172
218969940,4cyclictest0-21swapper/200:25:122
218969940,4cyclictest0-21swapper/200:21:272
218969940,4cyclictest0-21swapper/200:17:222
218969940,3cyclictest4984-21/usr/sbin/munin21:35:212
218969940,3cyclictest345-21dpkg20:35:012
218969940,3cyclictest25478-21ssh22:01:482
218969940,3cyclictest21276-21ssh00:10:142
218969940,3cyclictest19118-21ssh21:26:032
218969940,3cyclictest15036-21latency_hist21:05:012
218969940,3cyclictest12802-21ssh22:44:422
218969940,3cyclictest0-21swapper/220:50:132
218969940,1cyclictest15708-21timerwakeupswit22:45:202
218969940,0cyclictest0-21swapper/223:30:532
218929944,0cyclictest0-21swapper/123:44:401
218929944,0cyclictest0-21swapper/122:32:221
218929944,0cyclictest0-21swapper/121:57:171
218929944,0cyclictest0-21swapper/100:38:401
218929942,1cyclictest0-21swapper/100:25:121
218929941,2cyclictest0-21swapper/123:55:151
218929941,2cyclictest0-21swapper/123:45:131
218929941,2cyclictest0-21swapper/123:25:141
218929941,2cyclictest0-21swapper/122:10:121
218929941,2cyclictest0-21swapper/120:55:131
218929941,2cyclictest0-21swapper/120:25:151
218929941,2cyclictest0-21swapper/100:20:141
218929940,4cyclictest0-21swapper/121:39:581
218929940,4cyclictest0-21swapper/120:08:431
218929940,0cyclictest0-21swapper/123:21:331
218929940,0cyclictest0-21swapper/121:30:571
218879944,0cyclictest3-21ksoftirqd/022:10:110
218879944,0cyclictest17730-21ssh21:41:410
218879944,0cyclictest111rcuc/022:25:010
218879944,0cyclictest0-21swapper/021:55:140
218879944,0cyclictest0-21swapper/021:15:300
218879944,0cyclictest0-21swapper/019:40:200
218879943,1cyclictest24347-21munin-node19:15:010
218879943,1cyclictest17962-21pmu-power22:30:180
218879942,1cyclictest17512-21munin-run21:10:020
218879941,3cyclictest0-21swapper/000:12:470
218879941,2cyclictest0-21swapper/021:45:130
218879941,2cyclictest0-21swapper/020:10:130
218879940,4cyclictest5902-21diskstats20:45:130
218879940,4cyclictest30157-21apt-get20:30:120
218879940,4cyclictest0-21swapper/023:50:100
218879940,4cyclictest0-21swapper/023:45:120
218879940,4cyclictest0-21swapper/023:43:030
218879940,4cyclictest0-21swapper/023:30:120
218879940,4cyclictest0-21swapper/023:05:110
218879940,4cyclictest0-21swapper/022:57:190
218879940,4cyclictest0-21swapper/022:45:070
218879940,4cyclictest0-21swapper/022:37:470
218879940,4cyclictest0-21swapper/021:35:150
218879940,4cyclictest0-21swapper/000:05:100
218879940,4cyclictest0-21swapper/000:00:150
218879940,3cyclictest4209-21ntpq19:35:240
218879940,3cyclictest31282-21grep22:05:120
218879940,3cyclictest31191-21irqstats19:25:170
218879940,3cyclictest28112-21sh22:51:470
218879940,3cyclictest25186-21cat20:20:000
218879940,3cyclictest20953-21sh23:37:120
218879940,3cyclictest13069-21ssh00:22:120
218879940,3cyclictest0-21swapper/022:40:010
218879940,3cyclictest0-21swapper/019:50:120
218879940,0cyclictest17509-21diskmemload23:17:430
8683230,0sleep10-21swapper/122:25:321
801230,0sleep10-21swapper/100:32:231
219019931,2cyclictest55950irq/130-eth022:50:033
219019931,1cyclictest714-21snmpd19:10:143
219019931,1cyclictest0-21swapper/320:55:133
219019931,1cyclictest0-21swapper/320:30:123
219019930,3cyclictest0-21swapper/322:40:113
219019930,3cyclictest0-21swapper/320:15:143
219019930,3cyclictest0-21swapper/319:40:143
219019930,0cyclictest11224-21apt-get23:00:113
218969931,1cyclictest0-21swapper/220:10:132
218969930,3cyclictest8501-21ssh22:10:052
218969930,3cyclictest5731-21ssh21:20:052
218969930,3cyclictest28456-21head20:25:172
218969930,3cyclictest17833-21rm21:10:052
218969930,3cyclictest17778-21apt-get20:05:122
218969930,3cyclictest0-21swapper/221:55:112
218969930,3cyclictest0-21swapper/220:45:122
218969930,3cyclictest0-21swapper/220:15:062
218969930,3cyclictest0-21swapper/219:50:122
218969930,3cyclictest0-21swapper/219:46:122
218969930,3cyclictest0-21swapper/219:35:122
218969930,3cyclictest0-21swapper/219:30:132
218969930,3cyclictest0-21swapper/219:20:132
218969930,1cyclictest0-21swapper/221:05:142
218969930,0cyclictest12822-21apt-get19:55:132
218929933,0cyclictest0-21swapper/122:09:231
218929933,0cyclictest0-21swapper/121:26:271
218929933,0cyclictest0-21swapper/121:21:131
218929933,0cyclictest0-21swapper/121:15:591
218929931,2cyclictest0-21swapper/123:30:121
218929931,1cyclictest0-21swapper/123:50:121
218929931,1cyclictest0-21swapper/123:35:101
218929931,1cyclictest0-21swapper/123:05:111
218929931,1cyclictest0-21swapper/123:00:121
218929931,1cyclictest0-21swapper/122:50:131
218929931,1cyclictest0-21swapper/122:15:131
218929931,1cyclictest0-21swapper/122:00:121
218929931,1cyclictest0-21swapper/121:40:141
218929931,1cyclictest0-21swapper/121:00:111
218929931,1cyclictest0-21swapper/120:45:121
218929931,1cyclictest0-21swapper/119:50:121
218929931,1cyclictest0-21swapper/119:45:111
218929931,1cyclictest0-21swapper/119:35:121
218929931,1cyclictest0-21swapper/119:30:141
218929930,3cyclictest0-21swapper/119:42:061
218929930,2cyclictest17445-21chrt20:03:561
218929930,2cyclictest0-21swapper/121:10:111
218929930,2cyclictest0-21swapper/119:55:141
218929930,2cyclictest0-21swapper/119:15:111
218879932,1cyclictest714-21snmpd19:45:040
218879931,2cyclictest0-21swapper/021:10:090
218879931,1cyclictest0-21swapper/020:50:120
218879930,3cyclictest0-21swapper/023:55:150
218879930,3cyclictest0-21swapper/023:20:050
218879930,3cyclictest0-21swapper/023:00:120
218879930,3cyclictest0-21swapper/022:00:120
218879930,3cyclictest0-21swapper/021:20:020
218879930,3cyclictest0-21swapper/020:40:120
218879930,3cyclictest0-21swapper/020:25:150
218879930,3cyclictest0-21swapper/020:20:130
218879930,3cyclictest0-21swapper/020:05:130
218879930,3cyclictest0-21swapper/020:00:140
218879930,3cyclictest0-21swapper/019:55:130
218879930,3cyclictest0-21swapper/019:30:140
218879930,3cyclictest0-21swapper/019:20:110
218879930,3cyclictest0-21swapper/019:15:110
218879930,2cyclictest0-21swapper/020:35:020
218929921,1cyclictest97512chrt20:51:041
218929921,1cyclictest0-21swapper/123:10:121
218929921,1cyclictest0-21swapper/122:35:141
218929921,1cyclictest0-21swapper/121:46:501
218929921,1cyclictest0-21swapper/121:05:131
218929921,1cyclictest0-21swapper/120:10:121
218929921,1cyclictest0-21swapper/119:20:131
218929920,2cyclictest32147-21taskset20:32:011
218929920,1cyclictest30189-21chrt19:25:051
218929920,1cyclictest0-21swapper/120:35:011
218929920,1cyclictest0-21swapper/120:20:141
218929920,1cyclictest0-21swapper/120:15:131
218929920,1cyclictest0-21swapper/119:10:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional