You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-16 - 05:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Mon Mar 16, 2026 00:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
33532201184,12sleep00-21swapper/019:05:060
53102199182,12sleep10-21swapper/119:06:321
52822188170,13sleep30-21swapper/319:06:093
54402123107,11sleep20-21swapper/219:08:142
239352440,0sleep10-21swapper/120:50:121
86832430,0sleep20-21swapper/221:13:082
206572420,1sleep1211ktimersoftd/100:10:571
292762390,0sleep10-21swapper/121:38:321
13512150,0sleep10-21swapper/123:14:571
64712100,0sleep00-21swapper/023:16:480
575899104,3cyclictest21474-21sendmail-msp19:40:010
24972100,0sleep20-21swapper/221:56:192
5404290,0sleep10-21swapper/121:42:251
57589973,4cyclictest417-21munin-run21:25:010
27152270,0sleep10-21swapper/122:08:391
57719966,0cyclictest40-21ksoftirqd/321:00:013
57719964,2cyclictest4320-21kworker/3:220:10:553
57589965,1cyclictest17908-21/usr/sbin/munin00:25:190
57589962,2cyclictest0-21swapper/020:30:120
57589961,4cyclictest0-21swapper/020:00:130
57589960,3cyclictest22394-21awk21:20:000
57719955,0cyclictest4320-21kworker/3:223:54:523
57719955,0cyclictest4320-21kworker/3:223:43:403
57719955,0cyclictest4320-21kworker/3:222:58:523
57719955,0cyclictest4320-21kworker/3:222:25:173
57719955,0cyclictest4320-21kworker/3:222:02:533
57719955,0cyclictest4320-21kworker/3:221:51:433
57719955,0cyclictest4320-21kworker/3:221:40:313
57719955,0cyclictest4320-21kworker/3:219:59:433
57719955,0cyclictest4320-21kworker/3:200:39:403
57719955,0cyclictest4320-21kworker/3:200:17:143
57719954,1cyclictest4320-21kworker/3:221:18:053
57719950,5cyclictest0-21swapper/321:33:333
57719950,0cyclictest0-21swapper/323:00:423
57719950,0cyclictest0-21swapper/322:30:353
57679955,0cyclictest0-21swapper/222:25:092
57679950,5cyclictest0-21swapper/223:11:262
57679950,5cyclictest0-21swapper/222:23:422
57679950,5cyclictest0-21swapper/219:25:112
57679950,5cyclictest0-21swapper/200:35:142
57679950,5cyclictest0-21swapper/200:25:292
57679950,5cyclictest0-21swapper/200:08:102
57679950,0cyclictest0-21swapper/223:24:502
57679950,0cyclictest0-21swapper/222:00:262
57629951,2cyclictest0-21swapper/123:30:111
57629950,5cyclictest0-21swapper/123:00:531
57629950,5cyclictest0-21swapper/121:21:571
57629950,5cyclictest0-21swapper/119:50:161
57589955,0cyclictest0-21swapper/022:56:170
57589955,0cyclictest0-21swapper/000:20:480
57589952,2cyclictest0-21swapper/020:05:120
57589951,4cyclictest31383-21perf20:00:010
57589951,3cyclictest0-21swapper/019:15:010
57589950,5cyclictest1360-21diskmemload23:51:250
57589950,5cyclictest1360-21diskmemload23:35:420
57589950,5cyclictest0-21swapper/023:55:550
57589950,5cyclictest0-21swapper/023:29:000
57589950,5cyclictest0-21swapper/021:27:490
57589950,5cyclictest0-21swapper/000:38:080
57589950,5cyclictest0-21swapper/000:00:260
57589950,4cyclictest0-21swapper/019:25:120
57719944,0cyclictest57250irq/130-eth021:35:443
57719944,0cyclictest4320-21kworker/3:223:10:033
57719944,0cyclictest4320-21kworker/3:219:14:563
57719944,0cyclictest0-21swapper/323:32:423
57719944,0cyclictest0-21swapper/300:02:413
57719943,0cyclictest40-21ksoftirqd/322:40:003
57719941,3cyclictest0-21swapper/300:05:173
57719940,4cyclictest24132-21ssh00:29:073
57719940,4cyclictest11349-21irqstats21:45:153
57719940,4cyclictest0-21swapper/323:55:063
57719940,4cyclictest0-21swapper/323:05:123
57719940,4cyclictest0-21swapper/322:50:343
57719940,3cyclictest8934-21sh00:21:083
57719940,3cyclictest8624-21sh23:18:073
57719940,3cyclictest8493-21munin-node19:15:003
57719940,3cyclictest7105-21df20:15:133
57719940,3cyclictest4938-21sh22:13:343
57719940,3cyclictest3423-21ssh21:56:543
57719940,3cyclictest32382-21hddtemp_smartct21:05:153
57719940,3cyclictest31595-21/usr/sbin/munin20:00:153
57719940,3cyclictest28144-21/usr/sbin/munin22:40:143
57719940,3cyclictest25831-21sh00:30:023
57719940,3cyclictest25671-21cut19:45:183
57719940,3cyclictest23486-21sh22:06:273
57719940,3cyclictest21773-21sh22:21:133
57719940,3cyclictest18265-21sh23:22:443
57719940,3cyclictest16665-21grep20:35:133
57719940,3cyclictest1403-21latency_hist20:05:013
57719940,3cyclictest12793-21/usr/sbin/munin23:35:223
57719940,3cyclictest1085-21sh23:45:313
57719940,3cyclictest0-21swapper/319:20:033
57719940,1cyclictest29074-21/usr/sbin/munin21:00:113
57719940,1cyclictest19200-21/usr/sbin/munin19:35:163
57719940,1cyclictest14017-21/usr/sbin/munin20:30:153
57719940,0cyclictest0-21swapper/323:26:013
57679944,0cyclictest0-21swapper/221:25:212
57679944,0cyclictest0-21swapper/221:16:382
57679943,1cyclictest6525-21apt-get22:30:122
57679942,2cyclictest814-21snmpd21:22:262
57679942,1cyclictest814-21snmpd20:40:022
57679942,1cyclictest814-21snmpd00:21:032
57679940,4cyclictest30492-21grep21:55:002
57679940,4cyclictest28216-21ssh22:40:142
57679940,4cyclictest0-21swapper/223:43:552
57679940,4cyclictest0-21swapper/223:30:252
57679940,4cyclictest0-21swapper/223:01:172
57679940,4cyclictest0-21swapper/222:50:122
57679940,4cyclictest0-21swapper/222:45:532
57679940,4cyclictest0-21swapper/222:37:302
57679940,4cyclictest0-21swapper/222:15:112
57679940,4cyclictest0-21swapper/222:10:122
57679940,4cyclictest0-21swapper/222:05:122
57679940,4cyclictest0-21swapper/221:40:512
57679940,4cyclictest0-21swapper/221:30:072
57679940,4cyclictest0-21swapper/220:05:122
57679940,4cyclictest0-21swapper/220:00:122
57679940,4cyclictest0-21swapper/219:40:112
57679940,4cyclictest0-21swapper/200:30:292
57679940,4cyclictest0-21swapper/200:00:122
57679940,3cyclictest8381-21ntp_states19:15:012
57679940,3cyclictest0-21swapper/221:00:012
57679940,1cyclictest32572-21ntp_states23:45:172
57679940,1cyclictest26577-21hddtemp_smartct22:55:152
57679940,0cyclictest0-21swapper/220:18:342
57629944,0cyclictest0-21swapper/123:47:531
57629944,0cyclictest0-21swapper/100:28:381
57629944,0cyclictest0-21swapper/100:00:421
57629941,2cyclictest0-21swapper/123:40:111
57629941,2cyclictest0-21swapper/123:35:141
57629941,2cyclictest0-21swapper/121:10:121
57629941,1cyclictest0-21swapper/123:50:101
57629941,1cyclictest0-21swapper/123:15:111
57629941,1cyclictest0-21swapper/122:40:121
57629941,1cyclictest0-21swapper/100:20:121
57629940,4cyclictest0-21swapper/123:24:441
57629940,4cyclictest0-21swapper/120:30:511
57629940,2cyclictest0-21swapper/123:55:121
57629940,2cyclictest0-21swapper/121:15:111
57629940,2cyclictest0-21swapper/119:15:121
57629940,0cyclictest0-21swapper/122:36:361
57629940,0cyclictest0-21swapper/122:10:161
57629940,0cyclictest0-21swapper/100:36:551
57589944,0cyclictest0-21swapper/022:40:070
57589942,1cyclictest7100-21ssh00:05:010
57589941,1cyclictest0-21swapper/021:00:090
57589941,1cyclictest0-21swapper/020:25:130
57589940,4cyclictest4786-21taskset22:45:020
57589940,4cyclictest1360-21diskmemload23:30:100
57589940,4cyclictest1360-21diskmemload23:01:250
57589940,4cyclictest0-21swapper/023:23:320
57589940,4cyclictest0-21swapper/022:35:090
57589940,4cyclictest0-21swapper/022:05:110
57589940,4cyclictest0-21swapper/021:55:140
57589940,4cyclictest0-21swapper/021:30:120
57589940,4cyclictest0-21swapper/020:15:170
57589940,4cyclictest0-21swapper/019:30:120
57589940,4cyclictest0-21swapper/000:30:110
57589940,3cyclictest6518-21/usr/sbin/munin22:30:150
57589940,3cyclictest5851-21taskset19:10:000
57589940,3cyclictest3631-21ssh22:28:360
57589940,3cyclictest32339-21cat23:45:170
57589940,3cyclictest29635-21rm22:10:000
57589940,3cyclictest28307-21df_inode00:15:130
57589940,3cyclictest26901-21df20:55:110
57589940,3cyclictest22414-21perl19:40:130
57589940,3cyclictest20366-21rm21:50:030
57589940,3cyclictest19834-21ssh23:07:420
57589940,3cyclictest19809-21ssh21:49:500
57589940,3cyclictest16806-21ntpq22:50:180
57589940,3cyclictest14916-21ssh22:18:210
57589940,3cyclictest10484-21ssh22:00:180
57589940,3cyclictest0-21swapper/021:40:110
57589940,2cyclictest24153-21ssh23:10:120
30409240,0sleep20-21swapper/223:28:522
23279240,0sleep20-21swapper/200:12:352
57719932,1cyclictest9080-21/usr/sbin/munin20:20:133
57719932,1cyclictest5630-21grep22:45:123
57719932,1cyclictest22071-21cat19:40:133
57719931,1cyclictest0-21swapper/319:50:113
57719930,3cyclictest9102sleep321:25:103
57719930,3cyclictest7850-21apt-get22:15:113
57719930,3cyclictest21964-21df20:45:133
57719930,3cyclictest1773-21rm21:10:073
57719930,3cyclictest16730-21/usr/sbin/munin19:30:143
57719930,3cyclictest0-21swapper/321:20:153
57719930,3cyclictest0-21swapper/320:50:113
57719930,3cyclictest0-21swapper/320:40:043
57719930,3cyclictest0-21swapper/320:25:133
57719930,3cyclictest0-21swapper/319:25:043
57719930,1cyclictest17411-21ssh00:10:063
57679930,3cyclictest20291-21memory19:35:162
57679930,3cyclictest1829-21ssh23:15:052
57679930,3cyclictest17454-21perl19:30:132
57679930,3cyclictest12815-21ntpq20:25:172
57679930,3cyclictest10112-21ssh21:45:072
57679930,3cyclictest0-21swapper/223:55:072
57679930,3cyclictest0-21swapper/223:50:092
57679930,3cyclictest0-21swapper/223:35:132
57679930,3cyclictest0-21swapper/223:05:092
57679930,3cyclictest0-21swapper/221:35:032
57679930,3cyclictest0-21swapper/221:05:122
57679930,3cyclictest0-21swapper/220:55:092
57679930,3cyclictest0-21swapper/220:50:112
57679930,3cyclictest0-21swapper/220:45:122
57679930,3cyclictest0-21swapper/220:35:122
57679930,3cyclictest0-21swapper/220:32:142
57679930,3cyclictest0-21swapper/220:20:112
57679930,3cyclictest0-21swapper/220:10:132
57679930,3cyclictest0-21swapper/219:55:102
57679930,3cyclictest0-21swapper/219:50:122
57679930,3cyclictest0-21swapper/219:45:112
57679930,3cyclictest0-21swapper/219:20:102
57679930,3cyclictest0-21swapper/219:15:122
57679930,3cyclictest0-21swapper/200:15:122
57629933,0cyclictest0-21swapper/120:45:161
57629933,0cyclictest0-21swapper/100:33:091
57629931,1cyclictest0-21swapper/123:25:101
57629931,1cyclictest0-21swapper/122:45:101
57629931,1cyclictest0-21swapper/122:20:121
57629931,1cyclictest0-21swapper/121:50:121
57629931,1cyclictest0-21swapper/121:30:111
57629931,1cyclictest0-21swapper/121:25:111
57629931,1cyclictest0-21swapper/121:05:111
57629931,1cyclictest0-21swapper/121:00:011
57629931,1cyclictest0-21swapper/120:55:091
57629931,1cyclictest0-21swapper/120:40:091
57629931,1cyclictest0-21swapper/120:10:121
57629931,1cyclictest0-21swapper/120:00:181
57629931,1cyclictest0-21swapper/119:55:121
57629931,1cyclictest0-21swapper/119:35:111
57629931,1cyclictest0-21swapper/119:30:111
57629931,1cyclictest0-21swapper/119:25:121
57629931,1cyclictest0-21swapper/119:20:111
57629931,1cyclictest0-21swapper/119:10:121
57629931,0cyclictest0-21swapper/122:50:121
57629930,2cyclictest12553-21chrt22:01:061
57629930,2cyclictest11378-21chrt22:32:011
57629930,2cyclictest10152-21chrt22:15:281
57629930,2cyclictest0-21swapper/121:55:011
57629930,2cyclictest0-21swapper/121:45:121
57629930,1cyclictest0-21swapper/123:05:131
57629930,1cyclictest0-21swapper/100:05:111
57589931,1cyclictest0-21swapper/023:40:120
57589931,1cyclictest0-21swapper/020:10:120
57589930,3cyclictest24163-21apt-get19:45:100
57589930,3cyclictest18200-21ssh22:20:110
57589930,3cyclictest12323-21diskstats19:20:110
57589930,3cyclictest0-21swapper/021:35:110
57589930,3cyclictest0-21swapper/021:10:120
57589930,3cyclictest0-21swapper/021:05:110
57589930,3cyclictest0-21swapper/020:45:040
57589930,3cyclictest0-21swapper/020:40:090
57589930,3cyclictest0-21swapper/020:35:110
57589930,3cyclictest0-21swapper/020:20:110
57589930,3cyclictest0-21swapper/019:50:110
57589930,3cyclictest0-21swapper/000:10:110
57589930,2cyclictest23948-21aten2_r5power_e20:50:120
1014230,0sleep10-21swapper/122:58:481
57629921,1cyclictest0-21swapper/120:15:121
57629921,1cyclictest0-21swapper/100:15:111
57629921,0cyclictest0-21swapper/119:40:101
57629920,1cyclictest3819-21chrt20:09:281
57629920,1cyclictest0-21swapper/122:25:111
57629920,1cyclictest0-21swapper/120:35:111
57629920,1cyclictest0-21swapper/120:25:131
57629920,1cyclictest0-21swapper/120:20:121
57629920,1cyclictest0-21swapper/119:45:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional