You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-25 - 12:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Sat Apr 25, 2026 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
248252198182,11sleep10-21swapper/119:08:511
246692188171,12sleep00-21swapper/019:06:510
246472184167,12sleep30-21swapper/319:06:333
245692179162,13sleep20-21swapper/219:05:312
84422510,0sleep10-21swapper/122:06:141
247052470,0sleep20-21swapper/223:01:432
135532470,0sleep20-21swapper/219:50:122
286262420,0sleep00-21swapper/023:51:230
219532420,0sleep10-21swapper/121:10:131
153222110,0sleep00-21swapper/023:45:140
270692100,0sleep20-21swapper/222:47:022
2509699102,2cyclictest0-21swapper/321:10:123
104242100,0sleep00-21swapper/023:10:220
100572100,0sleep10-21swapper/123:26:131
3008290,0sleep10-21swapper/122:20:001
25236290,0sleep10-21swapper/123:02:021
250969982,1cyclictest0-21swapper/321:40:123
250969982,1cyclictest0-21swapper/321:25:123
250829980,7cyclictest0-21swapper/000:25:110
250969971,1cyclictest0-21swapper/320:00:153
250829971,3cyclictest4160-21awk23:40:000
250829970,3cyclictest6093-21munin-run21:50:010
250969965,1cyclictest5891-21apt-get20:40:113
250969963,2cyclictest28848-21apt-get23:20:133
250969963,1cyclictest30935-21apt-get19:20:113
250969962,3cyclictest0-21swapper/300:15:123
250969961,1cyclictest40-21ksoftirqd/322:52:303
250969961,1cyclictest40-21ksoftirqd/321:20:273
250969961,1cyclictest0-21swapper/323:40:163
250969961,1cyclictest0-21swapper/323:35:013
250969961,1cyclictest0-21swapper/323:04:083
250969961,1cyclictest0-21swapper/322:47:213
250969961,1cyclictest0-21swapper/322:36:203
250969961,1cyclictest0-21swapper/322:10:173
250969961,1cyclictest0-21swapper/322:07:003
250969961,1cyclictest0-21swapper/321:53:493
250969961,1cyclictest0-21swapper/321:45:213
250969961,1cyclictest0-21swapper/320:45:193
250969961,1cyclictest0-21swapper/320:20:183
250969961,1cyclictest0-21swapper/300:25:123
250969961,1cyclictest0-21swapper/300:13:353
250969961,1cyclictest0-21swapper/300:00:103
250969961,0cyclictest0-21swapper/323:55:163
250969960,5cyclictest24716-21ntp_states20:10:183
250969960,3cyclictest13665-21mailstats22:40:183
250969960,2cyclictest20712-21diskmemload00:35:483
250969960,2cyclictest20712-21diskmemload00:30:523
250969960,2cyclictest12024-21irqstats20:50:153
250969960,1cyclictest40-21ksoftirqd/323:48:283
250969960,1cyclictest40-21ksoftirqd/323:27:323
250969960,1cyclictest40-21ksoftirqd/300:09:353
250969960,1cyclictest0-21swapper/323:05:103
250969960,1cyclictest0-21swapper/322:28:343
250969960,1cyclictest0-21swapper/322:20:123
250969960,1cyclictest0-21swapper/321:30:023
250969960,1cyclictest0-21swapper/321:16:193
5463250,0sleep10-21swapper/100:12:051
250969954,1cyclictest3401-21apt-get20:35:103
250969952,2cyclictest802-21snmpd19:41:463
250969952,2cyclictest15761-21munin-run21:00:003
250969951,3cyclictest0-21swapper/319:55:153
250969951,2cyclictest0-21swapper/322:55:173
250969951,1cyclictest802-21snmpd21:56:083
250969951,1cyclictest40-21ksoftirqd/321:00:023
250969951,1cyclictest40-21ksoftirqd/319:30:113
250969951,1cyclictest40-21ksoftirqd/319:10:113
250969951,1cyclictest40-21ksoftirqd/300:20:363
250969951,1cyclictest0-21swapper/323:10:443
250969951,1cyclictest0-21swapper/320:05:143
250969951,1cyclictest0-21swapper/319:50:173
250969950,4cyclictest25925-21apt-get20:15:133
250969950,4cyclictest0-21swapper/322:00:133
250969950,3cyclictest2206-21ntp_states20:30:173
250969950,3cyclictest0-21swapper/321:05:123
250969950,2cyclictest27060-21sshd23:50:243
250969950,2cyclictest0-21swapper/323:30:133
250969950,1cyclictest391ktimersoftd/321:39:233
250969950,1cyclictest0-21swapper/323:15:143
250969950,1cyclictest0-21swapper/322:30:133
250969950,1cyclictest0-21swapper/322:15:013
250969950,1cyclictest0-21swapper/319:15:143
250969950,1cyclictest0-21swapper/319:15:133
250919953,2cyclictest0-21swapper/223:48:552
250919952,3cyclictest6840-21ssh21:34:362
250919951,2cyclictest0-21swapper/221:50:122
250919950,5cyclictest0-21swapper/200:30:162
250919950,4cyclictest0-21swapper/220:45:132
250919950,0cyclictest0-21swapper/200:15:152
250879951,3cyclictest0-21swapper/123:15:121
250879950,5cyclictest0-21swapper/121:23:381
250829955,0cyclictest3-21ksoftirqd/023:00:110
250829952,3cyclictest802-21snmpd23:06:440
250829950,5cyclictest0-21swapper/000:02:570
250829950,4cyclictest5076-21rm23:55:340
250829950,4cyclictest28559-21apt-get23:20:020
250829950,4cyclictest19284-21ssh22:59:410
250829950,4cyclictest0-21swapper/021:10:110
250829950,4cyclictest0-21swapper/000:20:120
250829950,0cyclictest81rcu_preempt21:35:130
250969942,1cyclictest30890-21apt-get20:25:123
250969941,1cyclictest0-21swapper/319:45:213
250969941,1cyclictest0-21swapper/319:35:133
250969940,4cyclictest0-21swapper/319:25:153
250919944,0cyclictest0-21swapper/223:18:052
250919944,0cyclictest0-21swapper/222:42:092
250919944,0cyclictest0-21swapper/222:15:482
250919944,0cyclictest0-21swapper/220:25:052
250919943,1cyclictest7605-21wc19:35:182
250919943,1cyclictest5472-21perl23:40:142
250919943,1cyclictest29234-21cpuspeed_turbos21:45:152
250919943,1cyclictest15092-21needreboot22:25:172
250919942,1cyclictest27686-21df_inode22:00:132
250919941,2cyclictest0-21swapper/220:30:112
250919941,2cyclictest0-21swapper/219:20:122
250919941,1cyclictest0-21swapper/223:05:122
250919941,1cyclictest0-21swapper/220:15:122
250919940,4cyclictest32742-21ssh00:10:012
250919940,4cyclictest23457-21diskstats00:05:132
250919940,4cyclictest0-21swapper/223:55:392
250919940,4cyclictest0-21swapper/223:51:452
250919940,4cyclictest0-21swapper/223:37:402
250919940,4cyclictest0-21swapper/223:30:342
250919940,4cyclictest0-21swapper/223:25:112
250919940,4cyclictest0-21swapper/222:55:102
250919940,4cyclictest0-21swapper/222:54:502
250919940,4cyclictest0-21swapper/222:37:542
250919940,4cyclictest0-21swapper/222:05:122
250919940,4cyclictest0-21swapper/221:56:232
250919940,4cyclictest0-21swapper/221:35:162
250919940,4cyclictest0-21swapper/221:16:012
250919940,4cyclictest0-21swapper/220:35:102
250919940,4cyclictest0-21swapper/220:07:102
250919940,4cyclictest0-21swapper/219:10:102
250919940,4cyclictest0-21swapper/200:35:112
250919940,4cyclictest0-21swapper/200:20:112
250919940,3cyclictest5888-21/usr/sbin/munin20:40:152
250919940,3cyclictest30988-21ssh00:25:122
250919940,3cyclictest28937-21sh22:32:052
250919940,3cyclictest21522-21threads21:25:202
250919940,3cyclictest18481-21sed20:00:012
250919940,3cyclictest15750-21latency_hist21:00:002
250919940,3cyclictest15138-21ssh22:10:042
250919940,3cyclictest13268-21ssh21:21:242
250919940,3cyclictest0-21swapper/221:05:162
250919940,3cyclictest0-21swapper/221:05:012
250919940,1cyclictest28358-21latency_hist21:45:022
250919940,1cyclictest13482-21tune2fs00:00:132
250919940,0cyclictest0-21swapper/223:23:542
250879944,0cyclictest0-21swapper/121:55:551
250879944,0cyclictest0-21swapper/121:52:001
250879944,0cyclictest0-21swapper/121:48:051
250879941,2cyclictest0-21swapper/123:35:111
250879941,2cyclictest0-21swapper/121:40:121
250879941,2cyclictest0-21swapper/121:00:101
250879941,2cyclictest0-21swapper/119:55:121
250879941,2cyclictest0-21swapper/119:40:111
250879941,2cyclictest0-21swapper/119:35:101
250879941,2cyclictest0-21swapper/119:25:111
250879940,4cyclictest0-21swapper/121:27:251
250879940,2cyclictest0-21swapper/123:30:101
250879940,0cyclictest0-21swapper/121:31:111
250879940,0cyclictest0-21swapper/100:16:281
250829944,0cyclictest3-21ksoftirqd/021:30:020
250829944,0cyclictest3-21ksoftirqd/020:25:120
250829944,0cyclictest3-21ksoftirqd/020:10:120
250829944,0cyclictest0-21swapper/021:24:040
250829942,2cyclictest25710-21kworker/0:022:30:460
250829942,2cyclictest25710-21kworker/0:021:51:490
250829942,2cyclictest25710-21kworker/0:020:36:250
250829942,2cyclictest25710-21kworker/0:019:23:450
250829941,2cyclictest0-21swapper/022:35:280
250829941,2cyclictest0-21swapper/020:30:110
250829940,4cyclictest0-21swapper/023:30:100
250829940,4cyclictest0-21swapper/023:25:110
250829940,4cyclictest0-21swapper/022:20:110
250829940,4cyclictest0-21swapper/020:40:110
250829940,4cyclictest0-21swapper/020:20:090
250829940,4cyclictest0-21swapper/019:50:100
250829940,4cyclictest0-21swapper/019:10:110
250829940,4cyclictest0-21swapper/000:11:410
250829940,3cyclictest8548-21apt-get20:45:000
250829940,3cyclictest4477-21ssh23:40:050
250829940,3cyclictest27478-21sed20:15:200
250829940,3cyclictest27208-21ssh22:15:180
250829940,3cyclictest26857-21ssh22:00:030
250829940,3cyclictest25333-21apt-key22:15:010
250829940,3cyclictest23881-21ssh22:45:210
250829940,3cyclictest22599-21rm00:05:010
250829940,3cyclictest20909-21sed20:05:000
250829940,3cyclictest20712-21diskmemload21:25:010
250829940,3cyclictest18348-21ssh21:40:050
250829940,3cyclictest16674-21ssh21:55:060
250829940,3cyclictest16320-21ssh22:41:420
250829940,3cyclictest14625-21perl22:25:150
250829940,3cyclictest10737-21ssh00:15:130
250829940,3cyclictest0-21swapper/019:40:120
250829940,1cyclictest81rcu_preempt22:50:110
250829940,1cyclictest0-21swapper/019:30:010
250829940,1cyclictest0-21swapper/000:35:120
250829940,1cyclictest0-21swapper/000:30:020
250829940,0cyclictest0-21swapper/023:16:500
15041240,0sleep10-21swapper/120:55:201
250919931,1cyclictest0-21swapper/220:00:112
250919930,3cyclictest4164-21perl19:30:132
250919930,3cyclictest3342-21sh22:20:022
250919930,3cyclictest27636-21munin-node19:15:012
250919930,3cyclictest27636-21munin-node19:15:012
250919930,3cyclictest10879-21apt-get19:45:112
250919930,3cyclictest0-21swapper/223:10:042
250919930,3cyclictest0-21swapper/220:50:122
250919930,3cyclictest0-21swapper/220:20:112
250919930,3cyclictest0-21swapper/220:10:112
250919930,3cyclictest0-21swapper/219:40:052
250919930,3cyclictest0-21swapper/219:25:062
250919930,1cyclictest20972-21ssh21:10:022
250879933,0cyclictest0-21swapper/123:40:241
250879931,1cyclictest0-21swapper/123:50:111
250879931,1cyclictest0-21swapper/123:45:131
250879931,1cyclictest0-21swapper/123:20:011
250879931,1cyclictest0-21swapper/123:10:101
250879931,1cyclictest0-21swapper/123:05:101
250879931,1cyclictest0-21swapper/122:50:121
250879931,1cyclictest0-21swapper/122:45:151
250879931,1cyclictest0-21swapper/122:35:121
250879931,1cyclictest0-21swapper/122:25:121
250879931,1cyclictest0-21swapper/122:20:121
250879931,1cyclictest0-21swapper/121:15:121
250879931,1cyclictest0-21swapper/121:05:101
250879931,1cyclictest0-21swapper/120:50:111
250879931,1cyclictest0-21swapper/120:45:001
250879931,1cyclictest0-21swapper/120:35:111
250879931,1cyclictest0-21swapper/120:25:131
250879931,1cyclictest0-21swapper/120:20:101
250879931,1cyclictest0-21swapper/120:15:121
250879931,1cyclictest0-21swapper/120:10:111
250879931,1cyclictest0-21swapper/119:45:121
250879931,1cyclictest0-21swapper/119:15:111
250879931,1cyclictest0-21swapper/119:15:111
250879931,1cyclictest0-21swapper/100:25:111
250879931,1cyclictest0-21swapper/100:05:121
250879931,1cyclictest0-21swapper/100:00:101
250879930,2cyclictest205532sleep120:02:441
250879930,2cyclictest0-21swapper/122:55:101
250879930,2cyclictest0-21swapper/122:00:121
250829933,0cyclictest25710-21kworker/0:019:55:090
250829932,1cyclictest802-21snmpd22:05:050
250829930,3cyclictest31535-21ssh21:15:120
250829930,3cyclictest0-21swapper/021:05:100
250829930,3cyclictest0-21swapper/021:00:110
250829930,3cyclictest0-21swapper/020:55:110
250829930,3cyclictest0-21swapper/020:50:080
250829930,3cyclictest0-21swapper/020:05:120
250829930,3cyclictest0-21swapper/019:45:120
250829930,3cyclictest0-21swapper/019:35:110
250829930,3cyclictest0-21swapper/019:30:100
250829930,3cyclictest0-21swapper/019:15:080
250829930,3cyclictest0-21swapper/019:15:080
24257230,0sleep10-21swapper/100:21:091
250879921,1cyclictest0-21swapper/120:30:121
250879921,1cyclictest0-21swapper/119:20:111
250879921,1cyclictest0-21swapper/100:30:111
250879921,0cyclictest0-21swapper/121:35:011
250879920,1cyclictest23992sleep123:55:031
250879920,1cyclictest0-21swapper/122:40:111
250879920,1cyclictest0-21swapper/122:30:121
250879920,1cyclictest0-21swapper/122:10:011
250879920,1cyclictest0-21swapper/120:05:111
250879920,1cyclictest0-21swapper/119:50:001
250879920,1cyclictest0-21swapper/119:30:121
250879920,1cyclictest0-21swapper/119:10:101
250879920,1cyclictest0-21swapper/100:35:121
250879910,1cyclictest0-21swapper/120:40:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional