You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-22 - 03:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Wed Jul 22, 2026 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
260902234220,10sleep10-21swapper/119:05:311
262622198182,12sleep00-21swapper/019:07:410
261162193176,12sleep30-21swapper/319:05:483
261872168150,13sleep20-21swapper/219:06:442
48852530,0sleep30-21swapper/321:16:443
108472500,0sleep10-21swapper/119:40:131
124802470,0sleep00-21swapper/023:15:140
244482460,0sleep00-21swapper/022:31:460
88802410,0sleep30-21swapper/300:01:503
266059960,5cyclictest20150-21/usr/sbin/munin22:30:133
266059955,0cyclictest40-21ksoftirqd/323:40:123
266059955,0cyclictest40-21ksoftirqd/320:30:113
266059955,0cyclictest0-21swapper/323:54:193
266059955,0cyclictest0-21swapper/322:42:363
266059952,2cyclictest16350-21ssh22:11:153
266059951,3cyclictest802-21snmpd23:03:233
266059950,5cyclictest0-21swapper/323:21:083
266059950,5cyclictest0-21swapper/323:21:083
266059950,5cyclictest0-21swapper/322:20:373
266059950,5cyclictest0-21swapper/321:21:073
266059950,5cyclictest0-21swapper/300:29:413
266059950,5cyclictest0-21swapper/300:12:213
266059950,4cyclictest0-21swapper/319:35:123
266049950,5cyclictest0-21swapper/221:33:002
266049950,5cyclictest0-21swapper/200:21:192
266049950,5cyclictest0-21swapper/200:15:122
266009952,2cyclictest0-21swapper/123:10:121
266009951,3cyclictest0-21swapper/122:25:131
266009951,3cyclictest0-21swapper/121:40:131
266009951,3cyclictest0-21swapper/121:35:141
266009951,3cyclictest0-21swapper/120:20:111
266009951,2cyclictest0-21swapper/123:15:131
266009951,2cyclictest0-21swapper/122:50:111
266009951,2cyclictest0-21swapper/122:15:111
266009951,2cyclictest0-21swapper/122:05:161
266009951,2cyclictest0-21swapper/122:00:131
266009951,2cyclictest0-21swapper/121:25:141
266009951,2cyclictest0-21swapper/119:50:101
266009951,2cyclictest0-21swapper/119:35:111
266009951,1cyclictest0-21swapper/121:45:121
266009950,5cyclictest0-21swapper/122:34:141
266009950,3cyclictest0-21swapper/123:05:121
266009950,3cyclictest0-21swapper/122:40:111
265999954,1cyclictest24242-21grep23:20:200
265999954,1cyclictest24242-21grep23:20:200
265999952,3cyclictest6836-21ssh23:28:270
265999950,5cyclictest0-21swapper/022:40:000
265999950,5cyclictest0-21swapper/022:29:400
265999950,5cyclictest0-21swapper/021:55:190
265999950,5cyclictest0-21swapper/021:43:420
265999950,5cyclictest0-21swapper/000:36:230
265999950,0cyclictest0-21swapper/022:07:420
19658250,4sleep019687-21ssh22:13:230
28408240,0sleep30-21swapper/322:00:563
266059944,0cyclictest8297-21kworker/3:122:15:043
266059944,0cyclictest8297-21kworker/3:121:41:283
266059944,0cyclictest8297-21kworker/3:121:07:533
266059944,0cyclictest8297-21kworker/3:120:45:293
266059944,0cyclictest8297-21kworker/3:120:00:443
266059944,0cyclictest8297-21kworker/3:119:49:313
266059944,0cyclictest8297-21kworker/3:119:27:073
266059944,0cyclictest8297-21kworker/3:100:07:003
266059944,0cyclictest40-21ksoftirqd/323:05:123
266059944,0cyclictest0-21swapper/323:18:233
266059944,0cyclictest0-21swapper/321:47:453
266059944,0cyclictest0-21swapper/300:15:073
266059943,1cyclictest17697-21grep19:55:013
266059942,1cyclictest32638-21ssh22:52:213
266059941,3cyclictest22637-21diskmemload21:51:253
266059940,4cyclictest5334-21apt-get20:35:093
266059940,4cyclictest22637-21diskmemload21:32:053
266059940,4cyclictest0-21swapper/323:55:123
266059940,4cyclictest0-21swapper/322:57:143
266059940,4cyclictest0-21swapper/322:37:063
266059940,4cyclictest0-21swapper/322:27:103
266059940,4cyclictest0-21swapper/321:25:143
266059940,4cyclictest0-21swapper/321:10:143
266059940,4cyclictest0-21swapper/320:55:133
266059940,4cyclictest0-21swapper/320:40:143
266059940,4cyclictest0-21swapper/319:55:193
266059940,4cyclictest0-21swapper/300:37:173
266059940,4cyclictest0-21swapper/300:30:013
266059940,4cyclictest0-21swapper/300:24:453
266059940,3cyclictest29427-21df_inode19:15:003
266059940,3cyclictest2148-21ssh23:10:023
266059940,3cyclictest16625-21cat23:50:003
266059940,3cyclictest12455-21rm21:36:443
266059940,3cyclictest11483-21/usr/sbin/munin23:30:193
266049943,1cyclictest20235-21/usr/sbin/munin20:00:132
266049942,2cyclictest3091-21ssh00:31:332
266049942,1cyclictest802-21snmpd23:27:052
266049942,1cyclictest802-21snmpd22:50:452
266049942,1cyclictest802-21snmpd22:05:082
266049942,1cyclictest802-21snmpd21:16:262
266049942,1cyclictest802-21snmpd19:50:012
266049941,3cyclictest57150irq/125-eth020:25:202
266049940,4cyclictest24491-21ssh22:31:482
266049940,4cyclictest18319-21ssh23:34:272
266049940,4cyclictest0-21swapper/223:57:562
266049940,4cyclictest0-21swapper/223:05:112
266049940,4cyclictest0-21swapper/222:45:132
266049940,4cyclictest0-21swapper/222:21:002
266049940,4cyclictest0-21swapper/222:15:062
266049940,4cyclictest0-21swapper/221:40:122
266049940,4cyclictest0-21swapper/221:35:132
266049940,4cyclictest0-21swapper/221:28:412
266049940,4cyclictest0-21swapper/220:35:182
266049940,4cyclictest0-21swapper/200:36:022
266049940,4cyclictest0-21swapper/200:26:322
266049940,3cyclictest7589-21ssh23:12:182
266049940,3cyclictest6425-21cat00:00:212
266049940,3cyclictest30152-21/usr/sbin/munin20:20:112
266049940,3cyclictest26002-21diskstats22:00:152
266049940,3cyclictest22245-21users21:05:242
266049940,3cyclictest11352-21irqstats22:25:182
266049940,3cyclictest0-21swapper/222:00:012
266049940,3cyclictest0-21swapper/200:05:122
266049940,2cyclictest21610-21sed23:35:202
266049940,1cyclictest8129-21diskstats22:40:132
266049940,1cyclictest7123-21/usr/sbin/munin23:45:222
266049940,1cyclictest29859-21tr23:40:122
266049940,1cyclictest2865-21/usr/sbin/munin20:30:132
266049940,1cyclictest18893-21sed23:50:202
266049940,1cyclictest15435-21/usr/sbin/munin20:55:212
266049940,1cyclictest12965-21/usr/sbin/munin20:50:152
266049940,0cyclictest0-21swapper/223:01:352
266049940,0cyclictest0-21swapper/219:38:192
266009944,0cyclictest0-21swapper/123:55:151
266009944,0cyclictest0-21swapper/123:39:151
266009944,0cyclictest0-21swapper/123:21:131
266009944,0cyclictest0-21swapper/123:21:131
266009944,0cyclictest0-21swapper/100:19:431
266009941,2cyclictest0-21swapper/123:30:111
266009941,2cyclictest0-21swapper/123:00:131
266009941,2cyclictest0-21swapper/122:55:131
266009941,2cyclictest0-21swapper/122:10:121
266009941,2cyclictest0-21swapper/121:50:111
266009941,2cyclictest0-21swapper/121:20:141
266009941,2cyclictest0-21swapper/121:00:131
266009941,2cyclictest0-21swapper/120:50:111
266009941,2cyclictest0-21swapper/120:30:111
266009941,2cyclictest0-21swapper/120:05:111
266009941,2cyclictest0-21swapper/119:25:121
266009941,2cyclictest0-21swapper/119:20:111
266009941,2cyclictest0-21swapper/100:25:121
266009941,2cyclictest0-21swapper/100:20:111
266009941,1cyclictest0-21swapper/122:20:111
266009941,1cyclictest0-21swapper/121:55:121
266009940,2cyclictest0-21swapper/121:10:141
266009940,2cyclictest0-21swapper/120:25:131
266009940,2cyclictest0-21swapper/119:30:111
265999944,0cyclictest0-21swapper/022:55:070
265999944,0cyclictest0-21swapper/019:50:200
265999944,0cyclictest0-21swapper/000:30:430
265999943,1cyclictest28702-21head22:50:160
265999943,1cyclictest20482-21tr21:05:150
265999942,2cyclictest29201-21kworker/0:122:46:020
265999942,2cyclictest29201-21kworker/0:122:21:570
265999942,1cyclictest802-21snmpd23:55:060
265999942,1cyclictest802-21snmpd22:00:260
265999942,1cyclictest802-21snmpd19:30:110
265999942,1cyclictest29897-21latency_hist20:20:010
265999941,3cyclictest802-21snmpd21:24:450
265999941,1cyclictest0-21swapper/023:05:120
265999940,4cyclictest0-21swapper/023:35:120
265999940,4cyclictest0-21swapper/021:29:370
265999940,4cyclictest0-21swapper/021:10:140
265999940,4cyclictest0-21swapper/000:26:160
265999940,4cyclictest0-21swapper/000:15:380
265999940,4cyclictest0-21swapper/000:05:110
265999940,3cyclictest8518-21perl19:35:130
265999940,3cyclictest7710-21diskstats23:45:140
265999940,3cyclictest5052-21df00:00:140
265999940,3cyclictest4944-21cron19:30:010
265999940,3cyclictest29435-21users19:15:000
265999940,3cyclictest29346-21ssh23:40:010
265999940,3cyclictest24019-21ssh00:10:030
265999940,3cyclictest22784-21/usr/sbin/munin22:15:200
265999940,3cyclictest22690-21date20:05:000
265999940,3cyclictest18178-21memory23:50:160
265999940,3cyclictest16496-21/usr/sbin/munin23:00:190
265999940,3cyclictest14034-21ssh23:31:430
265999940,3cyclictest12236-21ssh21:36:360
265999940,3cyclictest11810-21/usr/sbin/munin20:45:200
265999940,3cyclictest0-21swapper/020:50:010
265999940,2cyclictest0-21swapper/021:45:180
265999940,1cyclictest1151-21cat21:15:140
266059933,0cyclictest40-21ksoftirqd/320:20:123
266059930,3cyclictest31629-21apt-get23:25:023
266059930,3cyclictest22637-21diskmemload23:35:043
266059930,3cyclictest0-21swapper/322:45:123
266059930,3cyclictest0-21swapper/321:55:133
266059930,3cyclictest0-21swapper/321:00:113
266059930,3cyclictest0-21swapper/320:50:013
266059930,3cyclictest0-21swapper/320:25:143
266059930,3cyclictest0-21swapper/320:15:013
266059930,3cyclictest0-21swapper/320:10:123
266059930,3cyclictest0-21swapper/320:05:013
266059930,3cyclictest0-21swapper/319:40:113
266059930,3cyclictest0-21swapper/319:20:103
266059930,3cyclictest0-21swapper/319:10:113
266059930,2cyclictest5548-21cstates19:30:133
266059930,2cyclictest2647-21latency_hist22:05:003
266049932,1cyclictest29014-21kworker/2:221:00:052
266049932,1cyclictest27105-21cat19:10:132
266049932,1cyclictest2647-21rm19:25:002
266049931,2cyclictest57150irq/125-eth021:45:032
266049930,3cyclictest30112-21apt22:35:132
266049930,3cyclictest25182-21chrt20:10:132
266049930,3cyclictest22925-21sh21:10:032
266049930,3cyclictest22228-21/usr/sbin/munin23:20:142
266049930,3cyclictest22228-21/usr/sbin/munin23:20:132
266049930,3cyclictest10837-21expr19:40:132
266049930,3cyclictest10295-21/usr/sbin/munin20:45:112
266049930,3cyclictest0-21swapper/223:15:102
266049930,3cyclictest0-21swapper/222:55:132
266049930,3cyclictest0-21swapper/222:10:122
266049930,3cyclictest0-21swapper/221:50:122
266049930,3cyclictest0-21swapper/221:20:042
266049930,3cyclictest0-21swapper/220:40:022
266049930,3cyclictest0-21swapper/220:15:122
266049930,3cyclictest0-21swapper/220:05:122
266049930,3cyclictest0-21swapper/219:55:032
266049930,3cyclictest0-21swapper/219:45:122
266049930,3cyclictest0-21swapper/219:30:082
266049930,3cyclictest0-21swapper/219:20:022
266049930,3cyclictest0-21swapper/219:15:012
266049930,3cyclictest0-21swapper/200:10:032
266009932,1cyclictest0-21swapper/123:50:131
266009932,1cyclictest0-21swapper/100:05:111
266009931,2cyclictest0-21swapper/123:45:131
266009931,2cyclictest0-21swapper/100:00:111
266009931,1cyclictest0-21swapper/123:25:021
266009931,1cyclictest0-21swapper/122:45:111
266009931,1cyclictest0-21swapper/121:20:001
266009931,1cyclictest0-21swapper/121:05:151
266009931,1cyclictest0-21swapper/120:55:121
266009931,1cyclictest0-21swapper/120:45:121
266009931,1cyclictest0-21swapper/120:35:101
266009931,1cyclictest0-21swapper/120:15:141
266009931,1cyclictest0-21swapper/120:10:131
266009931,1cyclictest0-21swapper/120:00:111
266009931,1cyclictest0-21swapper/119:15:141
266009930,2cyclictest0-21swapper/123:40:101
266009930,2cyclictest0-21swapper/121:30:131
266009930,2cyclictest0-21swapper/120:40:141
266009930,2cyclictest0-21swapper/119:55:121
266009930,2cyclictest0-21swapper/119:45:131
266009930,2cyclictest0-21swapper/100:35:121
266009930,2cyclictest0-21swapper/100:30:101
266009930,2cyclictest0-21swapper/100:10:111
265999931,2cyclictest13014-21tr19:45:130
265999931,1cyclictest0-21swapper/020:35:090
265999930,3cyclictest7904-21tr22:40:130
265999930,3cyclictest32623-21apt-get20:25:140
265999930,3cyclictest30402-21ssh21:30:040
265999930,3cyclictest22637-21diskmemload00:20:060
265999930,3cyclictest2183-21rm23:10:030
265999930,3cyclictest18839-21memory19:55:190
265999930,3cyclictest0-21swapper/021:50:110
265999930,3cyclictest0-21swapper/021:00:110
265999930,3cyclictest0-21swapper/020:55:060
265999930,3cyclictest0-21swapper/020:20:120
265999930,3cyclictest0-21swapper/020:10:050
265999930,3cyclictest0-21swapper/020:00:120
265999930,3cyclictest0-21swapper/019:40:110
265999930,3cyclictest0-21swapper/019:20:110
265999930,3cyclictest0-21swapper/019:10:110
265999930,2cyclictest0-21swapper/020:40:140
265999930,2cyclictest0-21swapper/020:30:000
266009920,1cyclictest0-21swapper/122:35:011
266009920,1cyclictest0-21swapper/119:10:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional