You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 13:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot4.osadl.org (updated Sun Nov 30, 2025 00:53:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
71700rcu_preempt0-21swapper/021:39:150
71700rcu_preempt0-21swapper/021:39:150
71680rcu_preempt0-21swapper/223:33:552
71680rcu_preempt0-21swapper/223:33:552
3829994420cyclictest28912-21meminfo00:28:083
3829994420cyclictest28912-21meminfo00:28:083
71430rcu_preempt2475-1kworker/1:1H21:38:271
71430rcu_preempt2475-1kworker/1:1H21:38:271
46250420irq/120-QManpo8626-2109:24:361
46250420irq/120-QManpo8626-2109:24:361
46250420irq/120-QManpo8626-2109:24:361
3829994218cyclictest0-21swapper/321:52:583
3829994218cyclictest0-21swapper/321:52:583
71410rcu_preempt0-21swapper/100:04:201
71410rcu_preempt0-21swapper/100:04:201
46050410irq/122-QManpo0-210
46050410irq/122-QManpo0-210
3829994120cyclictest25459-21ntp_states22:18:093
3829994120cyclictest25459-21ntp_states22:18:093
3829994119cyclictest0-21swapper/300:25:323
3829994119cyclictest0-21swapper/300:25:323
3829994119cyclictest0-21swapper/300:25:323
3829994118cyclictest0-21swapper/320:18:093
3829994118cyclictest0-21swapper/320:18:093
3829994114cyclictest31909-21ssh22:31:013
3829994114cyclictest31909-21ssh22:31:013
71400rcu_preempt9943-1kworker/1:2H21:59:311
71400rcu_preempt9943-1kworker/1:2H21:59:311
71400rcu_preempt9943-1kworker/1:2H21:59:311
71400rcu_preempt0-21swapper/200:23:582
71400rcu_preempt0-21swapper/200:23:582
71400rcu_preempt0-21swapper/200:23:582
71400rcu_preempt0-21swapper/122:57:131
71400rcu_preempt0-21swapper/122:57:131
71400rcu_preempt0-21swapper/122:57:131
71400rcu_preempt0-21swapper/100:27:511
46050400irq/122-QManpo22875-2109:24:360
46050400irq/122-QManpo22875-2109:24:360
3829994019cyclictest22886-21munin-run00:17:443
3829994019cyclictest22886-21munin-run00:17:443
3829994019cyclictest0-21swapper/321:52:463
3829994019cyclictest0-21swapper/321:52:463
3829994017cyclictest0-21swapper/322:57:003
3829994017cyclictest0-21swapper/322:57:003
3829994017cyclictest0-21swapper/322:57:003
71390rcu_preempt31635-21apt-get23:32:561
71390rcu_preempt31635-21apt-get23:32:561
71390rcu_preempt2474-1kworker/2:1H21:58:092
71390rcu_preempt2474-1kworker/2:1H21:58:092
71390rcu_preempt2474-1kworker/2:1H21:58:092
71390rcu_preempt0-21swapper/122:02:561
71390rcu_preempt0-21swapper/122:02:561
46050390irq/122-QManpo0-210
46050390irq/122-QManpo0-210
46050390irq/122-QManpo0-210
46050390irq/122-QManpo0-210
46050390irq/122-QManpo0-210
3829993920cyclictest3410-21ntp_states22:38:083
3829993920cyclictest3410-21ntp_states22:38:083
3829993919cyclictest1197-21users22:33:173
3829993919cyclictest1197-21users22:33:173
3829993919cyclictest1197-21users22:33:173
3829993917cyclictest14342-21irqstats01:03:053
3829993917cyclictest14342-21irqstats01:03:053
3829993917cyclictest0-21swapper/323:08:083
3829993917cyclictest0-21swapper/323:08:083
3829993916cyclictest0-21swapper/322:06:263
3829993916cyclictest0-21swapper/322:06:263
3829993915cyclictest0-21swapper/322:43:113
3829993915cyclictest0-21swapper/322:43:113
3829993915cyclictest0-21swapper/320:58:053
3829993915cyclictest0-21swapper/320:58:053
3829993915cyclictest0-21swapper/319:47:573
3829993915cyclictest0-21swapper/300:42:583
3829993915cyclictest0-21swapper/300:42:583
3829993915cyclictest0-21swapper/300:42:583
71380rcu_preempt16947-21apt-get22:03:100
71380rcu_preempt16947-21apt-get22:03:100
71380rcu_preempt12713-21taskset00:58:540
71380rcu_preempt12713-21taskset00:58:540
71380rcu_preempt0-21swapper/100:39:181
71380rcu_preempt0-21swapper/100:39:181
71380rcu_preempt0-21swapper/100:39:181
71380rcu_preempt0-21swapper/021:57:570
71380rcu_preempt0-21swapper/021:57:570
71380rcu_preempt0-21swapper/021:57:570
71380rcu_preempt0-21swapper/021:53:020
71380rcu_preempt0-21swapper/021:53:020
71380rcu_preempt0-21swapper/020:27:590
71380rcu_preempt0-21swapper/020:27:590
3829993819cyclictest13430-21users23:58:123
3829993819cyclictest13430-21users23:58:123
3829993818cyclictest7130-21grep21:43:083
3829993818cyclictest7130-21grep21:43:083
3829993818cyclictest7130-21grep21:43:083
3829993817cyclictest29211-21df_abs23:28:003
3829993817cyclictest29211-21df_abs23:28:003
3829993816cyclictest23310-21df_inode00:18:003
3829993816cyclictest23310-21df_inode00:18:003
3829993816cyclictest23310-21df_inode00:18:003
3829993816cyclictest0-21swapper/322:57:593
3829993816cyclictest0-21swapper/322:57:593
3829993816cyclictest0-21swapper/320:47:453
3829993816cyclictest0-21swapper/320:47:453
3829993814cyclictest0-21swapper/300:53:143
3829993814cyclictest0-21swapper/300:53:143
3829993814cyclictest0-21swapper/300:41:373
3829993814cyclictest0-21swapper/300:41:373
3829993814cyclictest0-21swapper/300:41:373
3829993813cyclictest0-21swapper/323:38:073
3829993813cyclictest0-21swapper/323:38:073
3829993812cyclictest21438-21ssh22:10:363
3829993812cyclictest21438-21ssh22:10:363
3829993811cyclictest9673-21ssh22:50:293
3829993811cyclictest9673-21ssh22:50:293
3829993811cyclictest9673-21ssh22:50:293
291082380chrt23751-1kworker/0:2H21:12:150
291082380chrt23751-1kworker/0:2H21:12:150
111380rcuc/016888-21ssh01:08:080
111380rcuc/016888-21ssh01:08:080
111380rcuc/016888-21ssh01:08:080
71370rcu_preempt27487-1kworker/0:1H23:27:050
71370rcu_preempt27487-1kworker/0:1H23:27:050
71370rcu_preempt0-21swapper/222:18:062
71370rcu_preempt0-21swapper/222:18:062
71370rcu_preempt0-21swapper/122:45:411
71370rcu_preempt0-21swapper/122:45:411
71370rcu_preempt0-21swapper/121:36:291
71370rcu_preempt0-21swapper/121:36:291
71370rcu_preempt0-21swapper/121:36:291
71370rcu_preempt0-21swapper/120:48:051
71370rcu_preempt0-21swapper/120:48:051
71370rcu_preempt0-21swapper/100:33:061
71370rcu_preempt0-21swapper/100:33:061
71370rcu_preempt0-21swapper/100:33:061
71370rcu_preempt0-21swapper/100:11:141
71370rcu_preempt0-21swapper/100:11:141
71370rcu_preempt0-21swapper/023:15:340
71370rcu_preempt0-21swapper/023:15:340
71370rcu_preempt0-21swapper/023:04:390
71370rcu_preempt0-21swapper/023:04:390
71370rcu_preempt0-21swapper/021:28:080
71370rcu_preempt0-21swapper/021:28:080
71370rcu_preempt0-21swapper/020:22:420
71370rcu_preempt0-21swapper/020:22:420
46050370irq/122-QManpo6946-2109:24:360
46050370irq/122-QManpo6946-2109:24:360
46050370irq/122-QManpo6946-2109:24:360
46050370irq/122-QManpo30407-2109:24:360
46050370irq/122-QManpo30407-2109:24:360
46050370irq/122-QManpo0-210
46050370irq/122-QManpo0-210
3829993716cyclictest0-21swapper/300:08:103
3829993716cyclictest0-21swapper/300:08:103
3829993715cyclictest29168-21sort21:12:433
3829993715cyclictest29168-21sort21:12:433
3829993715cyclictest0-21swapper/323:33:003
3829993715cyclictest0-21swapper/323:33:003
3829993715cyclictest0-21swapper/321:58:053
3829993715cyclictest0-21swapper/321:58:053
3829993715cyclictest0-21swapper/321:58:053
3829993714cyclictest0-21swapper/322:23:023
3829993714cyclictest0-21swapper/322:23:023
3829993714cyclictest0-21swapper/322:23:023
3829993711cyclictest0-21swapper/323:05:243
3829993711cyclictest0-21swapper/323:05:243
71360rcu_preempt8433-21runrttasks00:50:370
71360rcu_preempt8433-21runrttasks00:50:370
71360rcu_preempt583-1runrttasks21:24:292
71360rcu_preempt583-1runrttasks21:24:292
71360rcu_preempt31452-21apt-get23:33:030
71360rcu_preempt31452-21apt-get23:33:030
71360rcu_preempt28463-21/usr/sbin/munin00:28:021
71360rcu_preempt28463-21/usr/sbin/munin00:28:021
71360rcu_preempt0-21swapper/321:35:013
71360rcu_preempt0-21swapper/321:35:013
71360rcu_preempt0-21swapper/321:35:013
71360rcu_preempt0-21swapper/222:43:432
71360rcu_preempt0-21swapper/222:43:432
71360rcu_preempt0-21swapper/200:42:442
71360rcu_preempt0-21swapper/200:42:442
71360rcu_preempt0-21swapper/200:42:442
71360rcu_preempt0-21swapper/200:03:052
71360rcu_preempt0-21swapper/200:03:052
71360rcu_preempt0-21swapper/123:59:271
71360rcu_preempt0-21swapper/123:59:271
71360rcu_preempt0-21swapper/123:56:031
71360rcu_preempt0-21swapper/123:56:031
71360rcu_preempt0-21swapper/123:48:201
71360rcu_preempt0-21swapper/123:48:201
71360rcu_preempt0-21swapper/023:11:040
71360rcu_preempt0-21swapper/023:11:040
71360rcu_preempt0-21swapper/022:47:590
71360rcu_preempt0-21swapper/022:47:590
71360rcu_preempt0-21swapper/022:47:590
71360rcu_preempt0-21swapper/022:33:030
71360rcu_preempt0-21swapper/022:33:030
71360rcu_preempt0-21swapper/022:33:030
71360rcu_preempt0-21swapper/021:27:450
71360rcu_preempt0-21swapper/021:27:450
71360rcu_preempt0-21swapper/020:58:050
71360rcu_preempt0-21swapper/020:58:050
71360rcu_preempt0-21swapper/001:03:140
71360rcu_preempt0-21swapper/001:03:140
46050360irq/122-QManpo27798-2109:24:360
46050360irq/122-QManpo27798-2109:24:360
46050360irq/122-QManpo27798-2109:24:360
3829993626cyclictest4354-21latency_hist23:42:523
3829993626cyclictest4354-21latency_hist23:42:523
3829993621cyclictest10031-21df_inode20:03:013
3829993621cyclictest10031-21df_inode20:03:013
3829993621cyclictest10031-21df_inode20:03:013
3829993619cyclictest22767-21memory20:48:083
3829993619cyclictest22767-21memory20:48:083
3829993617cyclictest9284-21chrt23:51:323
3829993617cyclictest9284-21chrt23:51:323
3829993616cyclictest0-21swapper/321:13:123
3829993616cyclictest0-21swapper/321:13:123
3829993616cyclictest0-21swapper/300:59:383
3829993616cyclictest0-21swapper/300:59:383
3829993616cyclictest0-21swapper/300:49:263
3829993616cyclictest0-21swapper/300:49:263
3829993616cyclictest0-21swapper/300:36:333
3829993616cyclictest0-21swapper/300:36:333
3829993616cyclictest0-21swapper/300:36:333
3829993615cyclictest0-21swapper/321:18:083
3829993615cyclictest0-21swapper/321:18:083
3829993614cyclictest22812-21ssh22:13:073
3829993614cyclictest22812-21ssh22:13:073
3829993614cyclictest22605-21ssh23:15:023
3829993614cyclictest22605-21ssh23:15:023
3829993614cyclictest0-21swapper/323:17:583
3829993614cyclictest0-21swapper/323:17:583
305202360sleep023751-1kworker/0:2H21:17:380
305202360sleep023751-1kworker/0:2H21:17:380
100550360irq/38-i2c-mpc0-21swapper/023:55:280
100550360irq/38-i2c-mpc0-21swapper/023:55:280
71350rcu_preempt31656-21taskset21:19:340
71350rcu_preempt31656-21taskset21:19:340
71350rcu_preempt19773-1kworker/0:2H22:43:150
71350rcu_preempt19773-1kworker/0:2H22:43:150
71350rcu_preempt12833-21df_inode20:13:010
71350rcu_preempt12833-21df_inode20:13:010
71350rcu_preempt12833-21df_inode20:13:010
71350rcu_preempt12353-21/usr/sbin/munin00:58:161
71350rcu_preempt12353-21/usr/sbin/munin00:58:161
71350rcu_preempt0-21swapper/222:59:332
71350rcu_preempt0-21swapper/222:59:332
71350rcu_preempt0-21swapper/222:53:172
71350rcu_preempt0-21swapper/222:53:172
71350rcu_preempt0-21swapper/222:53:172
71350rcu_preempt0-21swapper/222:11:382
71350rcu_preempt0-21swapper/222:11:382
71350rcu_preempt0-21swapper/221:14:522
71350rcu_preempt0-21swapper/221:14:522
71350rcu_preempt0-21swapper/200:49:102
71350rcu_preempt0-21swapper/200:49:102
71350rcu_preempt0-21swapper/200:37:012
71350rcu_preempt0-21swapper/200:37:012
71350rcu_preempt0-21swapper/200:37:012
71350rcu_preempt0-21swapper/200:13:162
71350rcu_preempt0-21swapper/200:13:162
71350rcu_preempt0-21swapper/123:41:351
71350rcu_preempt0-21swapper/123:41:351
71350rcu_preempt0-21swapper/123:13:271
71350rcu_preempt0-21swapper/123:13:271
71350rcu_preempt0-21swapper/122:51:311
71350rcu_preempt0-21swapper/122:51:311
71350rcu_preempt0-21swapper/122:51:311
71350rcu_preempt0-21swapper/122:28:381
71350rcu_preempt0-21swapper/122:28:381
71350rcu_preempt0-21swapper/121:49:091
71350rcu_preempt0-21swapper/121:49:091
71350rcu_preempt0-21swapper/121:45:401
71350rcu_preempt0-21swapper/121:45:401
71350rcu_preempt0-21swapper/121:45:401
71350rcu_preempt0-21swapper/100:23:361
71350rcu_preempt0-21swapper/100:23:361
71350rcu_preempt0-21swapper/021:51:520
71350rcu_preempt0-21swapper/021:51:520
71350rcu_preempt0-21swapper/021:34:470
71350rcu_preempt0-21swapper/021:34:470
71350rcu_preempt0-21swapper/021:34:470
71350rcu_preempt0-21swapper/020:47:460
71350rcu_preempt0-21swapper/020:47:460
71350rcu_preempt0-21swapper/000:18:090
71350rcu_preempt0-21swapper/000:18:090
71350rcu_preempt0-21swapper/000:18:090
46250350irq/120-QManpo13842-2109:24:361
46250350irq/120-QManpo13842-2109:24:361
46250350irq/120-QManpo13842-2109:24:361
46050350irq/122-QManpo27800-2109:24:360
46050350irq/122-QManpo27800-2109:24:360
46050350irq/122-QManpo27800-2109:24:360
46050350irq/122-QManpo25151-2109:24:360
46050350irq/122-QManpo25151-2109:24:360
46050350irq/122-QManpo2448-2109:24:360
46050350irq/122-QManpo2448-2109:24:360
46050350irq/122-QManpo19792-2109:24:360
46050350irq/122-QManpo19792-2109:24:360
46050350irq/122-QManpo10783-2109:24:360
46050350irq/122-QManpo10783-2109:24:360
46050350irq/122-QManpo10783-2109:24:360
46050350irq/122-QManpo0-210
46050350irq/122-QManpo0-210
46050350irq/122-QManpo0-210
46050350irq/122-QManpo0-210
46050350irq/122-QManpo0-210
46050350irq/122-QManpo0-210
46050350irq/122-QManpo0-210
46050350irq/122-QManpo0-210
3829993521cyclictest4162-21df_inode21:38:023
3829993521cyclictest4162-21df_inode21:38:023
3829993519cyclictest26815-21memory23:23:083
3829993519cyclictest26815-21memory23:23:083
3829993518cyclictest15791-21meminfo20:23:063
3829993518cyclictest15791-21meminfo20:23:063
3829993518cyclictest15791-21meminfo20:23:063
3829993515cyclictest0-21swapper/323:53:263
3829993515cyclictest0-21swapper/323:53:263
3829993515cyclictest0-21swapper/321:22:593
3829993515cyclictest0-21swapper/321:22:593
3829993515cyclictest0-21swapper/319:52:583
3829993515cyclictest0-21swapper/319:52:583
3829993515cyclictest0-21swapper/319:52:583
3829993514cyclictest11439-21diskstats20:08:023
3829993514cyclictest11439-21diskstats20:08:023
3829993513cyclictest0-21swapper/320:28:063
3829993513cyclictest0-21swapper/320:28:063
71340rcu_preempt6341-21ssh23:45:461
71340rcu_preempt6341-21ssh23:45:461
71340rcu_preempt5085-21ssh00:43:331
71340rcu_preempt5085-21ssh00:43:331
71340rcu_preempt5085-21ssh00:43:331
71340rcu_preempt4524-21ssh23:42:530
71340rcu_preempt4524-21ssh23:42:530
71340rcu_preempt24278-21ntp_states23:18:101
71340rcu_preempt24278-21ntp_states23:18:101
71340rcu_preempt22629-21if_eth322:13:031
71340rcu_preempt22629-21if_eth322:13:031
71340rcu_preempt19765-21/usr/sbin/munin22:08:011
71340rcu_preempt19765-21/usr/sbin/munin22:08:011
71340rcu_preempt0-21swapper/223:59:532
71340rcu_preempt0-21swapper/223:59:532
71340rcu_preempt0-21swapper/221:28:032
71340rcu_preempt0-21swapper/221:28:032
71340rcu_preempt0-21swapper/220:47:542
71340rcu_preempt0-21swapper/220:47:542
71340rcu_preempt0-21swapper/123:10:351
71340rcu_preempt0-21swapper/123:10:351
71340rcu_preempt0-21swapper/122:38:101
71340rcu_preempt0-21swapper/122:38:101
71340rcu_preempt0-21swapper/122:21:221
71340rcu_preempt0-21swapper/122:21:221
71340rcu_preempt0-21swapper/121:53:421
71340rcu_preempt0-21swapper/121:53:421
71340rcu_preempt0-21swapper/121:12:451
71340rcu_preempt0-21swapper/121:12:451
71340rcu_preempt0-21swapper/120:26:191
71340rcu_preempt0-21swapper/120:26:191
71340rcu_preempt0-21swapper/120:26:191
71340rcu_preempt0-21swapper/101:04:441
71340rcu_preempt0-21swapper/101:04:441
71340rcu_preempt0-21swapper/100:48:061
71340rcu_preempt0-21swapper/100:48:061
71340rcu_preempt0-21swapper/100:17:471
71340rcu_preempt0-21swapper/100:17:471
71340rcu_preempt0-21swapper/023:19:490
71340rcu_preempt0-21swapper/023:19:490
71340rcu_preempt0-21swapper/022:55:110
71340rcu_preempt0-21swapper/022:55:110
71340rcu_preempt0-21swapper/022:55:110
71340rcu_preempt0-21swapper/022:15:290
71340rcu_preempt0-21swapper/022:15:290
71340rcu_preempt0-21swapper/022:08:590
71340rcu_preempt0-21swapper/022:08:590
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional