You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-17 - 22:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot4.osadl.org (updated Sun May 17, 2026 12:44:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
257052630chrt46250irq/120-QMan10:48:551
257052630chrt46250irq/120-QMan10:48:551
257052630chrt46250irq/120-QMan10:48:551
71570rcu_preempt0-21swapper/107:33:141
71570rcu_preempt0-21swapper/107:33:141
71570rcu_preempt0-21swapper/107:33:141
71500rcu_preempt0-21swapper/012:08:040
71500rcu_preempt0-21swapper/012:08:040
71490rcu_preempt0-21swapper/312:32:593
71490rcu_preempt0-21swapper/312:32:593
46050480irq/122-QManpo20610-2110:48:550
46050480irq/122-QManpo20610-2110:48:550
71470rcu_preempt0-21swapper/109:28:241
71470rcu_preempt0-21swapper/109:28:241
46050470irq/122-QManpo1959-2110:48:550
46050470irq/122-QManpo1959-2110:48:550
71460rcu_preempt0-21swapper/111:13:311
71460rcu_preempt0-21swapper/111:13:311
71460rcu_preempt0-21swapper/111:13:311
22148994524cyclictest22039-21irqstats09:08:133
22148994524cyclictest22039-21irqstats09:08:133
22148994518cyclictest0-21swapper/312:26:153
22148994518cyclictest0-21swapper/312:26:153
22148994513cyclictest0-21swapper/309:54:493
22148994513cyclictest0-21swapper/309:54:493
22148994513cyclictest0-21swapper/309:54:493
22148994423cyclictest10359-21ntp_states09:48:193
22148994423cyclictest10359-21ntp_states09:48:193
22148994423cyclictest10359-21ntp_states09:48:193
71430rcu_preempt0-21swapper/112:17:061
71430rcu_preempt0-21swapper/112:17:061
71430rcu_preempt0-21swapper/112:17:061
71430rcu_preempt0-21swapper/107:08:121
71430rcu_preempt0-21swapper/107:08:121
71430rcu_preempt0-21swapper/012:38:040
71430rcu_preempt0-21swapper/012:38:040
71430rcu_preempt0-21swapper/011:54:440
71430rcu_preempt0-21swapper/011:54:440
71430rcu_preempt0-21swapper/011:54:440
46050430irq/122-QManpo7006-2110:48:550
46050430irq/122-QManpo7006-2110:48:550
46050430irq/122-QManpo7006-2110:48:550
22148994322cyclictest4941-21users10:38:293
22148994322cyclictest4941-21users10:38:293
22148994322cyclictest32767-21users07:48:233
22148994322cyclictest32767-21users07:48:233
22148994316cyclictest6209-21sendmail-msp11:48:213
22148994316cyclictest6209-21sendmail-msp11:48:213
22148994316cyclictest6209-21sendmail-msp11:48:213
22148994314cyclictest23627-21meminfo09:13:153
22148994314cyclictest23627-21meminfo09:13:153
22148994314cyclictest23627-21meminfo09:13:153
22148994313cyclictest0-21swapper/312:22:273
22148994313cyclictest0-21swapper/312:22:273
22148994220cyclictest7744-21ntp_states09:43:213
22148994220cyclictest7744-21ntp_states09:43:213
71410rcu_preempt10134-1kworker/1:2H08:23:341
71410rcu_preempt10134-1kworker/1:2H08:23:341
71410rcu_preempt0-21swapper/010:18:040
71410rcu_preempt0-21swapper/010:18:040
71410rcu_preempt0-21swapper/010:18:040
22148994121cyclictest22867-21df11:13:113
22148994121cyclictest22867-21df11:13:113
22148994121cyclictest22867-21df11:13:113
22148994121cyclictest16863-21munin-run12:02:543
22148994121cyclictest16863-21munin-run12:02:543
22148994120cyclictest23333-21diskstats10:13:123
22148994120cyclictest23333-21diskstats10:13:123
22148994120cyclictest23333-21diskstats10:13:123
22148994120cyclictest1959-21runrttasks10:03:043
22148994120cyclictest1959-21runrttasks10:03:043
22148994119cyclictest11933-21ssh11:53:143
22148994119cyclictest11933-21ssh11:53:143
22148994119cyclictest11933-21ssh11:53:143
71400rcu_preempt21157-21ssh11:08:541
71400rcu_preempt21157-21ssh11:08:541
71400rcu_preempt21157-21ssh11:08:541
71400rcu_preempt16907-21copy12:03:061
71400rcu_preempt16907-21copy12:03:061
71400rcu_preempt0-21swapper/111:37:591
71400rcu_preempt0-21swapper/111:37:591
71400rcu_preempt0-21swapper/111:37:591
71400rcu_preempt0-21swapper/110:43:451
71400rcu_preempt0-21swapper/110:43:451
71400rcu_preempt0-21swapper/009:59:470
71400rcu_preempt0-21swapper/009:59:470
71400rcu_preempt0-21swapper/009:59:470
46050400irq/122-QManpo0-210
46050400irq/122-QManpo0-210
22148994021cyclictest13327-21ssh10:54:303
22148994021cyclictest13327-21ssh10:54:303
22148994021cyclictest13327-21ssh10:54:303
22148994020cyclictest21038-1kworker/3:4H11:13:023
22148994020cyclictest21038-1kworker/3:4H11:13:023
22148994020cyclictest17322-21diskstats12:03:133
22148994020cyclictest17322-21diskstats12:03:133
22148994020cyclictest16488-21/usr/sbin/munin08:48:143
22148994020cyclictest16488-21/usr/sbin/munin08:48:143
22148994019cyclictest31878-21irqstats09:28:163
22148994019cyclictest31878-21irqstats09:28:163
22148994018cyclictest20536-21sh12:08:243
22148994018cyclictest20536-21sh12:08:243
22148994017cyclictest0-21swapper/312:17:223
22148994017cyclictest0-21swapper/312:17:223
22148994017cyclictest0-21swapper/312:17:223
71390rcu_preempt6657-21ssh11:43:130
71390rcu_preempt6657-21ssh11:43:130
71390rcu_preempt6657-21ssh11:43:130
71390rcu_preempt0-21swapper/110:38:081
71390rcu_preempt0-21swapper/110:38:081
71390rcu_preempt0-21swapper/110:34:521
71390rcu_preempt0-21swapper/110:34:521
71390rcu_preempt0-21swapper/110:34:521
71390rcu_preempt0-21swapper/110:06:541
71390rcu_preempt0-21swapper/110:06:541
71390rcu_preempt0-21swapper/108:28:451
71390rcu_preempt0-21swapper/108:28:451
71390rcu_preempt0-21swapper/007:38:040
71390rcu_preempt0-21swapper/007:38:040
46050390irq/122-QManpo28883-2110:48:550
46050390irq/122-QManpo28883-2110:48:550
46050390irq/122-QManpo28883-2110:48:550
22148993922cyclictest20189-21munin-run09:02:553
22148993922cyclictest20189-21munin-run09:02:553
22148993920cyclictest21012-21sh10:08:203
22148993920cyclictest21012-21sh10:08:203
22148993920cyclictest0-21swapper/310:30:133
22148993920cyclictest0-21swapper/310:30:133
22148993919cyclictest3551-21munin-run08:02:543
22148993919cyclictest3551-21munin-run08:02:543
22148993919cyclictest30427-21latency_hist07:42:573
22148993919cyclictest30427-21latency_hist07:42:573
22148993919cyclictest21001-21/usr/sbin/munin09:03:233
22148993919cyclictest21001-21/usr/sbin/munin09:03:233
22148993919cyclictest15303-21ntp_states08:43:183
22148993919cyclictest15303-21ntp_states08:43:183
22148993918cyclictest711-21sed12:33:133
22148993918cyclictest711-21sed12:33:133
22148993918cyclictest711-21sed12:33:133
22148993918cyclictest0-21swapper/311:08:113
22148993917cyclictest0-21swapper/311:45:303
22148993917cyclictest0-21swapper/311:45:303
22148993917cyclictest0-21swapper/311:45:303
22148993917cyclictest0-21swapper/311:28:453
22148993917cyclictest0-21swapper/311:28:453
22148993917cyclictest0-21swapper/311:28:453
22148993917cyclictest0-21swapper/310:48:273
22148993917cyclictest0-21swapper/310:48:273
22148993917cyclictest0-21swapper/310:48:273
22148993916cyclictest0-21swapper/309:33:183
22148993916cyclictest0-21swapper/309:33:183
22148993916cyclictest0-21swapper/309:33:183
22148993916cyclictest0-21swapper/307:43:243
22148993916cyclictest0-21swapper/307:43:243
22146993927cyclictest14709-21latency_hist08:42:572
22146993927cyclictest14709-21latency_hist08:42:572
22146993927cyclictest14709-21latency_hist08:42:572
2214599398cyclictest23632-21memory09:13:161
2214599398cyclictest23632-21memory09:13:161
2214599398cyclictest23632-21memory09:13:161
71380rcu_preempt29915-21sh12:27:210
71380rcu_preempt29915-21sh12:27:210
71380rcu_preempt1507-21sh12:33:371
71380rcu_preempt1507-21sh12:33:371
71380rcu_preempt1507-21sh12:33:371
71380rcu_preempt0-21swapper/112:24:511
71380rcu_preempt0-21swapper/112:24:511
71380rcu_preempt0-21swapper/112:02:581
71380rcu_preempt0-21swapper/112:02:581
71380rcu_preempt0-21swapper/110:10:531
71380rcu_preempt0-21swapper/110:10:531
71380rcu_preempt0-21swapper/108:43:141
71380rcu_preempt0-21swapper/108:43:141
71380rcu_preempt0-21swapper/010:36:540
71380rcu_preempt0-21swapper/010:36:540
71380rcu_preempt0-21swapper/010:36:540
71380rcu_preempt0-21swapper/010:32:190
71380rcu_preempt0-21swapper/010:32:190
46050380irq/122-QManpo3565-2110:48:550
46050380irq/122-QManpo3565-2110:48:550
46050380irq/122-QManpo0-210
46050380irq/122-QManpo0-210
46050380irq/122-QManpo0-210
22148993820cyclictest28880-21/usr/sbin/munin09:23:213
22148993820cyclictest28880-21/usr/sbin/munin09:23:213
22148993820cyclictest28880-21/usr/sbin/munin09:23:213
22148993820cyclictest22234-21/usr/sbin/munin07:13:093
22148993820cyclictest22234-21/usr/sbin/munin07:13:093
22148993820cyclictest15351-21irqstats09:58:153
22148993820cyclictest15351-21irqstats09:58:153
22148993820cyclictest15351-21irqstats09:58:153
22148993819cyclictest8079-21ssh10:44:263
22148993819cyclictest8079-21ssh10:44:263
22148993819cyclictest25471-21df11:18:103
22148993819cyclictest25471-21df11:18:103
22148993818cyclictest5874-21ssh12:43:003
22148993818cyclictest5874-21ssh12:43:003
22148993818cyclictest3562-21/usr/sbin/munin11:38:133
22148993818cyclictest3562-21/usr/sbin/munin11:38:133
22148993818cyclictest26568-21diskstats07:28:113
22148993818cyclictest26568-21diskstats07:28:113
22148993818cyclictest1860-21grep11:33:263
22148993818cyclictest1860-21grep11:33:263
22148993818cyclictest1860-21grep11:33:263
22148993817cyclictest0-21swapper/310:37:513
22148993817cyclictest0-21swapper/310:37:513
22148993817cyclictest0-21swapper/310:37:513
22148993817cyclictest0-21swapper/310:23:003
22148993817cyclictest0-21swapper/310:23:003
22148993815cyclictest27930-21sendmail-msp11:25:363
22148993815cyclictest27930-21sendmail-msp11:25:363
22148993815cyclictest27930-21sendmail-msp11:25:363
1599380migration/03876-21runrttasks09:36:580
1599380migration/03876-21runrttasks09:36:580
1599380migration/03876-21runrttasks09:36:580
71370rcu_preempt31112-21latency_hist10:28:021
71370rcu_preempt28377-21/usr/sbin/munin11:23:120
71370rcu_preempt28377-21/usr/sbin/munin11:23:120
71370rcu_preempt28377-21/usr/sbin/munin11:23:120
71370rcu_preempt20049-21taskset09:01:200
71370rcu_preempt20049-21taskset09:01:200
71370rcu_preempt17051-21apt-get12:03:060
71370rcu_preempt17051-21apt-get12:03:060
71370rcu_preempt13245-21diskmemload10:54:141
71370rcu_preempt13245-21diskmemload10:54:141
71370rcu_preempt13245-21diskmemload10:54:141
71370rcu_preempt10066-21sh09:48:111
71370rcu_preempt10066-21sh09:48:111
71370rcu_preempt10066-21sh09:48:111
71370rcu_preempt0-21swapper/211:53:242
71370rcu_preempt0-21swapper/211:53:242
71370rcu_preempt0-21swapper/211:53:242
71370rcu_preempt0-21swapper/112:40:511
71370rcu_preempt0-21swapper/112:40:511
71370rcu_preempt0-21swapper/112:18:161
71370rcu_preempt0-21swapper/112:18:161
71370rcu_preempt0-21swapper/109:56:471
71370rcu_preempt0-21swapper/109:56:471
71370rcu_preempt0-21swapper/109:56:471
71370rcu_preempt0-21swapper/109:33:421
71370rcu_preempt0-21swapper/109:33:421
71370rcu_preempt0-21swapper/109:33:421
71370rcu_preempt0-21swapper/107:17:591
71370rcu_preempt0-21swapper/011:09:440
71370rcu_preempt0-21swapper/011:09:440
71370rcu_preempt0-21swapper/011:09:440
71370rcu_preempt0-21swapper/009:43:210
71370rcu_preempt0-21swapper/009:43:210
71370rcu_preempt0-21swapper/008:45:240
71370rcu_preempt0-21swapper/008:45:240
46650370irq/116-QManpo22055-2110:48:553
46650370irq/116-QManpo22055-2110:48:553
46050370irq/122-QManpo0-210
46050370irq/122-QManpo0-210
46050370irq/122-QManpo0-210
46050370irq/122-QManpo0-210
46050370irq/122-QManpo0-210
46050370irq/122-QManpo0-210
46050370irq/122-QManpo0-210
46050370irq/122-QManpo0-210
22148993720cyclictest8008-21df08:18:063
22148993720cyclictest8008-21df08:18:063
22148993718cyclictest26018-21cat10:18:163
22148993718cyclictest26018-21cat10:18:163
22148993718cyclictest26018-21cat10:18:163
22148993717cyclictest28840-21ssh09:22:593
22148993717cyclictest28840-21ssh09:22:593
22148993717cyclictest17430-21/usr/sbin/munin11:03:083
22148993717cyclictest17430-21/usr/sbin/munin11:03:083
22148993717cyclictest17430-21/usr/sbin/munin11:03:083
22148993717cyclictest0-21swapper/307:22:553
22148993717cyclictest0-21swapper/307:22:553
22148993716cyclictest25957-21taskset07:25:073
22148993716cyclictest25957-21taskset07:25:073
22148993716cyclictest25957-21taskset07:25:073
22145993716cyclictest10342-21users10:48:241
22145993716cyclictest10342-21users10:48:241
22145993716cyclictest10342-21users10:48:241
71360rcu_preempt9106-21sendmail-msp08:28:160
71360rcu_preempt9106-21sendmail-msp08:28:160
71360rcu_preempt6906-21ssh09:42:430
71360rcu_preempt6906-21ssh09:42:430
71360rcu_preempt27691-21sh09:20:151
71360rcu_preempt27691-21sh09:20:151
71360rcu_preempt26811-21sh11:19:571
71360rcu_preempt26811-21sh11:19:571
71360rcu_preempt1329-21/usr/sbin/munin10:33:082
71360rcu_preempt1329-21/usr/sbin/munin10:33:082
71360rcu_preempt1329-21/usr/sbin/munin10:33:082
71360rcu_preempt11459-21kworker/1:011:55:241
71360rcu_preempt11459-21kworker/1:011:55:241
71360rcu_preempt11459-21kworker/1:011:55:241
71360rcu_preempt10377-21sh11:49:460
71360rcu_preempt10377-21sh11:49:460
71360rcu_preempt10377-21sh11:49:460
71360rcu_preempt0-21swapper/112:32:011
71360rcu_preempt0-21swapper/112:32:011
71360rcu_preempt0-21swapper/112:10:461
71360rcu_preempt0-21swapper/112:10:461
71360rcu_preempt0-21swapper/111:48:031
71360rcu_preempt0-21swapper/111:48:031
71360rcu_preempt0-21swapper/111:48:031
71360rcu_preempt0-21swapper/111:47:111
71360rcu_preempt0-21swapper/111:47:111
71360rcu_preempt0-21swapper/111:47:111
71360rcu_preempt0-21swapper/111:29:311
71360rcu_preempt0-21swapper/111:29:311
71360rcu_preempt0-21swapper/111:29:311
71360rcu_preempt0-21swapper/111:06:081
71360rcu_preempt0-21swapper/111:06:081
71360rcu_preempt0-21swapper/111:06:081
71360rcu_preempt0-21swapper/111:01:171
71360rcu_preempt0-21swapper/111:01:171
71360rcu_preempt0-21swapper/109:46:251
71360rcu_preempt0-21swapper/109:46:251
71360rcu_preempt0-21swapper/109:07:251
71360rcu_preempt0-21swapper/109:07:251
71360rcu_preempt0-21swapper/012:14:280
71360rcu_preempt0-21swapper/012:14:280
71360rcu_preempt0-21swapper/012:14:280
71360rcu_preempt0-21swapper/011:01:390
71360rcu_preempt0-21swapper/011:01:390
71360rcu_preempt0-21swapper/010:08:240
71360rcu_preempt0-21swapper/010:08:240
71360rcu_preempt0-21swapper/009:12:530
71360rcu_preempt0-21swapper/009:12:530
71360rcu_preempt0-21swapper/007:37:560
71360rcu_preempt0-21swapper/007:37:560
71360rcu_preempt0-21swapper/007:37:560
46450360irq/118-QManpo17434-2110:48:552
46450360irq/118-QManpo17434-2110:48:552
46450360irq/118-QManpo17434-2110:48:552
46450360irq/118-QManpo0-2110:48:552
46450360irq/118-QManpo0-2110:48:552
46050360irq/122-QManpo18240-2110:48:550
46050360irq/122-QManpo18240-2110:48:550
46050360irq/122-QManpo13397-2110:48:550
46050360irq/122-QManpo13397-2110:48:550
46050360irq/122-QManpo13397-2110:48:550
22148993622cyclictest6863-21meminfo08:13:153
22148993622cyclictest6863-21meminfo08:13:153
22148993621cyclictest28034-21irqstats07:33:133
22148993621cyclictest28034-21irqstats07:33:133
22148993621cyclictest28034-21irqstats07:33:133
22148993621cyclictest17964-21meminfo08:53:133
22148993621cyclictest17964-21meminfo08:53:133
22148993621cyclictest17964-21meminfo08:53:133
22148993616cyclictest5064-21which09:38:223
22148993616cyclictest5064-21which09:38:223
22148993616cyclictest0-21swapper/308:42:553
22148993616cyclictest0-21swapper/308:42:553
22148993616cyclictest0-21swapper/308:42:553
71350rcu_preempt477-1kworker/0:3H12:33:400
71350rcu_preempt477-1kworker/0:3H12:33:400
71350rcu_preempt477-1kworker/0:3H12:33:400
71350rcu_preempt31948-21sh12:30:350
71350rcu_preempt31948-21sh12:30:350
71350rcu_preempt30354-21crond07:42:541
71350rcu_preempt30354-21crond07:42:541
71350rcu_preempt28856-21irqstats10:23:162
71350rcu_preempt28856-21irqstats10:23:162
71350rcu_preempt2798-21sh11:36:080
71350rcu_preempt2798-21sh11:36:080
71350rcu_preempt2798-21sh11:36:080
71350rcu_preempt0-21swapper/212:00:082
71350rcu_preempt0-21swapper/212:00:082
71350rcu_preempt0-21swapper/111:40:051
71350rcu_preempt0-21swapper/111:40:051
71350rcu_preempt0-21swapper/111:27:081
71350rcu_preempt0-21swapper/111:27:081
71350rcu_preempt0-21swapper/111:27:081
71350rcu_preempt0-21swapper/110:24:271
71350rcu_preempt0-21swapper/110:13:251
71350rcu_preempt0-21swapper/110:13:251
71350rcu_preempt0-21swapper/110:13:251
71350rcu_preempt0-21swapper/110:02:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional