You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-09 - 02:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot4.osadl.org (updated Sat May 09, 2026 00:44:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1800021460chrt46250irq/120-QMan10:48:551
1800021460chrt46250irq/120-QMan10:48:551
71670rcu_preempt0-21swapper/121:15:381
71670rcu_preempt0-21swapper/121:15:381
71570rcu_preempt0-21swapper/200:07:552
71570rcu_preempt0-21swapper/200:07:552
71570rcu_preempt0-21swapper/200:07:552
29700994920cyclictest1523-21/usr/sbin/munin22:18:041
29700994920cyclictest1523-21/usr/sbin/munin22:18:041
29700994920cyclictest1523-21/usr/sbin/munin22:18:041
29700994917cyclictest26053-21sendmail-msp23:03:201
29700994917cyclictest26053-21sendmail-msp23:03:201
71480rcu_preempt0-21swapper/123:11:161
71480rcu_preempt0-21swapper/123:11:161
71470rcu_preempt4583-21sendmail-msp23:33:351
71470rcu_preempt4583-21sendmail-msp23:33:351
71460rcu_preempt27763-21munin-run21:02:462
71460rcu_preempt27763-21munin-run21:02:462
71460rcu_preempt20372-21sh23:51:391
71460rcu_preempt20372-21sh23:51:391
71460rcu_preempt20372-21sh23:51:391
71460rcu_preempt0-21swapper/000:32:570
71460rcu_preempt0-21swapper/000:32:570
71460rcu_preempt0-21swapper/000:32:570
71450rcu_preempt19090-1kworker/1:0H21:52:161
71450rcu_preempt19090-1kworker/1:0H21:52:161
71450rcu_preempt19090-1kworker/1:0H21:52:161
71450rcu_preempt0-21swapper/122:04:091
71450rcu_preempt0-21swapper/122:04:091
46050450irq/122-QManpo25371-210
46050450irq/122-QManpo25371-210
29700994518cyclictest32357-21sendmail-msp19:23:241
29700994518cyclictest32357-21sendmail-msp19:23:241
29700994518cyclictest32357-21sendmail-msp19:23:241
29700994516cyclictest1474-21apt-get19:27:561
29700994516cyclictest1474-21apt-get19:27:561
71440rcu_preempt0-21swapper/100:29:241
71440rcu_preempt0-21swapper/100:29:241
71440rcu_preempt0-21swapper/100:29:241
71440rcu_preempt0-21swapper/023:09:220
71440rcu_preempt0-21swapper/023:09:220
71440rcu_preempt0-21swapper/019:12:500
71440rcu_preempt0-21swapper/019:12:500
29700994421cyclictest5764-21ssh23:23:231
29700994421cyclictest5764-21ssh23:23:231
29700994421cyclictest5764-21ssh23:23:231
71430rcu_preempt21709-21sh21:54:281
71430rcu_preempt21709-21sh21:54:281
71430rcu_preempt21709-21sh21:54:281
71430rcu_preempt19338-21runrttasks23:48:332
71430rcu_preempt19338-21runrttasks23:48:332
71430rcu_preempt19338-21runrttasks23:48:332
29700994322cyclictest6843-21ssh22:27:331
29700994322cyclictest6843-21ssh22:27:331
29700994322cyclictest6843-21ssh22:27:331
29700994322cyclictest1959-21runrttasks19:54:041
29700994322cyclictest1959-21runrttasks19:54:041
29700994321cyclictest8308-21wc19:52:461
29700994321cyclictest8308-21wc19:52:461
29700994321cyclictest8308-21wc19:52:461
29700994321cyclictest24256-21/usr/sbin/munin23:58:101
29700994321cyclictest24256-21/usr/sbin/munin23:58:101
29700994316cyclictest31085-21/usr/sbin/munin19:18:101
29700994316cyclictest31085-21/usr/sbin/munin19:18:101
29700994316cyclictest31085-21/usr/sbin/munin19:18:101
71420rcu_preempt27202-21sh19:09:371
71420rcu_preempt27202-21sh19:09:371
71420rcu_preempt26339-21sendmail-msp00:11:371
71420rcu_preempt26339-21sendmail-msp00:11:371
71420rcu_preempt26339-21sendmail-msp00:11:371
71420rcu_preempt12113-21diskmemload00:35:551
71420rcu_preempt12113-21diskmemload00:35:551
71420rcu_preempt12113-21diskmemload00:35:551
71420rcu_preempt0-21swapper/122:58:071
71420rcu_preempt0-21swapper/122:58:071
71420rcu_preempt0-21swapper/122:08:121
71420rcu_preempt0-21swapper/122:08:121
71420rcu_preempt0-21swapper/122:08:121
71420rcu_preempt0-21swapper/121:17:581
71420rcu_preempt0-21swapper/121:17:581
71420rcu_preempt0-21swapper/020:08:020
71420rcu_preempt0-21swapper/020:08:020
71420rcu_preempt0-21swapper/000:03:120
71420rcu_preempt0-21swapper/000:03:120
71420rcu_preempt0-21swapper/000:03:120
29700994224cyclictest23002-21ssh22:57:201
29700994224cyclictest23002-21ssh22:57:201
29700994223cyclictest14840-21latency_hist21:42:511
29700994220cyclictest8904-21ssh22:30:491
29700994220cyclictest8904-21ssh22:30:491
29700994220cyclictest8904-21ssh22:30:491
29700994220cyclictest4136-21/usr/sbin/munin21:23:131
29700994220cyclictest4136-21/usr/sbin/munin21:23:131
29700994220cyclictest12438-21apt-get22:37:571
29700994220cyclictest12438-21apt-get22:37:571
29700994219cyclictest9742-21apt-get22:32:581
29700994219cyclictest9742-21apt-get22:32:581
71410rcu_preempt22197-21sendmail-msp20:42:511
71410rcu_preempt22197-21sendmail-msp20:42:511
71410rcu_preempt1900-21munin-node23:37:561
71410rcu_preempt1900-21munin-node23:37:561
71410rcu_preempt0-21swapper/300:13:333
71410rcu_preempt0-21swapper/300:13:333
71410rcu_preempt0-21swapper/123:44:091
71410rcu_preempt0-21swapper/123:44:091
71410rcu_preempt0-21swapper/123:44:091
71410rcu_preempt0-21swapper/123:32:471
71410rcu_preempt0-21swapper/123:32:471
71410rcu_preempt0-21swapper/123:32:471
71410rcu_preempt0-21swapper/100:13:531
71410rcu_preempt0-21swapper/100:13:531
71410rcu_preempt0-21swapper/000:09:500
71410rcu_preempt0-21swapper/000:09:500
71410rcu_preempt0-21swapper/000:09:500
29700994120cyclictest13432-21ntp_kernel_err00:38:111
29700994120cyclictest13432-21ntp_kernel_err00:38:111
29700994117cyclictest3332-21ssh00:18:561
29700994117cyclictest3332-21ssh00:18:561
71400rcu_preempt6891-21/usr/sbin/munin21:27:571
71400rcu_preempt6891-21/usr/sbin/munin21:27:571
71400rcu_preempt6891-21/usr/sbin/munin21:27:571
71400rcu_preempt27958-21sort19:09:582
71400rcu_preempt27958-21sort19:09:582
71400rcu_preempt11003-1kworker/1:2H21:44:321
71400rcu_preempt11003-1kworker/1:2H21:44:321
71400rcu_preempt11003-1kworker/1:2H21:44:321
71400rcu_preempt0-21swapper/019:45:560
71400rcu_preempt0-21swapper/019:45:560
71400rcu_preempt0-21swapper/019:45:560
29700994026cyclictest233121diskstats21:58:001
29700994026cyclictest233121diskstats21:58:001
29700994026cyclictest233121diskstats21:58:001
29700994021cyclictest5330-21/usr/sbin/munin00:23:061
29700994021cyclictest5330-21/usr/sbin/munin00:23:061
29700994021cyclictest5330-21/usr/sbin/munin00:23:061
29700994021cyclictest16923-21ssh22:45:081
29700994021cyclictest16923-21ssh22:45:081
29700994020cyclictest27366-1kworker/1:2H23:17:451
29700994020cyclictest27366-1kworker/1:2H23:17:451
29700994020cyclictest27366-1kworker/1:2H23:17:451
29700994018cyclictest135082sleep120:08:301
29700994018cyclictest135082sleep120:08:301
29700994015cyclictest488-21ssh22:15:271
29700994015cyclictest488-21ssh22:15:271
29700994015cyclictest488-21ssh22:15:271
71390rcu_preempt3807-21diskmemload23:20:471
71390rcu_preempt3807-21diskmemload23:20:471
71390rcu_preempt0-21swapper/323:41:473
71390rcu_preempt0-21swapper/323:41:473
71390rcu_preempt0-21swapper/319:09:003
71390rcu_preempt0-21swapper/319:09:003
71390rcu_preempt0-21swapper/300:24:413
71390rcu_preempt0-21swapper/300:24:413
71390rcu_preempt0-21swapper/300:24:413
71390rcu_preempt0-21swapper/300:10:073
71390rcu_preempt0-21swapper/300:10:073
71390rcu_preempt0-21swapper/300:10:073
71390rcu_preempt0-21swapper/120:43:571
71390rcu_preempt0-21swapper/120:43:571
71390rcu_preempt0-21swapper/100:04:181
71390rcu_preempt0-21swapper/100:04:181
71390rcu_preempt0-21swapper/100:04:181
46050390irq/122-QManpo29807-2110:48:550
46050390irq/122-QManpo29807-2110:48:550
46050390irq/122-QManpo26233-2110:48:550
46050390irq/122-QManpo26233-2110:48:550
46050390irq/122-QManpo23613-2110:48:550
46050390irq/122-QManpo23613-2110:48:550
46050390irq/122-QManpo0-210
46050390irq/122-QManpo0-210
46050390irq/122-QManpo0-210
46050390irq/122-QManpo0-210
46050390irq/122-QManpo0-210
46050390irq/122-QManpo0-210
29700993921cyclictest16779-21apt-get20:22:571
29700993921cyclictest16779-21apt-get20:22:571
29700993921cyclictest16779-21apt-get20:22:571
29700993920cyclictest3980-21sshd19:35:581
29700993920cyclictest3980-21sshd19:35:581
29700993920cyclictest21534-21ssh23:53:121
29700993920cyclictest21534-21ssh23:53:121
29700993919cyclictest18471-21irqstats20:28:031
29700993919cyclictest18471-21irqstats20:28:031
29700993918cyclictest0-21swapper/121:33:101
29700993918cyclictest0-21swapper/121:33:101
29700993918cyclictest0-21swapper/121:33:101
71380rcu_preempt24156-21missed_timers20:48:071
71380rcu_preempt24156-21missed_timers20:48:071
71380rcu_preempt12063-21ssh23:36:233
71380rcu_preempt12063-21ssh23:36:233
71380rcu_preempt0-21swapper/323:23:023
71380rcu_preempt0-21swapper/323:23:023
71380rcu_preempt0-21swapper/323:23:023
71380rcu_preempt0-21swapper/300:31:473
71380rcu_preempt0-21swapper/300:31:473
71380rcu_preempt0-21swapper/300:31:473
71380rcu_preempt0-21swapper/023:45:400
71380rcu_preempt0-21swapper/023:45:400
71380rcu_preempt0-21swapper/023:45:400
71380rcu_preempt0-21swapper/023:32:580
71380rcu_preempt0-21swapper/023:32:580
71380rcu_preempt0-21swapper/021:20:190
71380rcu_preempt0-21swapper/021:20:190
46050380irq/122-QManpo8433-2110:48:550
46050380irq/122-QManpo8433-2110:48:550
46050380irq/122-QManpo30899-2110:48:550
46050380irq/122-QManpo30899-2110:48:550
46050380irq/122-QManpo25936-2110:48:550
46050380irq/122-QManpo25936-2110:48:550
46050380irq/122-QManpo22330-10
46050380irq/122-QManpo22330-10
46050380irq/122-QManpo15592-2110:48:550
46050380irq/122-QManpo15592-2110:48:550
46050380irq/122-QManpo15592-2110:48:550
46050380irq/122-QManpo10686-2110:48:550
46050380irq/122-QManpo10686-2110:48:550
46050380irq/122-QManpo10686-2110:48:550
29700993823cyclictest16643-21apt20:22:451
29700993823cyclictest16643-21apt20:22:451
29700993823cyclictest16643-21apt20:22:451
29700993814cyclictest27762-21sendmail-msp21:06:141
29700993814cyclictest27762-21sendmail-msp21:06:141
29700993814cyclictest27762-21sendmail-msp21:06:141
71370rcu_preempt6980-21sh22:27:490
71370rcu_preempt6980-21sh22:27:490
71370rcu_preempt6980-21sh22:27:490
71370rcu_preempt0-21swapper/323:55:313
71370rcu_preempt0-21swapper/323:55:313
71370rcu_preempt0-21swapper/323:13:433
71370rcu_preempt0-21swapper/323:13:433
71370rcu_preempt0-21swapper/323:13:433
71370rcu_preempt0-21swapper/322:27:033
71370rcu_preempt0-21swapper/322:27:033
71370rcu_preempt0-21swapper/322:27:033
71370rcu_preempt0-21swapper/023:41:010
71370rcu_preempt0-21swapper/023:41:010
71370rcu_preempt0-21swapper/022:13:000
71370rcu_preempt0-21swapper/022:13:000
71370rcu_preempt0-21swapper/022:13:000
71370rcu_preempt0-21swapper/019:31:080
71370rcu_preempt0-21swapper/019:31:080
46050370irq/122-QManpo7045-2110:48:550
46050370irq/122-QManpo7045-2110:48:550
46050370irq/122-QManpo7045-2110:48:550
46050370irq/122-QManpo6749-2110:48:550
46050370irq/122-QManpo6749-2110:48:550
46050370irq/122-QManpo6749-2110:48:550
46050370irq/122-QManpo21983-2110:48:550
46050370irq/122-QManpo21983-2110:48:550
46050370irq/122-QManpo11903-210
46050370irq/122-QManpo11903-210
46050370irq/122-QManpo11903-210
46050370irq/122-QManpo0-210
46050370irq/122-QManpo0-210
46050370irq/122-QManpo0-210
46050370irq/122-QManpo0-210
46050370irq/122-QManpo0-210
46050370irq/122-QManpo0-210
46050370irq/122-QManpo0-210
29700993716cyclictest12456-21if_eth321:38:021
29700993716cyclictest0-21swapper/120:03:111
29700993716cyclictest0-21swapper/120:03:111
29700993716cyclictest0-21swapper/120:03:111
29700993715cyclictest0-21swapper/119:43:071
29700993715cyclictest0-21swapper/119:43:071
29700993715cyclictest0-21swapper/119:43:071
71360rcu_preempt29721-21sh22:08:470
71360rcu_preempt29721-21sh22:08:470
71360rcu_preempt29721-21sh22:08:470
71360rcu_preempt0-21swapper/323:47:193
71360rcu_preempt0-21swapper/323:47:193
71360rcu_preempt0-21swapper/323:47:193
71360rcu_preempt0-21swapper/322:49:223
71360rcu_preempt0-21swapper/322:49:223
71360rcu_preempt0-21swapper/322:12:053
71360rcu_preempt0-21swapper/322:12:053
71360rcu_preempt0-21swapper/322:12:053
71360rcu_preempt0-21swapper/322:04:533
71360rcu_preempt0-21swapper/322:04:533
71360rcu_preempt0-21swapper/321:57:463
71360rcu_preempt0-21swapper/321:57:463
71360rcu_preempt0-21swapper/321:57:463
71360rcu_preempt0-21swapper/320:42:523
71360rcu_preempt0-21swapper/320:32:473
71360rcu_preempt0-21swapper/320:32:473
71360rcu_preempt0-21swapper/300:35:523
71360rcu_preempt0-21swapper/300:35:523
71360rcu_preempt0-21swapper/300:35:523
71360rcu_preempt0-21swapper/121:08:231
71360rcu_preempt0-21swapper/121:08:231
71360rcu_preempt0-21swapper/022:36:400
71360rcu_preempt0-21swapper/022:36:400
46050360irq/122-QManpo6697-10
46050360irq/122-QManpo6697-10
46050360irq/122-QManpo6697-10
46050360irq/122-QManpo4068-2110:48:550
46050360irq/122-QManpo4068-2110:48:550
46050360irq/122-QManpo32002-2110:48:550
46050360irq/122-QManpo32002-2110:48:550
46050360irq/122-QManpo27762-2110:48:550
46050360irq/122-QManpo27762-2110:48:550
46050360irq/122-QManpo27762-2110:48:550
46050360irq/122-QManpo23179-2110:48:550
46050360irq/122-QManpo23179-2110:48:550
46050360irq/122-QManpo23179-2110:48:550
46050360irq/122-QManpo20509-2110:48:550
46050360irq/122-QManpo20509-2110:48:550
46050360irq/122-QManpo16641-2110:48:550
46050360irq/122-QManpo16641-2110:48:550
46050360irq/122-QManpo16641-2110:48:550
46050360irq/122-QManpo16641-2110:48:550
46050360irq/122-QManpo16641-2110:48:550
46050360irq/122-QManpo0-210
46050360irq/122-QManpo0-210
46050360irq/122-QManpo0-210
46050360irq/122-QManpo0-210
46050360irq/122-QManpo0-210
46050360irq/122-QManpo0-210
29700993623cyclictest1959-21runrttasks20:02:361
29700993623cyclictest1959-21runrttasks20:02:361
29700993617cyclictest29876-21df19:12:581
29700993617cyclictest29876-21df19:12:581
29700993617cyclictest0-21swapper/121:02:461
29700993617cyclictest0-21swapper/121:02:461
71350rcu_preempt3238-21kworker/0:619:48:410
71350rcu_preempt3238-21kworker/0:619:48:410
71350rcu_preempt3238-21kworker/0:619:48:410
71350rcu_preempt18538-21ssh21:48:153
71350rcu_preempt18538-21ssh21:48:153
71350rcu_preempt18538-21ssh21:48:153
71350rcu_preempt0-21swapper/323:04:213
71350rcu_preempt0-21swapper/323:04:213
71350rcu_preempt0-21swapper/322:16:343
71350rcu_preempt0-21swapper/322:16:343
71350rcu_preempt0-21swapper/322:16:343
71350rcu_preempt0-21swapper/120:12:571
71350rcu_preempt0-21swapper/120:12:571
46050350irq/122-QManpo7157-2110:48:550
46050350irq/122-QManpo7157-2110:48:550
46050350irq/122-QManpo7157-2110:48:550
46050350irq/122-QManpo31539-2110:48:550
46050350irq/122-QManpo31539-2110:48:550
46050350irq/122-QManpo31539-2110:48:550
46050350irq/122-QManpo27790-2110:48:550
46050350irq/122-QManpo27790-2110:48:550
46050350irq/122-QManpo22197-2110:48:550
46050350irq/122-QManpo22197-2110:48:550
46050350irq/122-QManpo20917-2110:48:550
46050350irq/122-QManpo20917-2110:48:550
46050350irq/122-QManpo20917-2110:48:550
46050350irq/122-QManpo1959-2110:48:550
46050350irq/122-QManpo1959-2110:48:550
46050350irq/122-QManpo1959-2110:48:550
46050350irq/122-QManpo0-210
46050350irq/122-QManpo0-210
46050350irq/122-QManpo0-210
46050350irq/122-QManpo0-210
46050350irq/122-QManpo0-210
46050350irq/122-QManpo0-210
46050350irq/122-QManpo0-210
46050350irq/122-QManpo0-210
320352350sleep08263-1kworker/0:7H19:19:050
320352350sleep08263-1kworker/0:7H19:19:050
320352350sleep08263-1kworker/0:7H19:19:050
29700993519cyclictest20022-21/usr/sbin/munin20:33:071
29700993519cyclictest20022-21/usr/sbin/munin20:33:071
29700993516cyclictest5610-21cut19:42:491
29700993516cyclictest5610-21cut19:42:491
71340rcu_preempt0-21swapper/321:23:133
71340rcu_preempt0-21swapper/321:23:133
71340rcu_preempt0-21swapper/120:57:461
71340rcu_preempt0-21swapper/120:57:461
71340rcu_preempt0-21swapper/022:45:050
71340rcu_preempt0-21swapper/022:45:050
46650340irq/116-QManpo0-2110:48:553
46650340irq/116-QManpo0-2110:48:553
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional