You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 17:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot4.osadl.org (updated Thu Dec 04, 2025 12:53:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
71600rcu_preempt0-21swapper/210:45:112
71600rcu_preempt0-21swapper/210:45:112
71530rcu_preempt20054-21copy08:22:591
71530rcu_preempt20054-21copy08:22:591
71530rcu_preempt20054-21copy08:22:591
8643994816cyclictest6095-21aten_r4power_vo10:38:031
8643994816cyclictest6095-21aten_r4power_vo10:38:031
8643994816cyclictest6095-21aten_r4power_vo10:38:031
100550460irq/38-i2c-mpc241ksoftirqd/210:35:222
100550460irq/38-i2c-mpc241ksoftirqd/210:35:222
8643994424cyclictest29418-21meminfo11:23:131
8643994424cyclictest29418-21meminfo11:23:131
100550440irq/38-i2c-mpc231rcuc/213:03:362
100550440irq/38-i2c-mpc231rcuc/213:03:362
100550440irq/38-i2c-mpc231rcuc/212:48:322
100550440irq/38-i2c-mpc231rcuc/212:48:322
71430rcu_preempt32183-21kworker/0:011:32:520
71430rcu_preempt32183-21kworker/0:011:32:520
71430rcu_preempt0-21swapper/211:04:092
71430rcu_preempt0-21swapper/211:04:092
8643994230cyclictest11284-21apt-get09:42:591
8643994230cyclictest11284-21apt-get09:42:591
8643994222cyclictest15073-21meminfo11:58:111
8643994222cyclictest15073-21meminfo11:58:111
8643994222cyclictest15073-21meminfo11:58:111
8643994221cyclictest12628-21ntp_states11:53:141
8643994221cyclictest12628-21ntp_states11:53:141
8643994220cyclictest21926-21mailstats11:08:151
8643994220cyclictest21926-21mailstats11:08:151
8643994220cyclictest21926-21mailstats11:08:151
8643994220cyclictest21017-21ssh11:07:491
8643994220cyclictest21017-21ssh11:07:491
8643994219cyclictest0-21swapper/108:03:011
8643994219cyclictest0-21swapper/108:03:011
8643994121cyclictest9173-21memory09:38:121
8643994121cyclictest9173-21memory09:38:121
8643994120cyclictest13518-21latency_hist12:57:511
8643994120cyclictest13518-21latency_hist12:57:511
8643994119cyclictest2067-21df_inode11:33:101
8643994119cyclictest2067-21df_inode11:33:101
8643994119cyclictest2067-21df_inode11:33:101
8643994119cyclictest0-21swapper/110:48:151
8643994119cyclictest0-21swapper/110:48:151
8643994117cyclictest0-21swapper/110:28:141
8643994117cyclictest0-21swapper/110:28:141
8643994117cyclictest0-21swapper/108:12:491
8643994117cyclictest0-21swapper/108:12:491
8643994117cyclictest0-21swapper/108:12:491
8643994116cyclictest0-21swapper/111:28:141
8643994116cyclictest0-21swapper/111:28:141
8643994114cyclictest8626-21runrttasks12:22:381
8643994114cyclictest8626-21runrttasks12:22:381
71410rcu_preempt24408-1sed10:08:181
71410rcu_preempt24408-1sed10:08:181
71410rcu_preempt0-21swapper/309:38:003
71410rcu_preempt0-21swapper/309:38:003
46050410irq/122-QManpo3427-210
46050410irq/122-QManpo3427-210
100550410irq/38-i2c-mpc231rcuc/213:08:372
100550410irq/38-i2c-mpc231rcuc/213:08:372
100550410irq/38-i2c-mpc231rcuc/213:08:372
100550410irq/38-i2c-mpc231rcuc/212:23:262
100550410irq/38-i2c-mpc231rcuc/212:23:262
100550410irq/38-i2c-mpc231rcuc/212:23:262
8643994021cyclictest19965-21users13:08:171
8643994021cyclictest19965-21users13:08:171
8643994021cyclictest19965-21users13:08:171
8643994020cyclictest15833-21sh10:57:481
8643994020cyclictest15833-21sh10:57:481
8643994019cyclictest8978-21ntp_states10:43:131
8643994019cyclictest8978-21ntp_states10:43:131
8643994019cyclictest26914-21sed10:13:191
8643994019cyclictest26914-21sed10:13:191
8643994019cyclictest1920-21df_inode09:13:041
8643994019cyclictest1920-21df_inode09:13:041
8643994019cyclictest16284-21diskstats10:58:061
8643994019cyclictest16284-21diskstats10:58:061
8643994019cyclictest16284-21diskstats10:58:061
8643994019cyclictest0-21swapper/109:58:051
8643994019cyclictest0-21swapper/109:58:051
8643994019cyclictest0-21swapper/109:58:051
8643994017cyclictest8626-21runrttasks10:04:331
8643994017cyclictest8626-21runrttasks10:04:331
71400rcu_preempt0-21swapper/212:33:252
71400rcu_preempt0-21swapper/212:33:252
71400rcu_preempt0-21swapper/212:33:252
71400rcu_preempt0-21swapper/010:11:040
71400rcu_preempt0-21swapper/010:11:040
71400rcu_preempt0-21swapper/009:32:540
71400rcu_preempt0-21swapper/009:32:540
71400rcu_preempt0-21swapper/009:32:540
8643993929cyclictest24577-21/usr/sbin/munin08:38:061
8643993929cyclictest24577-21/usr/sbin/munin08:38:061
8643993920cyclictest30209-21ssh12:27:541
8643993920cyclictest30209-21ssh12:27:541
8643993920cyclictest30209-21ssh12:27:541
8643993919cyclictest17489-21diskstats12:03:061
8643993919cyclictest17489-21diskstats12:03:061
8643993918cyclictest48022sleep110:34:401
8643993918cyclictest48022sleep110:34:401
8643993918cyclictest29481-21ssh10:18:191
8643993918cyclictest29481-21ssh10:18:191
8643993918cyclictest29481-21ssh10:18:191
8643993917cyclictest13095-21sort07:57:481
8643993917cyclictest13095-21sort07:57:481
8643993917cyclictest13095-21sort07:57:481
8643993917cyclictest0-21swapper/111:43:191
8643993917cyclictest0-21swapper/111:43:191
8643993917cyclictest0-21swapper/108:33:131
8643993917cyclictest0-21swapper/108:33:131
8643993916cyclictest0-21swapper/112:38:021
8643993916cyclictest0-21swapper/112:38:021
8643993916cyclictest0-21swapper/112:38:021
8643993916cyclictest0-21swapper/109:23:201
8643993916cyclictest0-21swapper/109:23:201
71390rcu_preempt0-21swapper/313:08:213
71390rcu_preempt0-21swapper/313:08:213
71390rcu_preempt0-21swapper/313:08:213
71390rcu_preempt0-21swapper/212:47:522
71390rcu_preempt0-21swapper/212:47:522
71390rcu_preempt0-21swapper/211:27:552
71390rcu_preempt0-21swapper/211:27:552
71390rcu_preempt0-21swapper/012:53:060
71390rcu_preempt0-21swapper/012:53:060
71390rcu_preempt0-21swapper/008:22:570
71390rcu_preempt0-21swapper/008:22:570
71390rcu_preempt0-21swapper/008:22:570
100550390irq/38-i2c-mpc231rcuc/208:34:072
100550390irq/38-i2c-mpc231rcuc/208:34:072
8643993824cyclictest10863-21memory07:48:111
8643993822cyclictest8626-21runrttasks09:31:031
8643993822cyclictest8626-21runrttasks09:31:031
8643993819cyclictest25738-21/usr/sbin/munin08:43:041
8643993819cyclictest25738-21/usr/sbin/munin08:43:041
8643993819cyclictest25738-21/usr/sbin/munin08:43:041
8643993819cyclictest10347-21unixbench_multi11:48:211
8643993819cyclictest10347-21unixbench_multi11:48:211
8643993818cyclictest5711-21apt-get12:43:001
8643993818cyclictest5711-21apt-get12:43:001
8643993818cyclictest27804-21grep08:48:161
8643993818cyclictest27804-21grep08:48:161
8643993818cyclictest22682-21df12:13:051
8643993818cyclictest22682-21df12:13:051
8643993818cyclictest0-21swapper/113:00:251
8643993818cyclictest0-21swapper/113:00:251
8643993818cyclictest0-21swapper/112:29:301
8643993818cyclictest0-21swapper/112:29:301
8643993817cyclictest0-21swapper/112:33:211
8643993817cyclictest0-21swapper/112:33:211
8643993817cyclictest0-21swapper/112:33:211
8643993817cyclictest0-21swapper/110:22:551
8643993817cyclictest0-21swapper/110:22:551
71380rcu_preempt6581-1mailstats09:28:272
71380rcu_preempt6581-1mailstats09:28:272
71380rcu_preempt3851-1kworker/3:2H09:28:083
71380rcu_preempt3851-1kworker/3:2H09:28:083
71380rcu_preempt0-21swapper/113:03:051
71380rcu_preempt0-21swapper/113:03:051
71380rcu_preempt0-21swapper/112:09:211
71380rcu_preempt0-21swapper/112:09:211
71380rcu_preempt0-21swapper/012:48:200
71380rcu_preempt0-21swapper/012:48:200
71380rcu_preempt0-21swapper/010:19:570
71380rcu_preempt0-21swapper/010:19:570
71380rcu_preempt0-21swapper/010:19:570
46050380irq/122-QManpo25109-2109:24:360
46050380irq/122-QManpo25109-2109:24:360
8643993722cyclictest8626-21runrttasks08:16:061
8643993722cyclictest8626-21runrttasks08:16:061
8643993722cyclictest8626-21runrttasks08:16:061
8643993722cyclictest26218-21munin-run11:17:491
8643993722cyclictest26218-21munin-run11:17:491
8643993722cyclictest26218-21munin-run11:17:491
8643993718cyclictest14409-21ssh09:48:131
8643993718cyclictest14409-21ssh09:48:131
8643993717cyclictest7261-21/usr/sbin/munin09:33:191
8643993717cyclictest7261-21/usr/sbin/munin09:33:191
8643993717cyclictest7261-21/usr/sbin/munin09:33:191
8643993717cyclictest12887-21snmpd09:57:531
8643993717cyclictest12887-21snmpd09:57:531
8643993717cyclictest12887-21snmpd09:57:531
8643993716cyclictest0-21swapper/108:58:161
8643993716cyclictest0-21swapper/108:58:161
71370rcu_preempt18233-1grep08:13:143
71370rcu_preempt18233-1grep08:13:143
71370rcu_preempt18233-1grep08:13:143
71370rcu_preempt0-21swapper/209:58:512
71370rcu_preempt0-21swapper/209:58:512
71370rcu_preempt0-21swapper/209:58:512
71370rcu_preempt0-21swapper/112:48:551
71370rcu_preempt0-21swapper/112:48:551
46050370irq/122-QManpo9662-2109:24:360
46050370irq/122-QManpo9662-2109:24:360
46050370irq/122-QManpo1608-2109:24:360
46050370irq/122-QManpo1608-2109:24:360
46050370irq/122-QManpo1608-2109:24:360
46050370irq/122-QManpo0-210
46050370irq/122-QManpo0-210
100550370irq/38-i2c-mpc231rcuc/210:17:582
100550370irq/38-i2c-mpc231rcuc/210:17:582
100550370irq/38-i2c-mpc231rcuc/210:17:582
864499369cyclictest20222-21irqstats12:08:102
864499369cyclictest20222-21irqstats12:08:102
8644993625cyclictest31300-21apt-get09:02:592
8644993625cyclictest31300-21apt-get09:02:592
8643993618cyclictest27894-21ssh11:19:591
8643993618cyclictest27894-21ssh11:19:591
71360rcu_preempt0-21swapper/311:48:103
71360rcu_preempt0-21swapper/311:48:103
71360rcu_preempt0-21swapper/311:32:583
71360rcu_preempt0-21swapper/311:32:583
71360rcu_preempt0-21swapper/311:32:583
71360rcu_preempt0-21swapper/311:27:523
71360rcu_preempt0-21swapper/311:27:523
71360rcu_preempt0-21swapper/211:33:162
71360rcu_preempt0-21swapper/211:33:162
71360rcu_preempt0-21swapper/211:33:162
71360rcu_preempt0-21swapper/210:08:032
71360rcu_preempt0-21swapper/210:08:032
71360rcu_preempt0-21swapper/111:41:521
71360rcu_preempt0-21swapper/111:41:521
71360rcu_preempt0-21swapper/011:27:530
71360rcu_preempt0-21swapper/011:27:530
71360rcu_preempt0-21swapper/011:13:030
71360rcu_preempt0-21swapper/011:13:030
71360rcu_preempt0-21swapper/011:13:030
71360rcu_preempt0-21swapper/010:59:130
71360rcu_preempt0-21swapper/010:59:130
71360rcu_preempt0-21swapper/010:59:130
71360rcu_preempt0-21swapper/009:50:480
71360rcu_preempt0-21swapper/009:50:480
46050360irq/122-QManpo8414-2109:24:360
46050360irq/122-QManpo8414-2109:24:360
46050360irq/122-QManpo27957-2109:24:360
46050360irq/122-QManpo27957-2109:24:360
46050360irq/122-QManpo27957-2109:24:360
46050360irq/122-QManpo21626-2109:24:360
46050360irq/122-QManpo21626-2109:24:360
46050360irq/122-QManpo21626-2109:24:360
46050360irq/122-QManpo17235-2109:24:360
46050360irq/122-QManpo17235-2109:24:360
46050360irq/122-QManpo1093-2109:24:360
46050360irq/122-QManpo1093-2109:24:360
184722360sleep014828-1kworker/0:0H13:06:460
184722360sleep014828-1kworker/0:0H13:06:460
8643993525cyclictest31597-21irqstats09:03:071
8643993525cyclictest31597-21irqstats09:03:071
8643993523cyclictest8626-21runrttasks08:30:021
8643993523cyclictest8626-21runrttasks08:30:021
8643993517cyclictest0-21swapper/108:53:141
8643993517cyclictest0-21swapper/108:53:141
8643993517cyclictest0-21swapper/108:53:141
8643993516cyclictest0-21swapper/108:20:571
8643993516cyclictest0-21swapper/108:20:571
71350rcu_preempt0-21swapper/312:32:013
71350rcu_preempt0-21swapper/312:32:013
71350rcu_preempt0-21swapper/308:23:133
71350rcu_preempt0-21swapper/308:23:133
71350rcu_preempt0-21swapper/308:23:133
71350rcu_preempt0-21swapper/211:53:592
71350rcu_preempt0-21swapper/211:53:592
71350rcu_preempt0-21swapper/211:52:052
71350rcu_preempt0-21swapper/211:52:052
71350rcu_preempt0-21swapper/211:10:152
71350rcu_preempt0-21swapper/211:10:152
71350rcu_preempt0-21swapper/211:10:152
71350rcu_preempt0-21swapper/208:47:492
71350rcu_preempt0-21swapper/208:47:492
71350rcu_preempt0-21swapper/208:47:492
71350rcu_preempt0-21swapper/011:05:290
71350rcu_preempt0-21swapper/011:05:290
46050350irq/122-QManpo32138-2109:24:360
46050350irq/122-QManpo32138-2109:24:360
46050350irq/122-QManpo26076-2109:24:360
46050350irq/122-QManpo26076-2109:24:360
46050350irq/122-QManpo26076-2109:24:360
46050350irq/122-QManpo23194-2109:24:360
46050350irq/122-QManpo23194-2109:24:360
46050350irq/122-QManpo18603-210
46050350irq/122-QManpo18603-210
46050350irq/122-QManpo18603-210
46050350irq/122-QManpo13071-2109:24:360
46050350irq/122-QManpo13071-2109:24:360
46050350irq/122-QManpo0-210
46050350irq/122-QManpo0-210
46050350irq/122-QManpo0-210
46050350irq/122-QManpo0-210
27122350sleep01247-1kworker/0:0H09:15:070
27122350sleep01247-1kworker/0:0H09:15:070
99650340irq/38-i2c-mpc0-21swapper/011:18:110
99650340irq/38-i2c-mpc0-21swapper/011:18:110
864599344cyclictest11723-21meminfo09:43:103
864599344cyclictest11723-21meminfo09:43:103
8644993414cyclictest13827-21df_inode10:53:052
8644993414cyclictest13827-21df_inode10:53:052
8644993410cyclictest0-21swapper/212:59:212
8644993410cyclictest0-21swapper/212:59:212
8644993410cyclictest0-21swapper/212:38:062
8644993410cyclictest0-21swapper/212:38:062
8644993410cyclictest0-21swapper/212:38:062
8644993410cyclictest0-21swapper/211:38:082
8644993410cyclictest0-21swapper/211:38:082
8643993426cyclictest3309-21df_inode09:18:061
8643993426cyclictest3309-21df_inode09:18:061
8643993424cyclictest0-21swapper/107:58:091
8643993424cyclictest0-21swapper/107:58:091
8643993420cyclictest32700-21/usr/sbin/munin09:08:121
8643993420cyclictest32700-21/usr/sbin/munin09:08:121
71340rcu_preempt5796-21latency_hist09:27:520
71340rcu_preempt5796-21latency_hist09:27:520
71340rcu_preempt19724-1kworker/2:2H10:17:162
71340rcu_preempt19724-1kworker/2:2H10:17:162
71340rcu_preempt15464-21taskset09:50:272
71340rcu_preempt15464-21taskset09:50:272
71340rcu_preempt0-21swapper/210:29:272
71340rcu_preempt0-21swapper/210:29:272
71340rcu_preempt0-21swapper/012:47:080
71340rcu_preempt0-21swapper/012:47:080
46050340irq/122-QManpo3552-10
46050340irq/122-QManpo3552-10
46050340irq/122-QManpo22353-2109:24:360
46050340irq/122-QManpo22353-2109:24:360
46050340irq/122-QManpo21615-109:24:360
46050340irq/122-QManpo21615-109:24:360
46050340irq/122-QManpo21615-109:24:360
46050340irq/122-QManpo19382-2109:24:360
46050340irq/122-QManpo19382-2109:24:360
46050340irq/122-QManpo0-210
46050340irq/122-QManpo0-210
46050340irq/122-QManpo0-210
46050340irq/122-QManpo0-210
46050340irq/122-QManpo0-210
46050340irq/122-QManpo0-210
46050340irq/122-QManpo0-210
46050340irq/122-QManpo0-210
46050340irq/122-QManpo0-210
46050340irq/122-QManpo0-210
164542340sleep015160-1kworker/0:2H12:00:570
164542340sleep015160-1kworker/0:2H12:00:570
164542340sleep015160-1kworker/0:2H12:00:570
864599336cyclictest29010-21tr08:53:113
864599336cyclictest29010-21tr08:53:113
864599336cyclictest29010-21tr08:53:113
864599336cyclictest0-21swapper/309:18:003
864599336cyclictest0-21swapper/309:18:003
864499339cyclictest0-21swapper/211:13:142
864499339cyclictest0-21swapper/211:13:142
864499339cyclictest0-21swapper/211:13:142
864499338cyclictest27505-21munin-run12:22:482
864499338cyclictest27505-21munin-run12:22:482
8644993312cyclictest11247-21df_inode10:48:072
8644993312cyclictest11247-21df_inode10:48:072
8644993311cyclictest0-21swapper/210:23:112
8644993311cyclictest0-21swapper/210:23:112
71330rcu_preempt7270-1kworker/2:2H09:43:162
71330rcu_preempt7270-1kworker/2:2H09:43:162
71330rcu_preempt32159-21ssh11:28:162
71330rcu_preempt32159-21ssh11:28:162
71330rcu_preempt18856-21ssh12:05:202
71330rcu_preempt18856-21ssh12:05:202
71330rcu_preempt0-21swapper/312:43:013
71330rcu_preempt0-21swapper/312:43:013
71330rcu_preempt0-21swapper/310:44:083
71330rcu_preempt0-21swapper/310:44:083
71330rcu_preempt0-21swapper/310:15:593
71330rcu_preempt0-21swapper/310:15:593
71330rcu_preempt0-21swapper/309:59:153
71330rcu_preempt0-21swapper/309:59:153
71330rcu_preempt0-21swapper/309:59:153
71330rcu_preempt0-21swapper/212:53:072
71330rcu_preempt0-21swapper/212:53:072
71330rcu_preempt0-21swapper/211:44:592
71330rcu_preempt0-21swapper/211:44:592
71330rcu_preempt0-21swapper/211:18:172
71330rcu_preempt0-21swapper/211:18:172
71330rcu_preempt0-21swapper/210:42:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional