You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 06:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot4.osadl.org (updated Thu Nov 27, 2025 00:53:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
71680rcu_preempt0-21swapper/122:51:171
71680rcu_preempt0-21swapper/122:51:171
71650rcu_preempt0-21swapper/100:57:091
71650rcu_preempt0-21swapper/100:57:091
71650rcu_preempt0-21swapper/100:57:091
71570rcu_preempt0-21swapper/200:47:552
71570rcu_preempt0-21swapper/200:47:552
71520rcu_preempt0-21swapper/122:04:591
71520rcu_preempt0-21swapper/122:04:591
71520rcu_preempt0-21swapper/122:04:591
1823199472cyclictest19333-21/usr/sbin/munin21:42:533
1823199472cyclictest19333-21/usr/sbin/munin21:42:533
71460rcu_preempt0-21swapper/100:46:331
71460rcu_preempt0-21swapper/100:46:331
71460rcu_preempt0-21swapper/100:46:331
71460rcu_preempt0-21swapper/100:46:331
1823199462cyclictest8626-21runrttasks00:58:013
1823199462cyclictest8626-21runrttasks00:58:013
71440rcu_preempt0-21swapper/320:33:073
71440rcu_preempt0-21swapper/320:33:073
71440rcu_preempt0-21swapper/320:33:073
1823199444cyclictest0-21swapper/323:08:023
1823199444cyclictest0-21swapper/323:08:023
1823199444cyclictest0-21swapper/300:47:413
1823199444cyclictest0-21swapper/300:47:413
1823199444cyclictest0-21swapper/300:47:413
1823199444cyclictest0-21swapper/300:47:413
1823199434cyclictest0-21swapper/322:18:023
1823199434cyclictest0-21swapper/322:18:023
1823199433cyclictest18167-21diskstats23:37:563
1823199433cyclictest18167-21diskstats23:37:563
1823199432cyclictest23010-21df_inode22:47:563
1823199432cyclictest23010-21df_inode22:47:563
1823199423cyclictest0-21swapper/323:27:533
1823199423cyclictest0-21swapper/323:27:533
1823199422cyclictest31710-21/usr/sbin/munin00:02:543
1823199422cyclictest31710-21/usr/sbin/munin00:02:543
1823199422cyclictest31710-21/usr/sbin/munin00:02:543
1823199422cyclictest17574-21irqstats22:38:033
1823199422cyclictest17574-21irqstats22:38:033
1823199422cyclictest17574-21irqstats22:38:033
1823199421cyclictest18436-21/usr/sbin/munin00:37:583
1823199421cyclictest18436-21/usr/sbin/munin00:37:583
1823199421cyclictest18436-21/usr/sbin/munin00:37:583
71410rcu_preempt4729-21copy00:12:450
71410rcu_preempt4729-21copy00:12:450
71410rcu_preempt0-21swapper/223:27:192
71410rcu_preempt0-21swapper/223:27:192
71410rcu_preempt0-21swapper/222:37:522
71410rcu_preempt0-21swapper/222:37:522
71410rcu_preempt0-21swapper/222:37:522
71410rcu_preempt0-21swapper/023:22:170
71410rcu_preempt0-21swapper/023:22:170
1823199414cyclictest31621-1kworker/3:2H22:28:063
1823199414cyclictest31621-1kworker/3:2H22:28:063
1823199414cyclictest0-21swapper/323:33:073
1823199414cyclictest0-21swapper/323:33:073
1823199413cyclictest20166-21df22:42:543
1823199413cyclictest20166-21df22:42:543
1823199413cyclictest20166-21df22:42:543
1823199413cyclictest0-21swapper/322:12:543
1823199413cyclictest0-21swapper/322:12:543
1823199413cyclictest0-21swapper/321:37:553
1823199413cyclictest0-21swapper/321:37:553
1823199413cyclictest0-21swapper/321:37:553
1823199413cyclictest0-21swapper/320:12:503
1823199413cyclictest0-21swapper/320:12:503
1823199413cyclictest0-21swapper/301:12:163
1823199413cyclictest0-21swapper/301:12:163
1823199413cyclictest0-21swapper/301:12:163
1823199412cyclictest4691-21apt-get00:13:063
1823199412cyclictest4691-21apt-get00:13:063
1823199412cyclictest4691-21apt-get00:13:063
1823199412cyclictest4361-21/usr/sbin/munin20:47:563
1823199412cyclictest4361-21/usr/sbin/munin20:47:563
1823199412cyclictest27673-21tr21:57:523
1823199412cyclictest27673-21tr21:57:523
1823199412cyclictest27673-21tr21:57:523
1823199412cyclictest27673-21tr21:57:523
1823199412cyclictest25448-21munin-run20:07:393
1823199412cyclictest25448-21munin-run20:07:393
1823199412cyclictest23423-21/usr/sbin/munin23:47:543
1823199412cyclictest23423-21/usr/sbin/munin23:47:543
1823199412cyclictest22575-21memory21:48:023
1823199412cyclictest22575-21memory21:48:023
1823199412cyclictest22575-21memory21:48:023
1823199412cyclictest2093-21/usr/sbin/munin00:07:513
1823199412cyclictest2093-21/usr/sbin/munin00:07:513
1823199411cyclictest9803-21df_abs21:12:553
1823199411cyclictest9803-21df_abs21:12:553
1823199411cyclictest26204-21/usr/sbin/munin23:52:553
1823199411cyclictest26204-21/usr/sbin/munin23:52:553
18228994127cyclictest8957-21apt-get22:22:500
18228994127cyclictest8957-21apt-get22:22:500
18228994127cyclictest8957-21apt-get22:22:500
18228994114cyclictest2520-21ssh22:10:290
18228994114cyclictest2520-21ssh22:10:290
71400rcu_preempt0-21swapper/023:10:190
71400rcu_preempt0-21swapper/023:10:190
1823199404cyclictest0-21swapper/300:32:513
1823199404cyclictest0-21swapper/300:32:513
1823199404cyclictest0-21swapper/300:32:513
1823199403cyclictest0-21swapper/321:17:563
1823199403cyclictest0-21swapper/321:17:563
1823199402cyclictest30608-21diskstats22:02:563
1823199402cyclictest30608-21diskstats22:02:563
1823199402cyclictest30608-21diskstats22:02:563
18231994020cyclictest0-21swapper/323:13:133
18231994020cyclictest0-21swapper/323:13:133
18231994020cyclictest0-21swapper/323:13:133
1823199401cyclictest8626-21runrttasks20:41:043
1823199401cyclictest8626-21runrttasks20:41:043
1823199401cyclictest8626-21runrttasks20:41:043
1823199401cyclictest16398-21diskmemload21:54:583
1823199401cyclictest16398-21diskmemload21:54:583
1823199401cyclictest15329-21grep22:33:103
1823199401cyclictest15329-21grep22:33:103
1823199401cyclictest13128-21apt-get00:27:533
1823199401cyclictest13128-21apt-get00:27:533
1823199401cyclictest0-21swapper/301:03:253
1823199401cyclictest0-21swapper/301:03:253
1823199401cyclictest0-21swapper/301:03:253
1822899407cyclictest0-21swapper/022:33:070
1822899407cyclictest0-21swapper/022:33:070
18228994019cyclictest19665-21irqstats21:42:580
18228994019cyclictest19665-21irqstats21:42:580
18228994015cyclictest24854-21apt-get21:52:510
18228994015cyclictest24854-21apt-get21:52:510
71390rcu_preempt0-21swapper/122:37:501
71390rcu_preempt0-21swapper/122:37:501
71390rcu_preempt0-21swapper/122:37:501
71390rcu_preempt0-21swapper/120:32:591
71390rcu_preempt0-21swapper/120:32:591
71390rcu_preempt0-21swapper/120:32:591
71390rcu_preempt0-21swapper/023:37:390
71390rcu_preempt0-21swapper/023:37:390
71390rcu_preempt0-21swapper/023:26:170
71390rcu_preempt0-21swapper/023:26:170
71390rcu_preempt0-21swapper/022:31:050
71390rcu_preempt0-21swapper/022:31:050
71390rcu_preempt0-21swapper/001:07:480
71390rcu_preempt0-21swapper/000:39:170
71390rcu_preempt0-21swapper/000:39:170
71390rcu_preempt0-21swapper/000:39:170
1823199394cyclictest0-21swapper/320:43:053
1823199394cyclictest0-21swapper/320:43:053
1823199393cyclictest0-21swapper/323:24:563
1823199393cyclictest0-21swapper/323:24:563
1823199393cyclictest0-21swapper/300:48:013
1823199393cyclictest0-21swapper/300:48:013
1823199391cyclictest6879-21/usr/sbin/munin23:18:043
1823199391cyclictest6879-21/usr/sbin/munin23:18:043
1823199391cyclictest31022-21apt-get23:02:533
1823199391cyclictest31022-21apt-get23:02:533
1823199391cyclictest29573-21taskset20:22:143
1823199391cyclictest29573-21taskset20:22:143
1823199391cyclictest28955-21/usr/sbin/munin23:58:103
1823199391cyclictest28955-21/usr/sbin/munin23:58:103
1823199391cyclictest28282-21apt-get22:57:553
1823199391cyclictest28282-21apt-get22:57:553
1823199391cyclictest28282-21apt-get22:57:553
1823199391cyclictest20655-21apt-get23:42:513
1823199391cyclictest20655-21apt-get23:42:513
1823199391cyclictest20655-21apt-get23:42:513
1823199391cyclictest0-21swapper/322:53:003
1823199391cyclictest0-21swapper/322:53:003
1823199391cyclictest0-21swapper/322:08:053
1823199391cyclictest0-21swapper/322:08:053
1823199391cyclictest0-21swapper/300:18:123
1823199391cyclictest0-21swapper/300:18:123
18231993917cyclictest0-21swapper/321:28:003
18231993917cyclictest0-21swapper/321:28:003
1822899397cyclictest0-21swapper/023:50:310
1822899397cyclictest0-21swapper/023:50:310
71380rcu_preempt2077-21cat00:07:471
71380rcu_preempt12943-21apt00:27:420
71380rcu_preempt12943-21apt00:27:420
71380rcu_preempt12943-21apt00:27:420
71380rcu_preempt0-21swapper/222:23:042
71380rcu_preempt0-21swapper/222:23:042
71380rcu_preempt0-21swapper/222:23:042
71380rcu_preempt0-21swapper/220:03:022
71380rcu_preempt0-21swapper/220:03:022
71380rcu_preempt0-21swapper/023:53:570
71380rcu_preempt0-21swapper/023:53:570
71380rcu_preempt0-21swapper/023:40:210
71380rcu_preempt0-21swapper/023:40:210
71380rcu_preempt0-21swapper/022:48:390
71380rcu_preempt0-21swapper/022:48:390
71380rcu_preempt0-21swapper/022:05:450
71380rcu_preempt0-21swapper/022:05:450
71380rcu_preempt0-21swapper/022:05:450
71380rcu_preempt0-21swapper/001:08:190
71380rcu_preempt0-21swapper/001:08:190
71380rcu_preempt0-21swapper/001:08:190
71380rcu_preempt0-21swapper/000:47:450
71380rcu_preempt0-21swapper/000:47:450
71380rcu_preempt0-21swapper/000:47:450
71380rcu_preempt0-21swapper/000:47:450
71380rcu_preempt0-21swapper/000:18:100
71380rcu_preempt0-21swapper/000:18:100
71380rcu_preempt0-21swapper/000:04:330
71380rcu_preempt0-21swapper/000:04:330
71380rcu_preempt0-21swapper/000:04:330
1823199384cyclictest0-21swapper/321:07:503
1823199384cyclictest0-21swapper/321:07:503
1823199382cyclictest9210-21df_inode22:22:543
1823199382cyclictest9210-21df_inode22:22:543
1823199382cyclictest9210-21df_inode22:22:543
1823199382cyclictest26362-21/usr/sbin/munin00:53:073
1823199382cyclictest26362-21/usr/sbin/munin00:53:073
1823199382cyclictest26362-21/usr/sbin/munin00:53:073
1823199381cyclictest6266-21/usr/sbin/munin20:58:003
1823199381cyclictest6266-21/usr/sbin/munin20:58:003
1823199381cyclictest22798-21/usr/sbin/munin19:57:523
1823199381cyclictest22798-21/usr/sbin/munin19:57:523
1823199381cyclictest22798-21/usr/sbin/munin19:57:523
1823199381cyclictest0-21swapper/300:22:553
1823199381cyclictest0-21swapper/300:22:553
1823199381cyclictest0-21swapper/300:22:553
1822899388cyclictest0-21swapper/021:42:150
1822899388cyclictest0-21swapper/021:42:150
1822899388cyclictest0-21swapper/021:42:150
18228993822cyclictest10094-21ntp_offset21:13:020
18228993822cyclictest10094-21ntp_offset21:13:020
18228993817cyclictest8626-21runrttasks00:49:070
18228993817cyclictest8626-21runrttasks00:49:070
71370rcu_preempt5568-21kworker/2:400:19:082
71370rcu_preempt5568-21kworker/2:400:19:082
71370rcu_preempt4729-21copy00:12:500
71370rcu_preempt4729-21copy00:12:500
71370rcu_preempt4729-21copy00:12:500
71370rcu_preempt28466-21grep21:58:091
71370rcu_preempt28466-21grep21:58:091
71370rcu_preempt28466-21grep21:58:091
71370rcu_preempt28466-21grep21:58:091
71370rcu_preempt27391-1kworker/1:1H00:08:191
71370rcu_preempt27391-1kworker/1:1H00:08:191
71370rcu_preempt16398-1diskmemload21:47:321
71370rcu_preempt16398-1diskmemload21:47:321
71370rcu_preempt0-21swapper/123:47:591
71370rcu_preempt0-21swapper/123:47:591
71370rcu_preempt0-21swapper/120:02:491
71370rcu_preempt0-21swapper/120:02:491
71370rcu_preempt0-21swapper/022:38:550
71370rcu_preempt0-21swapper/022:38:550
71370rcu_preempt0-21swapper/022:38:550
71370rcu_preempt0-21swapper/022:13:590
71370rcu_preempt0-21swapper/022:13:590
71370rcu_preempt0-21swapper/021:31:200
71370rcu_preempt0-21swapper/021:31:200
71370rcu_preempt0-21swapper/020:47:540
71370rcu_preempt0-21swapper/020:47:540
71370rcu_preempt0-21swapper/020:22:580
71370rcu_preempt0-21swapper/020:22:580
71370rcu_preempt0-21swapper/020:22:580
71370rcu_preempt0-21swapper/000:55:050
71370rcu_preempt0-21swapper/000:55:050
71370rcu_preempt0-21swapper/000:55:050
1823199371cyclictest21418-21apt-get19:52:523
1823199371cyclictest21418-21apt-get19:52:523
18228993727cyclictest4142-21apt-get23:12:520
18228993727cyclictest4142-21apt-get23:12:520
18228993727cyclictest4142-21apt-get23:12:520
18228993717cyclictest29634-21/usr/sbin/munin23:58:080
18228993717cyclictest29634-21/usr/sbin/munin23:58:080
18228993714cyclictest0-21swapper/001:03:040
18228993714cyclictest0-21swapper/001:03:040
71360rcu_preempt12349-21date21:22:471
71360rcu_preempt12349-21date21:22:471
71360rcu_preempt12349-21date21:22:471
71360rcu_preempt0-21swapper/223:02:012
71360rcu_preempt0-21swapper/223:02:012
71360rcu_preempt0-21swapper/223:02:012
71360rcu_preempt0-21swapper/222:20:492
71360rcu_preempt0-21swapper/222:20:492
71360rcu_preempt0-21swapper/222:14:142
71360rcu_preempt0-21swapper/222:14:142
71360rcu_preempt0-21swapper/123:04:031
71360rcu_preempt0-21swapper/123:04:031
71360rcu_preempt0-21swapper/122:56:371
71360rcu_preempt0-21swapper/122:56:371
71360rcu_preempt0-21swapper/122:13:251
71360rcu_preempt0-21swapper/122:13:251
71360rcu_preempt0-21swapper/100:27:371
71360rcu_preempt0-21swapper/100:27:371
71360rcu_preempt0-21swapper/100:27:371
71360rcu_preempt0-21swapper/023:01:060
71360rcu_preempt0-21swapper/023:01:060
71360rcu_preempt0-21swapper/023:01:060
71360rcu_preempt0-21swapper/022:53:330
71360rcu_preempt0-21swapper/022:53:330
71360rcu_preempt0-21swapper/022:43:070
71360rcu_preempt0-21swapper/022:43:070
71360rcu_preempt0-21swapper/022:43:070
71360rcu_preempt0-21swapper/021:48:440
71360rcu_preempt0-21swapper/021:48:440
71360rcu_preempt0-21swapper/021:48:440
71360rcu_preempt0-21swapper/020:32:580
71360rcu_preempt0-21swapper/020:32:580
71360rcu_preempt0-21swapper/020:32:580
1823199362cyclictest30292-21ntp_states20:23:083
1823199362cyclictest30292-21ntp_states20:23:083
1823199362cyclictest30292-21ntp_states20:23:083
1823199361cyclictest8626-21runrttasks21:03:263
1823199361cyclictest8626-21runrttasks21:03:263
1823199361cyclictest32423-21latency_hist20:32:433
1823199361cyclictest32423-21latency_hist20:32:433
1823199361cyclictest0-21swapper/321:35:493
1823199361cyclictest0-21swapper/321:35:493
1823199361cyclictest0-21swapper/320:56:073
1823199361cyclictest0-21swapper/320:56:073
18231993615cyclictest12661-21/usr/sbin/munin21:22:573
18231993615cyclictest12661-21/usr/sbin/munin21:22:573
18231993615cyclictest12661-21/usr/sbin/munin21:22:573
18228993616cyclictest26470-21users20:08:090
18228993616cyclictest26470-21users20:08:090
18228993616cyclictest26470-21users20:08:090
18228993613cyclictest0-21swapper/021:59:580
18228993613cyclictest0-21swapper/021:59:580
18228993613cyclictest0-21swapper/021:59:580
18228993613cyclictest0-21swapper/021:59:580
71350rcu_preempt23652-1kworker/0:1H23:03:240
71350rcu_preempt23652-1kworker/0:1H23:03:240
71350rcu_preempt12887-21snmpd00:48:021
71350rcu_preempt12887-21snmpd00:48:021
71350rcu_preempt0-21swapper/223:38:042
71350rcu_preempt0-21swapper/223:38:042
71350rcu_preempt0-21swapper/201:11:012
71350rcu_preempt0-21swapper/201:11:012
71350rcu_preempt0-21swapper/201:11:012
71350rcu_preempt0-21swapper/200:41:172
71350rcu_preempt0-21swapper/200:41:172
71350rcu_preempt0-21swapper/200:41:172
71350rcu_preempt0-21swapper/123:53:451
71350rcu_preempt0-21swapper/123:53:451
71350rcu_preempt0-21swapper/123:45:311
71350rcu_preempt0-21swapper/123:45:311
71350rcu_preempt0-21swapper/123:45:311
71350rcu_preempt0-21swapper/122:22:561
71350rcu_preempt0-21swapper/122:22:561
71350rcu_preempt0-21swapper/122:22:561
71350rcu_preempt0-21swapper/121:40:111
71350rcu_preempt0-21swapper/121:40:111
71350rcu_preempt0-21swapper/121:40:111
71350rcu_preempt0-21swapper/120:32:411
71350rcu_preempt0-21swapper/120:32:411
71350rcu_preempt0-21swapper/023:43:470
71350rcu_preempt0-21swapper/023:43:470
71350rcu_preempt0-21swapper/023:43:470
71350rcu_preempt0-21swapper/023:30:570
71350rcu_preempt0-21swapper/023:30:570
71350rcu_preempt0-21swapper/021:33:070
71350rcu_preempt0-21swapper/021:33:070
71350rcu_preempt0-21swapper/021:03:420
71350rcu_preempt0-21swapper/021:03:420
71350rcu_preempt0-21swapper/020:03:060
71350rcu_preempt0-21swapper/020:03:060
71350rcu_preempt0-21swapper/000:34:040
71350rcu_preempt0-21swapper/000:34:040
71350rcu_preempt0-21swapper/000:34:040
18228993526cyclictest21418-21apt-get19:52:500
18228993526cyclictest21418-21apt-get19:52:500
18228993514cyclictest6203-21/usr/sbin/munin22:18:100
18228993514cyclictest6203-21/usr/sbin/munin22:18:100
18228993513cyclictest0-21swapper/020:18:030
18228993513cyclictest0-21swapper/020:18:030
18228993513cyclictest0-21swapper/000:27:580
18228993513cyclictest0-21swapper/000:27:580
18228993512cyclictest0-21swapper/020:38:080
18228993512cyclictest0-21swapper/020:38:080
18228993512cyclictest0-21swapper/020:38:080
71340rcu_preempt32482-1kworker/1:0H01:08:071
71340rcu_preempt32482-1kworker/1:0H01:08:071
71340rcu_preempt32482-1kworker/1:0H01:08:071
71340rcu_preempt16151-1kworker/1:0H23:34:401
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional