You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-22 - 13:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Tue Sep 22, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
35203102710,18sleep375-21kworker/3:1+events20:59:043
36248852570,1chrt3624890-21irqrtprio22:44:031
36248852570,1chrt3624890-21irqrtprio22:44:031
3412164995445,7cyclictest278-21systemd-journal00:05:001
3412164995445,7cyclictest278-21systemd-journal00:05:001
3412164995348,3cyclictest3360057-21kworker/u8:2+flush-8:019:19:171
3412164995242,7cyclictest3429100-21latency_hist19:25:001
36549552490,5sleep3451irq_work/323:14:063
3412161994843,3cyclictest3489163-21kworker/u8:0+events_unbound20:38:590
3412161994738,7cyclictest3708530-21/usr/sbin/munin00:09:160
3412161994640,4cyclictest3668996-21/usr/sbin/munin23:29:140
3412161994638,6cyclictest3519280-21/usr/sbin/munin20:59:130
3412161994537,5cyclictest3583540-21apt-get22:00:000
3412161994437,5cyclictest3423578-21kworker/u8:0+flush-8:019:28:590
3412161994437,5cyclictest3423578-21kworker/u8:0+flush-8:019:28:590
3412164994338,3cyclictest3558232-21ntpq21:34:091
3412164994336,5cyclictest3412003-21kworker/u8:1+flush-8:020:19:001
3412161994335,6cyclictest3622819-21ntpq22:39:120
3412161994335,6cyclictest3622819-21ntpq22:39:120
3412164994234,6cyclictest3738441-21/usr/sbin/munin00:39:161
3412164994234,6cyclictest3713759-21diskstats00:13:591
3412161994135,4cyclictest3489163-21kworker/u8:0+flush-8:020:44:010
3412161994132,7cyclictest3722861-21apt-get00:20:010
3412161994132,7cyclictest3688754-21/usr/sbin/munin23:49:120
3412164994030,8cyclictest3533000-21ntpq21:09:111
3412164994030,8cyclictest3533000-21ntpq21:09:111
3412161994036,2cyclictest3703082-21kworker/u8:3+events_unbound00:04:040
3412161994036,2cyclictest3703082-21kworker/u8:3+events_unbound00:04:040
3412161994035,4cyclictest3489163-21kworker/u8:0+flush-8:020:49:010
3412164993930,7cyclictest3417010-21cat19:15:001
3412161993929,8cyclictest3742210-21ntpq00:39:100
3412164993831,5cyclictest3438952-21cat19:35:001
3412161993833,3cyclictest3448914-21kworker/u8:2+flush-8:019:59:000
3412161993832,4cyclictest3633017-21kworker/u8:0+flush-8:023:24:150
3412161993831,5cyclictest278-21systemd-journal20:30:560
3412164993731,4cyclictest278-21systemd-journal00:09:591
3412164993727,8cyclictest3548113-21ntpq21:24:101
3412161993730,5cyclictest3412003-21kworker/u8:1+events_unbound21:30:010
3412164993630,4cyclictest3489163-21kworker/u8:0+flush-8:020:34:131
3412164993628,6cyclictest278-21systemd-journal19:39:121
3412164993627,3cyclictest3518782-21kworker/u8:3+flush-8:021:04:011
3412164993627,3cyclictest3518782-21kworker/u8:3+flush-8:021:04:011
3412164993626,8cyclictest3513188-21ntpq20:49:091
340750723621,10sleep10-21swapper/119:07:191
3412164993531,3cyclictest3489163-21kworker/u8:0+events_unbound20:59:031
3412164993524,8cyclictest3677780-21ntpq23:34:131
3412161993531,2cyclictest3628883-21latency_hist22:45:000
3412161993531,2cyclictest3628883-21latency_hist22:45:000
3412161993526,6cyclictest3588750-21latency_hist22:05:010
3412169993427,5cyclictest278-21systemd-journal23:50:002
3412164993428,5cyclictest3423578-21kworker/u8:0+flush-8:019:29:131
3412164993428,5cyclictest3423578-21kworker/u8:0+flush-8:019:29:131
3412161993429,4cyclictest3412003-21kworker/u8:1+flush-8:019:49:010
3412161993428,4cyclictest2596456-21kworker/u8:3+events_unbound19:15:020
3412161993425,7cyclictest3533606-21latency_hist21:10:000
3412161993425,7cyclictest3533606-21latency_hist21:10:000
3412161993425,7cyclictest3518166-21ntpq20:54:110
3412161993424,8cyclictest3637923-21ntpq22:54:100
37347312330,3sleep10-21swapper/100:34:051
3412164993329,2cyclictest3649976-21irqrtprio23:09:011
3412164993327,5cyclictest2596456-21kworker/u8:3+flush-8:020:09:141
3412161993328,3cyclictest3618443-21unixbench_singl22:34:160
3412161993328,3cyclictest3438946-21ls19:35:000
3412161993324,7cyclictest3659402-21diskstats23:18:590
3412164993226,5cyclictest3633017-21kworker/u8:0+flush-8:000:19:021
3412161993228,3cyclictest3429124-21systemd-run19:25:000
3412161993226,4cyclictest3443915-21latency_hist19:40:010
341216199322,28cyclictest3508955-21kworker/0:2+events21:14:330
3412164993127,2cyclictest3642823-21needreboot22:59:071
3412164993126,4cyclictest3648689-21latency_hist23:05:021
3412164993124,5cyclictest3489163-21kworker/u8:0+flush-8:020:44:131
3412161993127,3cyclictest3678291-21kworker/u8:2+flush-8:000:24:200
3412161993127,2cyclictest3598644-21idleruntime-cro22:15:000
3412161993123,6cyclictest3483074-21ntpq20:19:100
3412169993021,7cyclictest3722981-21gpgv00:20:012
3412164993026,3cyclictest3412003-21kworker/u8:1+events_unbound19:49:141
3412164993026,2cyclictest3462993-21needreboot19:59:061
3412164993026,2cyclictest0-21swapper/100:29:041
3412164993025,3cyclictest3598204-21systemctl22:14:151
3412164993024,4cyclictest3412003-21kworker/u8:1+flush-8:020:24:011
3412164993023,5cyclictest278-21systemd-journal23:40:001
3412164993022,6cyclictest3634153-21apt-get22:53:561
3412164993020,7cyclictest3698072-21latency_hist23:55:001
355333622924,3sleep13518782-21kworker/u8:3+flush-8:021:29:161
3412169992925,2cyclictest3738818-21fschecks_time00:39:032
3412164992925,2cyclictest0-21swapper/123:44:011
3412164992924,4cyclictest3593597-21kworker/u8:1+flush-8:022:31:431
3412164992923,5cyclictest3533555-21kworker/u8:2+events_unbound21:44:131
3412164992917,9cyclictest278-21systemd-journal21:50:001
341216199294,22cyclictest3608941-21sshd22:26:130
3412161992924,4cyclictest3703082-21kworker/u8:3+flush-8:000:14:140
3412161992924,3cyclictest3644325-21cpuspeed_turbos23:04:000
3412161992922,5cyclictest2596456-21kworker/u8:3+events_unbound19:14:130
3412169992824,2cyclictest3708667-21aten2_r5power_v00:08:592
3412169992823,3cyclictest3658599-21cron23:15:002
3412169992819,7cyclictest3553936-21gpgv21:30:012
3412169992818,7cyclictest3424225-21cat19:20:002
3412164992824,3cyclictest838-21mta-sts-daemon23:13:581
3412164992824,2cyclictest3445507-21kthreadcore19:44:051
3412164992823,3cyclictest3469051-21latency_hist20:05:011
3412164992819,6cyclictest3518751-21latency_hist20:55:001
3412161992824,3cyclictest3723336-21kworker/u8:1+events_unbound00:34:070
3412161992823,4cyclictest3518782-21kworker/u8:3+flush-8:021:04:270
3412161992823,4cyclictest3518782-21kworker/u8:3+flush-8:021:04:270
3412161992823,3cyclictest3698080-21idleruntime-cro23:55:000
3412161992820,6cyclictest3573044-21ntpq21:49:080
3412161992817,9cyclictest3649507-21diskstats23:08:580
3412161992817,8cyclictest3493189-21ntpq20:29:080
3412169992723,3cyclictest3693827-21aten2_r5power_v23:53:582
3412169992722,3cyclictest3503945-21cron20:40:002
3412169992715,9cyclictest3493850-21apt20:30:002
3412164992723,2cyclictest3454962-21irqcore19:54:031
3412164992722,4cyclictest3593597-21kworker/u8:1+flush-8:023:21:181
3412164992721,3cyclictest0-21swapper/120:39:121
3412161992724,2cyclictest3473414-21mailstats20:09:180
3412161992723,2cyclictest0-21swapper/022:25:000
3412161992723,2cyclictest0-21swapper/020:05:000
3412161992721,4cyclictest3633017-21kworker/u8:0+flush-8:022:59:000
3412161992718,7cyclictest3488665-21latency_hist20:25:010
3412161992717,8cyclictest3577975-21ntpq21:54:080
3412169992623,2cyclictest3702927-21unixbench_singl23:59:182
3412169992623,2cyclictest3429710-21aten2_r5power_e19:28:572
3412169992623,2cyclictest3429710-21aten2_r5power_e19:28:572
3412169992621,3cyclictest3449658-21cpuspeed_turbos19:48:592
3412164992621,4cyclictest3518782-21kworker/u8:3+flush-8:022:19:021
3412164992621,3cyclictest3543804-21systemd-run21:20:001
3412164992618,5cyclictest278-21systemd-journal22:26:131
3412161992622,3cyclictest2596456-21kworker/u8:3+flush-8:020:14:180
3412161992622,2cyclictest0-21swapper/023:40:000
3412161992620,4cyclictest3423578-21kworker/u8:0+flush-8:019:44:020
3412169992522,2cyclictest3717791-21unixbench_singl00:14:152
3412164992521,3cyclictest3633017-21kworker/u8:0+events_unbound23:49:051
3412164992521,2cyclictest3494055-21latency_hist20:30:011
3412164992520,4cyclictest3533555-21kworker/u8:2+events_unbound21:54:031
3412164992519,4cyclictest3608539-21grep22:24:171
3412164992519,4cyclictest3583447-21unixbench_singl21:59:151
3412161992515,8cyclictest3654445-21diskstats23:14:020
3412161992510,13cyclictest3508955-21kworker/0:2+events22:18:010
3412169992421,2cyclictest3598529-21unixbench_singl22:14:162
3412169992421,2cyclictest3539598-21cpuspeed_turbos21:19:002
3412169992420,3cyclictest3538702-21unixbench_singl21:14:152
3412169992415,7cyclictest3443961-21grep19:40:012
3412164992420,3cyclictest3535121-21irqrtprio21:14:021
3412164992420,2cyclictest3584931-21irqcore22:04:041
3412164992419,3cyclictest3725819-21kthreadcore00:24:061
3412164992412,9cyclictest278-21systemd-journal23:29:131
341216199243,20cyclictest3508955-21kworker/0:2+events22:05:550
341216199242,20cyclictest3548713-21sh21:25:010
36296382230,4sleep20-21swapper/222:49:012
3412169992320,2cyclictest3639463-21fschecks_time22:59:002
3412169992320,2cyclictest3454485-21aten2_r5power_v19:53:582
3412169992319,3cyclictest0-21swapper/221:00:002
3412169992319,2cyclictest3468859-21latency_hist20:05:022
3412169992318,3cyclictest3533492-21unixbench_singl21:09:172
3412169992318,3cyclictest3533492-21unixbench_singl21:09:172
3412169992312,9cyclictest3728053-21awk00:25:002
3412164992319,2cyclictest0-21swapper/123:18:591
3412164992319,2cyclictest0-21swapper/122:49:071
3412164992318,4cyclictest2596456-21kworker/u8:3+flush-8:020:14:021
3412164992316,2cyclictest161rcu_preempt21:39:021
341216199232,20cyclictest0-21swapper/021:39:200
3412161992317,4cyclictest3533555-21kworker/u8:2+events_unbound21:44:030
3412161992316,4cyclictest1-21systemd23:43:130
34074172233,3sleep00-21swapper/019:06:100
3412169992219,2cyclictest3599255-21aten2_r5power_e22:18:592
3412169992218,2cyclictest3604461-21fschecks_count22:24:012
3412164992218,2cyclictest0-21swapper/122:39:041
3412164992218,2cyclictest0-21swapper/122:39:041
3412164992218,2cyclictest0-21swapper/122:09:021
3412164992216,5cyclictest3633017-21kworker/u8:0+flush-8:023:59:101
341216199225,16cyclictest3508955-21kworker/0:2+events23:33:590
341216199225,16cyclictest3508955-21kworker/0:2+events21:34:070
341216199223,5cyclictest0-21swapper/019:54:030
3412161992218,2cyclictest0-21swapper/022:48:590
341216199221,20cyclictest3683315-21kworker/0:0+events23:56:320
3412169992118,2cyclictest3569599-21fschecks_count21:49:002
3412169992118,2cyclictest3469723-21fschecks_count20:09:042
3412169992117,2cyclictest3624108-21aten2_r5power_e22:43:572
3412169992117,2cyclictest3624108-21aten2_r5power_e22:43:572
341216999202,13cyclictest3682638-21ntpq23:39:102
3412169992016,3cyclictest3648693-21latency_hist23:05:012
3412169992016,2cyclictest3733770-21cpuspeed_turbos00:34:002
3412169992016,2cyclictest3703675-21aten2_r5power_e00:03:572
3412169992016,2cyclictest3703675-21aten2_r5power_e00:03:572
3412169992016,2cyclictest3614222-21aten2_r5power_p22:33:582
3412169992016,2cyclictest0-21swapper/223:44:052
3412169992011,7cyclictest3620886-21seq22:39:082
3412169992011,7cyclictest3620886-21seq22:39:082
3412169992010,2cyclictest0-21swapper/222:04:082
3412161992015,3cyclictest3541452-21kthreadcore21:19:060
341216999197,4cyclictest0-21swapper/222:54:002
341216999197,4cyclictest0-21swapper/221:31:142
3412169991916,2cyclictest3424747-21aten2_r5power_c19:23:582
3412169991915,3cyclictest3668349-21unixbench_singl23:24:172
3412169991915,2cyclictest0-21swapper/221:55:002
3412169991914,3cyclictest3609409-21tr22:28:572
3412169991913,4cyclictest3568610-21unixbench_multi21:44:152
3412169991913,4cyclictest278-21systemd-journal20:15:002
3412169991910,6cyclictest3416070-21tr19:14:052
34333842180,2sleep3481ktimers/319:29:073
34333842180,2sleep3481ktimers/319:29:073
341216999189,7cyclictest3462390-21tr19:59:052
341216999182,12cyclictest3582869-21ntpq21:59:072
341216999182,11cyclictest3589298-21apt-get22:08:582
3412169991814,2cyclictest3678328-21cron23:35:002
3412169991814,2cyclictest3673309-21grep23:29:162
34073952183,8sleep30-21swapper/319:05:533
34073292184,10sleep20-21swapper/219:05:032
34642632179,5sleep30-21swapper/320:03:553
341216999179,6cyclictest3488109-21sshd20:24:122
3412169991713,2cyclictest3663501-21cron23:20:002
3412169991713,2cyclictest3498887-21unixbench_singl20:34:162
3412169991713,2cyclictest0-21swapper/220:19:042
3412169991713,2cyclictest0-21swapper/219:34:042
3412169991712,4cyclictest3723336-21kworker/u8:1+events_unbound00:29:052
3412169991712,3cyclictest0-21swapper/223:10:002
3412169991711,4cyclictest3509683-21cpuspeed_turbos20:48:592
3412169991711,4cyclictest0-21swapper/221:39:112
341216199174,12cyclictest3683315-21kworker/0:0+events00:27:470
36199962166,6sleep30-21swapper/322:39:083
36199962166,6sleep30-21swapper/322:39:083
3412169991613,2cyclictest0-21swapper/221:20:552
3412169991612,3cyclictest3514626-21tr20:53:592
341216999161,11cyclictest3444481-21apt-get19:43:592
3412169991512,2cyclictest0-21swapper/221:02:122
3412169991512,2cyclictest0-21swapper/221:02:122
3412169991512,2cyclictest0-21swapper/220:43:462
37026672142,8sleep30-21swapper/323:59:173
37129742132,6sleep30-21swapper/300:10:013
36882352132,6sleep30-21swapper/323:45:013
36777972132,7sleep30-21swapper/323:34:133
35893022132,7sleep30-21swapper/322:08:593
35335882133,6sleep30-21swapper/321:10:003
35335882133,6sleep30-21swapper/321:10:003
35169262133,7sleep30-21swapper/320:54:083
34989852132,6sleep30-21swapper/320:35:013
34738002132,6sleep30-21swapper/320:10:013
34241642132,6sleep30-21swapper/319:20:013
37390002122,6sleep30-21swapper/300:39:063
37340532122,6sleep30-21swapper/300:34:043
37289752122,6sleep30-21swapper/300:29:033
37279902122,6sleep30-21swapper/300:24:293
37041172122,6sleep30-21swapper/300:04:033
37041172122,6sleep30-21swapper/300:04:033
36788972122,6sleep30-21swapper/323:38:593
36695102122,6sleep30-21swapper/323:29:043
36605422122,6sleep30-21swapper/323:19:053
36532652123,5sleep30-21swapper/323:09:143
36478802122,6sleep30-21swapper/323:04:123
36239692122,6sleep30-21swapper/322:43:133
36239692122,6sleep30-21swapper/322:43:133
36136092122,6sleep30-21swapper/322:30:013
36096002122,6sleep30-21swapper/322:29:013
36068122122,6sleep30-21swapper/322:24:073
35794122123,6sleep30-21swapper/321:58:593
35695602122,6sleep30-21swapper/321:49:003
35643232122,6sleep30-21swapper/321:43:553
35393832122,6sleep30-21swapper/321:18:593
35364072122,6sleep30-21swapper/321:14:053
35237462122,6sleep30-21swapper/321:00:013
35237462122,6sleep30-21swapper/321:00:013
35094042124,5sleep30-21swapper/320:48:293
34948852122,6sleep30-21swapper/320:34:013
34932502122,6sleep30-21swapper/320:29:113
34879912122,6sleep30-21swapper/320:24:103
34828952122,6sleep30-21swapper/320:19:083
34494432122,6sleep30-21swapper/319:48:583
34416222122,6sleep30-21swapper/319:39:073
34344802123,6sleep30-21swapper/319:32:533
37181552112,5sleep30-21swapper/300:15:303
37082732112,6sleep30-21swapper/300:05:393
36933962112,6sleep30-21swapper/323:50:103
36875672112,5sleep30-21swapper/323:44:093
36637812112,6sleep30-21swapper/323:20:223
36388652112,6sleep30-21swapper/322:56:053
36339202112,5sleep30-21swapper/322:51:163
36291122112,6sleep30-21swapper/322:47:353
35989632112,6sleep30-21swapper/322:16:173
35939242112,6sleep30-21swapper/322:10:353
35842122112,6sleep30-21swapper/322:02:373
35739702112,6sleep30-21swapper/321:50:453
35592282112,6sleep30-21swapper/321:37:043
35541742112,6sleep30-21swapper/321:30:343
35490762112,5sleep30-21swapper/321:26:453
35440102112,6sleep30-21swapper/321:20:073
35042672112,6sleep30-21swapper/320:40:553
34693662112,6sleep30-21swapper/320:08:083
34590892112,6sleep30-21swapper/319:56:253
34541412112,6sleep30-21swapper/319:51:153
34444042112,6sleep30-21swapper/319:43:173
34193062112,5sleep30-21swapper/319:17:003
34123632112,6sleep30-21swapper/319:11:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional