You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-29 - 10:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Wed Apr 29, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
34886252560,3chrt371rcuc/220:56:132
35194652550,5chrt281rcuc/121:26:161
3379097995344,6cyclictest3535163-21latency_hist21:45:001
3379097995242,6cyclictest280-21systemd-journal22:15:001
3379100995138,10cyclictest3484491-21ntpq20:51:172
3379097995145,4cyclictest3406086-21kworker/u8:1+flush-8:019:51:061
3379097995142,6cyclictest3405626-21apt-get19:35:001
3379095995040,7cyclictest280-21systemd-journal23:31:220
3379095994937,9cyclictest3439765-21ntpq20:06:140
3379095994837,9cyclictest280-21systemd-journal22:40:010
3379097994741,5cyclictest3568190-21kworker/u8:3+events_unbound22:16:211
3379097994741,5cyclictest3568190-21kworker/u8:3+events_unbound22:16:211
3379095994737,8cyclictest3440540-21kworker/u8:2+flush-8:020:16:100
3379095994737,8cyclictest3440540-21kworker/u8:2+flush-8:020:16:090
3379100994639,4cyclictest3500413-21kworker/u8:2+flush-8:021:16:092
3379097994642,3cyclictest3639677-21kworker/u8:0+flush-8:000:06:161
3379097994641,4cyclictest2005899-21kworker/u8:3+flush-8:019:36:211
3379097994539,4cyclictest3440540-21kworker/u8:2+flush-8:020:21:071
3379097994437,5cyclictest3658466-21kworker/u8:1+flush-8:023:46:221
3379097994436,6cyclictest3659555-21/usr/sbin/munin23:51:201
3379097994235,5cyclictest3440540-21kworker/u8:2+flush-8:020:36:201
3379097994234,6cyclictest280-21systemd-journal00:02:441
3379097994233,7cyclictest280-21systemd-journal21:35:001
3379095994233,7cyclictest280-21systemd-journal20:12:100
3379097994136,4cyclictest3406086-21kworker/u8:1+events_unbound20:41:211
3379100994034,4cyclictest3500413-21kworker/u8:2+flush-8:022:26:172
3379097994031,6cyclictest280-21systemd-journal21:06:411
3379097994030,8cyclictest3559911-21apt-get22:10:001
3379095994036,3cyclictest3568190-21kworker/u8:3+flush-8:023:11:130
3379097993935,3cyclictest3406086-21kworker/u8:1+flush-8:020:26:081
3379097993933,4cyclictest3440540-21kworker/u8:2+flush-8:020:16:081
3379097993933,4cyclictest3440540-21kworker/u8:2+flush-8:020:16:081
3379097993834,3cyclictest2544827-21kworker/u8:2+flush-8:019:21:071
3379097993833,3cyclictest2005899-21kworker/u8:3+flush-8:021:01:211
3379095993833,3cyclictest2005899-21kworker/u8:3+flush-8:019:36:090
3379097993732,4cyclictest3406086-21kworker/u8:1+flush-8:020:11:191
3379097993731,4cyclictest3693982-21kworker/u8:1+flush-8:000:26:071
3379097993731,4cyclictest3480722-21apt-get20:51:021
3379095993732,4cyclictest3595257-21kworker/u8:1+flush-8:022:51:150
3379095993732,4cyclictest3568190-21kworker/u8:3+flush-8:023:36:140
3379097993630,4cyclictest3568190-21kworker/u8:3+flush-8:022:56:141
3379095993630,4cyclictest3500413-21kworker/u8:2+events_unbound23:16:220
3379095993629,5cyclictest3470489-21latency_hist20:40:010
3379095993626,8cyclictest3633677-21ntpq23:21:170
3379100993530,4cyclictest3440540-21kworker/u8:2+flush-8:020:31:182
3379097993531,3cyclictest3678609-21kworker/u8:3+events_unbound00:21:131
3379097993531,3cyclictest3678609-21kworker/u8:3+events_unbound00:21:131
3379097993530,3cyclictest3500413-21kworker/u8:2+flush-8:000:11:231
3379095993527,6cyclictest280-21systemd-journal21:15:000
3379100993428,4cyclictest3406086-21kworker/u8:1+flush-8:019:55:312
3379095993428,4cyclictest2544827-21kworker/u8:2+flush-8:019:26:200
337909599340,30cyclictest3565078-21true22:14:590
33742662344,9sleep10-21swapper/119:05:041
3379097993329,3cyclictest3500413-21kworker/u8:2+events_unbound22:31:191
3379097993327,5cyclictest3568190-21kworker/u8:3+events_unbound23:06:061
3379095993325,6cyclictest3544720-21unixbench_singl21:51:210
3379095993322,8cyclictest3663397-21ntpq23:51:160
3379100993224,6cyclictest280-21systemd-journal21:55:002
3379097993228,3cyclictest3568190-21kworker/u8:3+flush-8:022:36:151
3379097993228,3cyclictest2544827-21kworker/u8:2+flush-8:019:26:221
3379097993227,4cyclictest3595257-21kworker/u8:1+flush-8:022:51:211
3379097993226,5cyclictest2005899-21kworker/u8:3+events_unbound19:16:191
3379097993226,4cyclictest280-21systemd-journal23:14:431
3379095993227,4cyclictest3639677-21kworker/u8:0+flush-8:000:31:080
3379095993227,4cyclictest3568190-21kworker/u8:3+flush-8:023:01:210
3379095993226,5cyclictest3475099-21unixbench_singl20:41:230
3379095993225,6cyclictest3658888-21unixbench_multi23:46:240
3379100993127,3cyclictest3544260-21kworker/u8:1+events_unbound22:01:272
3379100993126,4cyclictest3406086-21kworker/u8:1+flush-8:021:06:512
3379100993125,4cyclictest3624265-21unixbench_multi23:11:222
3379097993127,3cyclictest3568190-21kworker/u8:3+events_unbound23:41:071
3379097993126,3cyclictest3640497-21irqrtprio23:31:101
3379095993127,3cyclictest3406086-21kworker/u8:1+flush-8:019:54:120
3379095993127,3cyclictest3406086-21kworker/u8:1+events_unbound20:02:000
3379095993127,3cyclictest3406086-21kworker/u8:1+events_unbound20:02:000
3379095993127,3cyclictest2005899-21kworker/u8:3+flush-8:019:56:080
3379095993126,4cyclictest2005899-21kworker/u8:3+events_unbound19:15:030
3379095993124,6cyclictest3599649-21unixbench_singl22:46:240
3379100993024,4cyclictest3410545-21journal-offline19:36:232
3379097993027,2cyclictest3635066-21cpuspeed_turbos23:26:031
3379097993026,3cyclictest3625679-21irqrtprio23:16:111
3379097993026,3cyclictest3595257-21kworker/u8:1+flush-8:023:21:071
3379097993025,4cyclictest3500413-21kworker/u8:2+flush-8:021:36:181
3379097993025,4cyclictest2005899-21kworker/u8:3+events_unbound21:25:011
3379097993024,4cyclictest3658466-21kworker/u8:1+flush-8:023:56:101
3379097993023,5cyclictest3435701-21cron20:05:001
3379097993023,5cyclictest3435701-21cron20:05:001
3379097993018,9cyclictest280-21systemd-journal23:37:431
3379097993016,4cyclictest3406086-21kworker/u8:1+events_unbound20:59:461
3379095993025,4cyclictest3658466-21kworker/u8:1+flush-8:000:06:130
3379095993025,4cyclictest3524872-21kworker/u8:0+events_unbound22:16:050
3379095993025,4cyclictest3524872-21kworker/u8:0+events_unbound22:16:050
3379095993025,4cyclictest3406086-21kworker/u8:1+flush-8:020:21:190
3379095993024,5cyclictest3688678-21unixbench_singl00:16:220
3379095993024,4cyclictest3654005-21unixbench_singl23:41:230
3379095993023,5cyclictest3406086-21kworker/u8:1+events_unbound20:56:170
3379095993023,5cyclictest3405620-21latency_hist19:35:010
3379100992926,2cyclictest3619380-21unixbench_singl23:06:232
3379100992925,3cyclictest3406086-21kworker/u8:1+events_unbound20:46:252
3379100992925,3cyclictest2005899-21kworker/u8:3+flush-8:020:01:132
3379100992925,3cyclictest2005899-21kworker/u8:3+flush-8:020:01:132
3379100992922,5cyclictest280-21systemd-journal21:05:002
3379097992924,4cyclictest3500413-21kworker/u8:2+events_unbound22:26:151
3379097992922,5cyclictest280-21systemd-journal19:42:411
3379097992921,6cyclictest3594770-21apt-get22:45:001
3379095992925,2cyclictest3669137-21cron00:00:000
3379095992924,3cyclictest3456092-21aten2_r5power_p20:26:050
3379095992923,5cyclictest3554642-21unixbench_multi22:01:230
3379095992919,8cyclictest280-21systemd-journal21:20:000
3379100992824,3cyclictest3500413-21kworker/u8:2+events_unbound23:45:012
3379097992824,3cyclictest3500413-21kworker/u8:2+flush-8:000:16:211
3379097992824,2cyclictest3464670-21ntpq20:31:161
3379097992822,5cyclictest3500413-21kworker/u8:2+flush-8:021:56:181
3379095992824,3cyclictest3594410-21unixbench_multi22:41:230
3379095992824,3cyclictest3383039-21needreboot19:11:140
3379095992822,5cyclictest3683656-21unixbench_multi00:11:230
3379095992822,4cyclictest3500413-21kworker/u8:2+events_unbound22:31:070
35947562270,6sleep30-21swapper/322:45:013
3379100992722,3cyclictest3693584-21unixbench_multi00:21:232
3379100992722,3cyclictest3693584-21unixbench_multi00:21:232
3379100992720,5cyclictest3405626-21apt-get19:35:002
3379097992722,4cyclictest2005899-21kworker/u8:3+flush-8:021:46:231
3379097992722,3cyclictest3440540-21kworker/u8:2+flush-8:020:45:121
3379097992721,5cyclictest3406086-21kworker/u8:1+events_unbound19:46:161
3379095992722,3cyclictest3406086-21kworker/u8:1-rpciod21:01:120
3379095992721,5cyclictest3698574-21unixbench_singl00:26:230
3379095992721,4cyclictest3570432-21aten2_r5power_p22:21:050
3379095992721,4cyclictest3500413-21kworker/u8:2+flush-8:021:21:230
3379095992719,6cyclictest3704241-21aten2_r5power_e00:36:060
3379100992622,2cyclictest3510530-21aten2_r5power_p21:21:062
3379100992621,3cyclictest3678748-21unixbench_singl00:06:232
3379097992622,3cyclictest3406086-21kworker/u8:1+flush-8:020:08:321
3379097992622,2cyclictest3554999-21cron22:05:001
3379097992622,2cyclictest0-21swapper/122:46:111
3379097992621,4cyclictest2005899-21kworker/u8:3+events_unbound21:11:071
3379095992623,2cyclictest3693042-21needreboot00:21:150
3379095992623,2cyclictest3693042-21needreboot00:21:150
3379095992621,3cyclictest3673823-21unixbench_multi00:01:220
3379095992620,4cyclictest3619334-21unixbench_multi23:06:230
3379100992522,2cyclictest3590463-21fschecks_count22:41:072
3379100992521,2cyclictest3570459-21aten2_r5power_v22:21:062
3379100992517,6cyclictest280-21systemd-journal22:15:002
337910099250,10cyclictest35015662grep21:11:102
3379097992519,4cyclictest2005899-21kworker/u8:3+flush-8:019:11:111
3379097992517,6cyclictest3699247-21apt-get00:31:031
3379097992510,3cyclictest0-21swapper/121:16:121
3379095992522,2cyclictest3558996-21needreboot22:06:140
3379095992522,2cyclictest3495956-21tune2fs21:06:060
3379095992522,2cyclictest3464629-21needreboot20:31:150
3379095992519,4cyclictest3406086-21kworker/u8:1+events_unbound20:46:060
3379095992519,4cyclictest2005899-21kworker/u8:3+flush-8:021:31:070
3379100992419,3cyclictest3610254-21aten2_r5power_e23:01:042
3379100992419,3cyclictest3441101-21aten2_r5power_v20:11:042
3379097992418,4cyclictest3574029-21tail22:21:151
3379097992418,4cyclictest3568190-21kworker/u8:3+flush-8:023:01:161
3379097992417,5cyclictest2005899-21kworker/u8:3+events_unbound19:56:061
3379095992420,2cyclictest0-21swapper/021:56:050
3379095992419,4cyclictest3639116-21unixbench_singl23:26:200
3379095992419,4cyclictest3395459-21unixbench_singl19:21:220
3379095992418,4cyclictest3606123-21kernelversion22:56:130
3379100992319,2cyclictest0-21swapper/223:20:002
3379100992317,5cyclictest3406086-21kworker/u8:1+flush-8:020:21:302
3379097992318,3cyclictest3524872-21kworker/u8:0+events_unbound21:53:021
3379097992317,5cyclictest3639677-21kworker/u8:0+flush-8:000:36:191
3379095992319,3cyclictest2005899-21kworker/u8:3+flush-8:019:46:330
3379095992318,3cyclictest3529151-21missed_timers21:36:150
3379095992317,5cyclictest3500413-21kworker/u8:2+events_unbound22:30:010
3379100992219,2cyclictest3465989-21aten2_r5power_v20:36:052
3379100992218,2cyclictest3471095-21fschecks_count20:41:072
3379100992217,4cyclictest3599576-21unixbench_multi22:46:242
3379100992217,3cyclictest3568190-21kworker/u8:3+events_unbound22:55:022
3379095992218,3cyclictest2005899-21kworker/u8:3+events_unbound21:26:230
3379095992217,3cyclictest0-21swapper/021:41:210
3379095992216,5cyclictest3411244-21aten2_r5power_e19:41:060
33786862229,9sleep20-21swapper/219:07:152
337910099218,5cyclictest0-21swapper/220:06:182
3379100992116,4cyclictest3524872-21kworker/u8:0+flush-8:021:33:482
3379100992116,4cyclictest3524872-21kworker/u8:0+events_unbound22:05:042
3379100992115,4cyclictest3500413-21kworker/u8:2+events_unbound00:00:022
3379100992114,5cyclictest280-21systemd-journal22:20:002
3379100992114,5cyclictest280-21systemd-journal22:19:592
3379095992116,4cyclictest3483765-21kthreadcore20:51:130
3379095992115,4cyclictest2005899-21kworker/u8:3+flush-8:021:49:530
3379095992115,3cyclictest0-21swapper/019:10:010
337910099202,13cyclictest3600284-21apt-get22:51:042
3379100992018,1cyclictest280-21systemd-journal19:40:412
3379100992014,4cyclictest3659843-21fschecks_count23:51:072
3379100992012,6cyclictest280-21systemd-journal21:58:432
3379100992011,7cyclictest3667383-21cut23:56:122
337910099192,12cyclictest3684377-21apt-get00:16:052
3379100991916,2cyclictest3639862-21aten2_r5power_p23:31:062
3379100991916,2cyclictest3583968-21grep22:31:152
3379100991916,2cyclictest3446112-21aten2_r5power_v20:16:052
3379100991916,2cyclictest3446112-21aten2_r5power_v20:16:052
3379100991915,3cyclictest3383575-21unixbench_multi19:11:222
3379100991912,5cyclictest3634791-21sshd23:25:442
3379100991911,6cyclictest3589823-21cron22:40:012
3379100991911,6cyclictest3393300-21cut19:21:122
3379100991815,2cyclictest3515724-21aten2_r5power_v21:26:052
3379100991814,3cyclictest3425711-21cron19:55:002
3379100991814,2cyclictest0-21swapper/221:45:002
3379100991814,2cyclictest0-21swapper/200:31:052
337910099180,16cyclictest3397716-21cut19:26:102
33787292183,8sleep30-21swapper/319:07:483
35753052172,9sleep30-21swapper/322:26:033
3379100991714,2cyclictest3704401-21cpuspeed_turbos00:36:072
3379100991713,3cyclictest3500413-21kworker/u8:2+events_unbound23:24:512
3379100991713,3cyclictest3416406-21fschecks_count19:46:072
3379100991712,3cyclictest0-21swapper/200:11:082
337910099171,12cyclictest3694291-21apt-get00:26:032
337910099171,12cyclictest3535487-21apt-get21:46:042
337910099170,9cyclictest3658391-21ntpq23:46:172
337910099162,8cyclictest3525507-21apt-get21:36:052
3379100991611,3cyclictest0-21swapper/223:36:122
3379100991611,3cyclictest0-21swapper/220:26:122
337910099155,8cyclictest3387668-21tr19:16:132
35603702142,7sleep30-21swapper/322:10:023
34906092142,8sleep30-21swapper/321:01:043
34348492142,8sleep30-21swapper/320:01:173
34348492142,8sleep30-21swapper/320:01:163
35889872132,7sleep30-21swapper/322:36:193
35819192133,6sleep30-21swapper/322:31:123
35291392132,7sleep30-21swapper/321:36:153
35202902132,6sleep30-21swapper/321:30:003
35051222132,7sleep30-21swapper/321:15:013
34762982132,7sleep30-21swapper/320:46:113
34207952130,2sleep375-21kworker/3:1+mm_percpu_wq19:49:593
34015162132,7sleep30-21swapper/319:31:113
37085512123,5sleep30-21swapper/300:37:083
37034562122,6sleep30-21swapper/300:31:243
36978332121,7sleep30-21swapper/300:26:143
36902822122,6sleep30-21swapper/300:21:123
36902822122,6sleep30-21swapper/300:21:123
36797912122,6sleep30-21swapper/300:11:093
36788502122,6sleep30-21swapper/300:07:043
36692182122,5sleep30-21swapper/300:00:023
36642182121,7sleep30-21swapper/323:55:003
36444332122,5sleep30-21swapper/323:35:013
36439892122,6sleep30-21swapper/323:31:243
36369802122,6sleep30-21swapper/323:26:113
36197272122,5sleep30-21swapper/323:10:023
36150552122,6sleep30-21swapper/323:05:443
36100622122,6sleep30-21swapper/323:00:023
36057402122,6sleep30-21swapper/322:56:133
36045862122,6sleep30-21swapper/322:51:243
35703502122,6sleep30-21swapper/322:21:063
35506232122,6sleep30-21swapper/322:01:073
35491762122,6sleep30-21swapper/321:56:183
35404712122,6sleep30-21swapper/321:51:043
35128642122,6sleep30-21swapper/321:21:153
34952802122,5sleep30-21swapper/321:05:013
34862822123,5sleep30-21swapper/320:56:113
34810922122,6sleep30-21swapper/320:51:093
34707762122,6sleep30-21swapper/320:40:413
34606822122,6sleep30-21swapper/320:30:023
34598982122,6sleep30-21swapper/320:26:213
34464692122,6sleep30-21swapper/320:16:103
34464692122,6sleep30-21swapper/320:16:103
34218922122,6sleep30-21swapper/319:51:103
34133722123,5sleep30-21swapper/319:41:153
33958012122,5sleep30-21swapper/319:25:013
33860172122,6sleep30-21swapper/319:15:063
36879242112,5sleep30-21swapper/300:16:153
36689092112,6sleep30-21swapper/323:57:093
36549202112,5sleep30-21swapper/323:46:093
36534042112,5sleep30-21swapper/323:41:163
36320692112,5sleep30-21swapper/323:21:123
36250662112,5sleep30-21swapper/323:16:073
35957032112,5sleep30-21swapper/322:46:093
35657572112,5sleep30-21swapper/322:16:083
35657572112,5sleep30-21swapper/322:16:083
35553652112,6sleep30-21swapper/322:06:053
35353822112,5sleep30-21swapper/321:45:013
35337662112,5sleep30-21swapper/321:41:133
35155362112,6sleep30-21swapper/321:25:243
35063502112,5sleep30-21swapper/321:16:133
34658802112,5sleep30-21swapper/320:36:043
34549382110,7sleep30-21swapper/320:21:193
34409922112,6sleep30-21swapper/320:11:043
34367572112,5sleep30-21swapper/320:06:113
34262792112,5sleep30-21swapper/319:56:073
34088802112,5sleep30-21swapper/319:36:133
33915182112,6sleep30-21swapper/319:21:083
33793092112,5sleep30-21swapper/319:11:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional