You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-30 - 15:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Thu Jul 30, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3405425995651,4cyclictest335557-21systemd-journal00:39:593
3405422994538,4cyclictest3728155-21latency_hist00:20:012
3405415994539,4cyclictest3749670-21latency_hist00:40:000
3405422994433,9cyclictest3696713-21latency_hist23:50:012
3405418994438,4cyclictest335557-21systemd-journal20:59:131
3405415994236,4cyclictest335557-21systemd-journal19:13:100
3405425994037,2cyclictest3623892-21kworker/u8:2+flush-259:023:11:173
3405425994037,2cyclictest3623892-21kworker/u8:2+flush-259:023:11:173
3405415993934,4cyclictest3722930-21apt-key00:15:020
3405425993835,2cyclictest3692312-21kworker/u8:2+flush-259:023:55:183
3405425993731,4cyclictest3572250-21latency_hist21:50:013
3405425993630,4cyclictest3744087-21latency_hist00:35:013
3405422993629,5cyclictest335557-21systemd-journal00:05:002
3405418993630,4cyclictest3488554-21cp20:30:001
3405415993633,2cyclictest3577253-21kworker/u8:0+flush-259:021:55:010
3405422993529,4cyclictest3525590-21apt-get21:05:132
3405418993530,3cyclictest335557-21systemd-journal19:51:121
3405415993531,3cyclictest3488393-21gpgv20:30:000
3405422993327,4cyclictest3426036-21latency_hist19:30:012
3405418993328,3cyclictest335557-21systemd-journal23:34:121
3405425993127,3cyclictest3451592-21kworker/u8:3+events_unbound20:04:133
3405425993127,3cyclictest335557-21systemd-journal21:05:013
3405422993126,4cyclictest335557-21systemd-journal19:20:332
3405418993127,3cyclictest3655399-21kworker/u8:0+events_unbound00:00:011
3405418993026,3cyclictest335557-21systemd-journal22:11:131
3405418993025,4cyclictest3613619-21kworker/u8:3+flush-259:023:10:001
3405418993025,4cyclictest3473146-21apt-get20:15:121
3405418993023,5cyclictest3457005-21apt-get20:00:011
3405425992925,3cyclictest3462628-21kworker/u8:2+flush-259:020:10:443
3405415992925,3cyclictest3462841-21apt-get20:05:110
3405425992825,2cyclictest3707275-21kworker/u8:1+events_unbound00:21:133
3405418992822,4cyclictest3644847-21apt-get23:00:141
3405418992822,4cyclictest3644847-21apt-get23:00:141
3405415992825,2cyclictest3670917-21kworker/u8:1+flush-259:023:45:000
3405415992823,4cyclictest335557-21systemd-journal00:28:200
3405425992723,3cyclictest3655399-21kworker/u8:0+flush-259:023:26:223
3405418992722,3cyclictest3457686-21apt-get20:00:111
3405418992722,3cyclictest3431479-21apt-get19:35:121
3405418992721,4cyclictest3586880-21ntpq22:00:211
3405415992722,4cyclictest3649780-21latency_hist23:05:000
3405415992722,4cyclictest3649780-21latency_hist23:05:000
3405425992622,3cyclictest3577253-21kworker/u8:0+events_unbound22:40:233
3405422992620,4cyclictest3649963-21cp23:05:002
3405422992620,4cyclictest3649963-21cp23:05:002
3405418992622,3cyclictest3644600-21kworker/u8:4+flush-259:023:25:001
3405418992622,3cyclictest3623892-21kworker/u8:2+flush-259:022:55:161
3405418992621,4cyclictest3519763-21kworker/u8:2+flush-259:022:00:011
3405415992620,5cyclictest3700981-21ntpq23:50:210
3405425992522,2cyclictest3462628-21kworker/u8:2+events_unbound20:09:133
3405425992520,3cyclictest3707275-21kworker/u8:1+flush-259:000:15:163
3405425992519,4cyclictest3509688-21apt-get20:50:123
3405425992517,5cyclictest3576505-21ntpq21:50:183
3405418992521,3cyclictest3436631-21apt-get19:40:101
3405415992520,3cyclictest3514863-21apt-get20:55:110
3405425992421,2cyclictest3623892-21kworker/u8:2+flush-259:023:15:243
3405425992421,2cyclictest3462628-21kworker/u8:2+events_unbound20:37:123
3405425992420,3cyclictest3623892-21kworker/u8:2+events_unbound23:01:133
3405425992420,3cyclictest3623892-21kworker/u8:2+events_unbound23:01:133
3405425992420,3cyclictest3488215-21kworker/u8:0+flush-259:020:40:473
3405425992420,3cyclictest3451592-21kworker/u8:3+flush-259:020:45:173
3405425992420,3cyclictest3426060-21kworker/u8:1+events_unbound19:35:003
3405425992420,3cyclictest3421150-21apt-get19:25:113
3405425992419,4cyclictest3650467-21apt-get23:05:123
3405425992418,4cyclictest3707290-21/usr/sbin/munin00:00:173
3405425992417,4cyclictest3738941-21latency_hist00:30:013
3405422992418,4cyclictest335557-21systemd-journal23:25:002
3405418992420,3cyclictest3655399-21kworker/u8:0+flush-259:023:20:001
3405418992420,3cyclictest3519763-21kworker/u8:2+events_unbound21:45:131
3405418992420,3cyclictest3519763-21kworker/u8:2+events_unbound21:45:011
3405418992419,3cyclictest335557-21systemd-journal21:35:591
3405415992420,3cyclictest3644600-21kworker/u8:4+flush-259:000:30:270
3405415992419,4cyclictest3504502-21kworker/u8:1+flush-259:022:10:010
3405415992419,3cyclictest3451592-21kworker/u8:3+flush-259:020:45:200
3405425992320,2cyclictest3399381-21kworker/u8:2+flush-259:019:10:213
3405425992319,3cyclictest3472924-21kworker/u8:1+events_unbound20:20:003
3405418992320,2cyclictest3504502-21kworker/u8:1+flush-259:021:10:211
3405415992318,4cyclictest3655399-21kworker/u8:0+flush-259:023:25:150
3405415992316,5cyclictest3565854-21ntpq21:40:220
3405425992219,2cyclictest3577253-21kworker/u8:0+flush-259:022:05:183
3405425992219,2cyclictest3519763-21kworker/u8:2+flush-259:022:00:243
3405425992218,3cyclictest3504502-21kworker/u8:1+flush-259:021:55:113
3405422992218,3cyclictest3577253-21kworker/u8:0+flush-259:022:10:162
3405422992218,3cyclictest3451592-21kworker/u8:3+flush-259:020:00:162
3405418992220,1cyclictest3451592-21kworker/u8:3+events_unbound20:05:121
3405418992219,2cyclictest3670917-21kworker/u8:1+events_unbound23:40:191
3405418992219,2cyclictest3472924-21kworker/u8:1+events_unbound20:20:111
3405418992218,3cyclictest3399381-21kworker/u8:2+events_unbound19:45:141
3405418992217,4cyclictest3623892-21kworker/u8:2+events_unbound22:50:131
3405418992217,3cyclictest3587991-21/usr/sbin/munin22:05:131
3405418992216,4cyclictest335557-21systemd-journal21:52:121
3405425992117,3cyclictest3670917-21kworker/u8:1+events_unbound23:31:213
3405425992117,3cyclictest3644600-21kworker/u8:4+events_unbound23:20:243
3405425992117,3cyclictest3504502-21kworker/u8:1+events_unbound22:25:223
3405425992115,4cyclictest3519745-21apt-get21:00:003
3405422992117,3cyclictest3577253-21kworker/u8:0+events_unbound22:05:162
3405422992117,3cyclictest3504502-21kworker/u8:1+flush-259:021:55:152
3405418992118,2cyclictest3577253-21kworker/u8:0+flush-259:022:30:161
3405418992118,2cyclictest3519763-21kworker/u8:2+events_unbound21:25:131
3405415992116,3cyclictest3399381-21kworker/u8:2+flush-259:019:40:240
3405415992115,4cyclictest3676312-21apt-get23:30:100
3405415992114,5cyclictest3650300-21base6423:05:000
3405415992114,4cyclictest3733341-21latency_hist00:25:010
3405425992016,2cyclictest3399381-21kworker/u8:2+events_unbound19:20:163
3405425992012,5cyclictest335557-21systemd-journal19:37:123
3405422992014,4cyclictest3472880-21latency_hist20:14:592
3405418992017,2cyclictest3655399-21kworker/u8:0+events_unbound23:30:011
3405418992016,3cyclictest357783-21kworker/u8:3+flush-259:019:20:181
3405418992015,4cyclictest3426060-21kworker/u8:1+events_unbound19:30:131
3405425991915,3cyclictest3504502-21kworker/u8:1+events_unbound22:49:133
3405425991914,3cyclictest509-21rs:main3
3405425991912,5cyclictest3593318-21diskstats22:10:133
3405418991916,2cyclictest509-21rs:main1
3405418991915,3cyclictest3504502-21kworker/u8:1+flush-259:021:30:211
3405415991915,3cyclictest3399381-21kworker/u8:2+flush-259:019:15:260
3405415991912,5cyclictest3405307-21latency_hist19:10:010
3405425991814,3cyclictest3519763-21kworker/u8:2+events_unbound21:15:233
3405425991813,3cyclictest507-21in:imuxsock21:35:003
3405422991816,1cyclictest0-21swapper/219:15:012
3405422991815,2cyclictest3644560-21cron23:00:012
3405422991815,2cyclictest0-21swapper/200:35:002
3405422991814,3cyclictest3519763-21kworker/u8:2+flush-259:021:05:002
3405422991814,3cyclictest3462628-21kworker/u8:2+flush-259:020:15:212
3405422991814,3cyclictest3451592-21kworker/u8:3+flush-259:020:20:172
3405422991812,4cyclictest509-21rs:main2
3405418991815,2cyclictest3399381-21kworker/u8:2+flush-259:019:15:201
3405418991815,2cyclictest3399381-21kworker/u8:2+events_unbound19:10:151
3405418991814,3cyclictest3451592-21kworker/u8:3+events_unbound20:10:161
3405418991813,4cyclictest3681632-21diskstats23:35:141
3405415991816,1cyclictest3629045-21sh22:45:000
3405415991814,2cyclictest0-21swapper/023:00:000
3405415991813,4cyclictest3504502-21kworker/u8:1+events_unbound22:30:000
3405415991813,3cyclictest3577253-21kworker/u8:0+flush-259:022:40:000
3405415991813,3cyclictest3399381-21kworker/u8:2+flush-259:019:50:010
3405425991713,3cyclictest3655399-21kworker/u8:0+events_unbound23:35:133
3405425991713,3cyclictest3488624-21latency_hist20:29:593
3405425991712,3cyclictest3623892-21kworker/u8:2+events_unbound22:50:243
3405425991712,3cyclictest3519763-21kworker/u8:2+events_unbound21:05:183
3405422991712,3cyclictest3655399-21kworker/u8:0+flush-259:023:35:182
3405418991712,3cyclictest3624114-21/usr/sbin/munin22:40:251
3405415991714,2cyclictest3498254-21ntp_kernel_pll_20:35:230
3405415991713,3cyclictest3702158-21apt-get23:55:140
3405415991713,3cyclictest3577253-21kworker/u8:0+flush-259:022:30:210
3405415991713,3cyclictest3451592-21kworker/u8:3+flush-259:020:21:120
3405415991710,5cyclictest335557-21systemd-journal00:15:000
3405425991613,2cyclictest3670917-21kworker/u8:1+events_unbound23:41:143
3405425991613,2cyclictest3399381-21kworker/u8:2+flush-259:019:40:213
3405425991612,3cyclictest3655399-21kworker/u8:0+events_unbound23:46:123
3405425991612,3cyclictest3504502-21kworker/u8:1+events_unbound21:40:123
3405422991614,1cyclictest3623869-21cron22:40:002
3405422991612,3cyclictest3399381-21kworker/u8:2+events_unbound19:50:282
3405422991612,2cyclictest1-21systemd23:20:002
3405422991611,3cyclictest3629310-21apt-get22:45:122
3405422991610,1cyclictest0-21swapper/220:00:002
3405418991613,2cyclictest3623892-21kworker/u8:2+events_unbound23:10:241
3405418991613,2cyclictest3623892-21kworker/u8:2+events_unbound23:10:231
3405418991612,3cyclictest3519763-21kworker/u8:2+events_unbound21:20:131
3405418991612,2cyclictest0-21swapper/100:30:001
3405418991611,4cyclictest3701884-21latency_hist23:55:011
3405418991610,4cyclictest3499118-21latency_hist20:40:001
3405415991614,1cyclictest60350irq/132-enp0s29f1:rx-021:45:240
3405415991613,2cyclictest60350irq/132-enp0s29f1:rx-023:35:250
3405415991613,2cyclictest3695813-21ntp_kernel_pll_23:45:200
3405425991513,1cyclictest3504502-21kworker/u8:1+events_unbound21:10:143
3405425991512,2cyclictest3577253-21kworker/u8:0+flush-259:022:30:113
3405425991511,3cyclictest3655399-21kworker/u8:0+events_unbound23:50:143
3405425991511,3cyclictest3519763-21kworker/u8:2+events_unbound21:21:123
3405425991511,3cyclictest3451592-21kworker/u8:3+events_unbound20:30:233
3405425991510,4cyclictest3366786-21kworker/u8:0+flush-259:019:55:253
340542299159,4cyclictest3567294-21base6421:45:002
3405422991513,1cyclictest0-21swapper/219:35:002
3405422991511,3cyclictest3519763-21kworker/u8:2+flush-259:022:00:312
3405422991511,3cyclictest3451592-21kworker/u8:3+flush-259:020:25:212
340541899158,2cyclictest3728160-21sh00:20:001
3405418991512,2cyclictest3707275-21kworker/u8:1+flush-259:000:05:181
3405418991512,2cyclictest3592822-21kworker/u8:3+flush-259:022:20:171
3405418991511,3cyclictest3504502-21kworker/u8:1+events_unbound22:35:161
3405415991513,1cyclictest60350irq/132-enp0s29f1:rx-021:55:100
3405415991513,1cyclictest60350irq/132-enp0s29f1:rx-021:21:510
3405415991513,1cyclictest60350irq/132-enp0s29f1:rx-020:30:220
3405415991513,1cyclictest60350irq/132-enp0s29f1:rx-019:55:250
3405415991513,1cyclictest60350irq/132-enp0s29f1:rx-019:20:200
3405415991512,2cyclictest60350irq/132-enp0s29f1:rx-022:50:230
3405415991512,2cyclictest60350irq/132-enp0s29f1:rx-022:48:130
3405415991512,2cyclictest60350irq/132-enp0s29f1:rx-021:35:120
3405415991512,2cyclictest60350irq/132-enp0s29f1:rx-021:15:200
3405415991512,2cyclictest60350irq/132-enp0s29f1:rx-021:10:180
3405415991512,2cyclictest60350irq/132-enp0s29f1:rx-000:01:110
340542599147,5cyclictest3717367-21awk00:10:003
3405425991411,2cyclictest3472924-21kworker/u8:1+flush-259:020:20:243
3405425991411,2cyclictest3399381-21kworker/u8:2+flush-259:019:45:233
3405425991410,3cyclictest3644600-21kworker/u8:4+events_unbound00:10:293
3405425991410,3cyclictest3366786-21kworker/u8:0+events_unbound19:54:143
340542299149,4cyclictest3488215-21kworker/u8:0+flush-259:020:55:242
3405422991411,2cyclictest3618751-21idleruntime-cro22:35:002
3405422991410,3cyclictest3366786-21kworker/u8:0+flush-259:019:40:172
3405418991411,1cyclictest0-21swapper/100:25:011
340541599148,4cyclictest335557-21systemd-journal23:15:000
340541599148,4cyclictest335557-21systemd-journal23:15:000
3405415991413,1cyclictest60350irq/132-enp0s29f1:rx-023:15:220
3405415991413,1cyclictest60350irq/132-enp0s29f1:rx-021:05:250
3405415991412,1cyclictest60350irq/132-enp0s29f1:rx-019:54:150
3405415991412,1cyclictest60350irq/132-enp0s29f1:rx-019:33:270
3405415991412,1cyclictest60350irq/132-enp0s29f1:rx-019:25:150
3405415991411,2cyclictest60350irq/132-enp0s29f1:rx-000:05:160
3405415991411,2cyclictest3666206-21fschecks_count23:20:140
3405415991411,2cyclictest3462628-21kworker/u8:2+flush-259:020:15:200
340541599140,5cyclictest3503420-21ntpq20:40:240
340542599139,2cyclictest0-21swapper/321:30:003
340542299139,3cyclictest3744633-21base6400:35:022
340542299139,3cyclictest3707275-21kworker/u8:1+flush-259:000:10:172
340542299139,3cyclictest3701874-21cron23:55:002
340542299139,3cyclictest3670917-21kworker/u8:1+flush-259:023:30:102
340542299139,3cyclictest3488994-21base6420:30:012
3405422991311,1cyclictest0-21swapper/222:45:002
3405422991310,2cyclictest3451592-21kworker/u8:3+flush-259:020:40:212
340541899139,3cyclictest3488215-21kworker/u8:0+events_unbound20:50:011
340541899137,4cyclictest3493965-21latency_hist20:35:011
3405418991311,1cyclictest3634214-21idleruntime-cro22:50:001
3405418991310,2cyclictest3744541-21gpgv00:35:011
340541599139,3cyclictest60350irq/132-enp0s29f1:rx-021:25:120
3405415991311,1cyclictest60350irq/132-enp0s29f1:rx-022:00:160
3405415991311,1cyclictest60350irq/132-enp0s29f1:rx-021:00:150
3405415991311,1cyclictest60350irq/132-enp0s29f1:rx-020:10:060
3405415991310,2cyclictest60350irq/132-enp0s29f1:rx-022:22:420
3405415991310,2cyclictest60350irq/132-enp0s29f1:rx-020:50:340
340542599126,4cyclictest3603250-21latency_hist22:20:013
340542299129,2cyclictest3675606-21unixbench_singl23:25:242
340542299129,2cyclictest3623892-21kworker/u8:2+flush-259:023:10:312
340542299129,2cyclictest3623892-21kworker/u8:2+flush-259:023:10:312
340542299129,2cyclictest3572639-21cpuspeed_turbos21:50:102
340542299129,2cyclictest3504738-21fschecks_count20:45:152
340542299129,2cyclictest3415671-21cron19:20:002
340542299127,3cyclictest335557-21systemd-journal22:26:092
340542299126,4cyclictest3691543-21cron23:45:012
340541899129,2cyclictest3644600-21kworker/u8:4+flush-259:000:35:161
340541899129,2cyclictest3608807-21cpuspeed_turbos22:25:131
340541899128,3cyclictest3707275-21kworker/u8:1+events_unbound00:00:251
340541899128,3cyclictest3577253-21kworker/u8:0+events_unbound22:15:131
340541599127,4cyclictest335557-21systemd-journal22:19:550
340542599119,1cyclictest0-21swapper/322:20:123
340542599119,1cyclictest0-21swapper/321:35:173
340542599115,5cyclictest211-21jbd2/nvme0n1p2-822:40:003
340542299117,3cyclictest401ktimers/219:45:112
340542299117,3cyclictest3504502-21kworker/u8:1+flush-259:021:30:162
340541899118,2cyclictest3691883-21cpuspeed_turbos23:45:121
340541899117,2cyclictest500-21systemd-logind21:05:001
340541599119,1cyclictest0-21swapper/019:35:130
340542299107,2cyclictest3634707-21fschecks_count22:50:142
340542299107,2cyclictest3561874-21cpuspeed_turbos21:40:142
340542299107,2cyclictest3435479-21ntp_kernel_pll_19:35:212
340542299106,3cyclictest3733998-21/usr/sbin/munin00:25:222
340541899107,2cyclictest0-21swapper/120:40:201
340541599100,3cyclictest3551862-21ps21:30:160
34054189997,1cyclictest0-21swapper/119:25:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional