You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-25 - 10:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Sat Jul 25, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4155967995147,3cyclictest4123729-21kworker/u8:0+flush-259:019:15:003
4155964994845,2cyclictest13832-21kworker/u8:1+events_unbound20:11:452
4155962994538,4cyclictest4108008-21kworker/u8:3+flush-259:019:40:141
4155957994540,3cyclictest4108008-21kworker/u8:3+flush-259:020:15:250
4155964994440,3cyclictest249041-21kworker/u8:4+events_unbound00:05:292
4155962994437,4cyclictest259184-21latency_hist23:55:001
4155957994339,3cyclictest159677-21kworker/u8:4+events_unbound22:40:240
4155964994239,2cyclictest232808-21kworker/u8:3+events_unbound00:03:302
4155964994238,3cyclictest70399-21kworker/u8:1+events_unbound21:30:292
4155957994134,5cyclictest43921-21ntpq20:25:190
4155964994037,2cyclictest4108008-21kworker/u8:3+events_unbound21:29:282
4155957994037,2cyclictest269777-21kworker/u8:1+flush-259:000:30:100
4155967993933,4cyclictest335557-21systemd-journal19:40:013
4155964993936,2cyclictest13832-21kworker/u8:1+events_unbound20:05:142
4155964993936,2cyclictest133761-21kworker/u8:1+events_unbound22:00:142
4155957993936,2cyclictest4108008-21kworker/u8:3+flush-259:020:50:250
4155957993936,2cyclictest4108008-21kworker/u8:3+events_unbound21:10:230
4155964993835,2cyclictest97069-21kworker/u8:2+events_unbound22:44:312
4155964993835,2cyclictest269777-21kworker/u8:1+events_unbound00:32:552
4155964993835,2cyclictest159677-21kworker/u8:4+events_unbound22:39:302
4155964993834,3cyclictest269777-21kworker/u8:1+events_unbound00:12:282
4155964993735,2cyclictest4171688-21kworker/u8:4+events_unbound19:57:292
4155964993734,2cyclictest4108008-21kworker/u8:3+events_unbound20:27:302
4155964993734,2cyclictest249041-21kworker/u8:4+events_unbound23:52:212
4155964993734,2cyclictest232808-21kworker/u8:3+events_unbound23:49:292
4155964993734,2cyclictest201770-21kworker/u8:1+events_unbound23:02:282
4155964993734,2cyclictest196461-21kworker/u8:2+events_unbound23:05:232
4155957993734,2cyclictest264391-21kworker/u8:0+events_unbound00:15:020
4155957993734,2cyclictest264391-21kworker/u8:0+events_unbound00:15:020
4155964993633,2cyclictest97069-21kworker/u8:2+events_unbound22:07:032
4155964993633,2cyclictest97069-21kworker/u8:2+events_unbound22:07:022
4155964993633,2cyclictest97069-21kworker/u8:2+events_unbound21:55:222
4155964993533,2cyclictest50357-21kworker/u8:0+events_unbound21:00:242
4155964993532,2cyclictest4108008-21kworker/u8:3+events_unbound21:40:132
4155964993531,3cyclictest175156-21kworker/u8:0+events_unbound22:57:292
4155962993529,4cyclictest4166514-21/usr/sbin/munin19:20:121
4155957993532,2cyclictest4171688-21kworker/u8:4+events_unbound19:25:210
4155964993432,2cyclictest4171688-21kworker/u8:4+events_unbound19:25:152
4155964993432,2cyclictest264391-21kworker/u8:0+events_unbound00:15:222
4155964993432,2cyclictest264391-21kworker/u8:0+events_unbound00:15:212
4155964993431,2cyclictest4171688-21kworker/u8:4+events_unbound19:45:202
4155964993431,2cyclictest4108008-21kworker/u8:3+events_unbound21:17:282
4155964993431,2cyclictest4108008-21kworker/u8:3+events_unbound20:20:212
4155964993431,2cyclictest4108008-21kworker/u8:3+events_unbound19:32:292
4155962993429,3cyclictest196461-21kworker/u8:2+flush-259:023:30:181
4155957993430,3cyclictest4108008-21kworker/u8:3+flush-259:020:35:190
4155957993429,3cyclictest159677-21kworker/u8:4+flush-259:022:30:160
4155967993328,4cyclictest4108008-21kworker/u8:3+flush-259:019:45:003
4155967993328,3cyclictest285051-21latency_hist00:20:013
4155967993328,3cyclictest285051-21latency_hist00:20:013
4155964993330,2cyclictest4108008-21kworker/u8:3+events_unbound20:35:142
4155964993330,2cyclictest175156-21kworker/u8:0+events_unbound22:45:282
4155957993330,2cyclictest50357-21kworker/u8:0+events_unbound20:55:240
4155957993330,2cyclictest4108008-21kworker/u8:3+flush-259:021:20:210
4155957993325,6cyclictest61085-21diskstats20:45:120
4155964993229,2cyclictest4108008-21kworker/u8:3+events_unbound20:17:282
4155964993227,2cyclictest4108008-21kworker/u8:3+events_unbound20:45:212
4155962993228,3cyclictest107823-21apt-get21:30:131
4155957993229,2cyclictest97069-21kworker/u8:2+events_unbound21:50:180
4155957993227,4cyclictest107554-21latency_hist21:30:000
4155957993225,5cyclictest138107-21ntpq21:55:220
4155964993129,2cyclictest4108008-21kworker/u8:3+events_unbound20:30:222
4155964993129,2cyclictest159677-21kworker/u8:4+events_unbound22:30:132
4155964993128,2cyclictest4097006-21kworker/u8:2+events_unbound19:23:282
4155964993128,2cyclictest175156-21kworker/u8:0+events_unbound23:19:292
4155964993127,3cyclictest70399-21kworker/u8:1+flush-259:021:25:002
4155957993128,2cyclictest201770-21kworker/u8:1+events_unbound23:15:150
4155957993127,3cyclictest4108008-21kworker/u8:3+events_unbound21:00:170
4155967993026,3cyclictest335557-21systemd-journal00:24:263
4155964993027,2cyclictest97069-21kworker/u8:2+events_unbound22:28:292
4155962993027,2cyclictest201770-21kworker/u8:1+flush-259:023:20:211
4155962993026,3cyclictest13832-21kworker/u8:1+flush-259:020:20:181
4155957993027,2cyclictest4108008-21kworker/u8:3+events_unbound19:36:290
4155957993027,2cyclictest232808-21kworker/u8:3+flush-259:023:55:210
4155957993027,2cyclictest175156-21kworker/u8:0+events_unbound23:35:180
4155957993027,2cyclictest133761-21kworker/u8:1+flush-259:022:15:170
4155957993026,3cyclictest97069-21kworker/u8:2+flush-259:021:45:150
4155957993026,3cyclictest249041-21kworker/u8:4+events_unbound23:52:180
4155957993026,3cyclictest24392-21kworker/u8:0+events_unbound20:10:170
4155957993026,3cyclictest133761-21kworker/u8:1+events_unbound22:10:200
4155967992923,4cyclictest335557-21systemd-journal21:16:273
4155964992927,2cyclictest4108008-21kworker/u8:3+events_unbound19:54:272
4155964992927,2cyclictest201770-21kworker/u8:1+events_unbound23:25:252
4155962992920,6cyclictest71019-21latency_hist20:55:021
4155957992925,3cyclictest285285-21kworker/u8:3+events_unbound00:25:170
4155967992824,3cyclictest4123729-21kworker/u8:0+flush-259:019:50:003
4155967992823,4cyclictest4171723-21apt-get19:25:123
4155964992826,2cyclictest4097006-21kworker/u8:2+events_unbound19:15:002
4155964992826,2cyclictest285285-21kworker/u8:3+events_unbound00:25:142
4155962992823,3cyclictest4161386-21apt-get19:15:111
4155957992824,3cyclictest201770-21kworker/u8:1+flush-259:023:05:300
4155957992824,3cyclictest159677-21kworker/u8:4+events_unbound22:25:230
4155967992723,3cyclictest269813-21apt-get00:05:133
4155967992721,4cyclictest335557-21systemd-journal21:45:003
4155964992720,5cyclictest14046-21/usr/sbin/munin20:00:152
4155962992723,3cyclictest4108008-21kworker/u8:3+flush-259:021:40:231
4155962992722,3cyclictest24426-21apt-get20:10:121
4155957992723,3cyclictest13832-21kworker/u8:1+events_unbound20:04:280
4155964992623,2cyclictest175156-21kworker/u8:0+events_unbound22:52:282
4155962992621,3cyclictest285285-21kworker/u8:3+flush-259:000:25:001
4155957992623,2cyclictest97069-21kworker/u8:2+events_unbound21:35:230
4155957992623,2cyclictest175156-21kworker/u8:0+events_unbound22:55:150
4155957992623,2cyclictest175156-21kworker/u8:0+events_unbound22:45:170
4155957992622,3cyclictest50357-21kworker/u8:0+events_unbound20:40:170
4155967992522,2cyclictest159677-21kworker/u8:4+events_unbound22:30:183
4155964992522,2cyclictest4108008-21kworker/u8:3+events_unbound19:40:242
4155962992521,3cyclictest13832-21kworker/u8:1+flush-259:020:05:201
4155962992519,4cyclictest97069-21kworker/u8:2+events_unbound21:50:011
4155957992522,2cyclictest4171688-21kworker/u8:4+flush-259:019:45:240
4155957992522,2cyclictest4123729-21kworker/u8:0+events_unbound19:50:230
4155957992522,2cyclictest4108008-21kworker/u8:3+flush-259:020:30:190
4155957992522,2cyclictest232808-21kworker/u8:3+flush-259:023:45:250
4155957992521,3cyclictest96864-21gpgv21:20:000
4155957992521,3cyclictest269777-21kworker/u8:1+flush-259:000:10:170
4155967992420,3cyclictest102679-21apt-get21:25:133
4155964992421,3cyclictest232808-21kworker/u8:3+events_unbound23:37:302
4155964992421,2cyclictest4108008-21kworker/u8:3+events_unbound21:35:142
4155962992418,4cyclictest159677-21kworker/u8:4+flush-259:022:50:001
4155962992417,5cyclictest509-21rs:main1
4155957992421,2cyclictest4123729-21kworker/u8:0+events_unbound19:30:220
4155957992421,2cyclictest13832-21kworker/u8:1+events_unbound20:05:200
4155957992420,3cyclictest4171688-21kworker/u8:4+events_unbound19:55:140
4155957992420,3cyclictest249041-21kworker/u8:4+events_unbound00:05:250
4155967992316,5cyclictest186017-21cat22:45:013
4155964992321,2cyclictest4108008-21kworker/u8:3+events_unbound19:35:202
4155964992320,2cyclictest97069-21kworker/u8:2+events_unbound21:45:282
4155964992319,3cyclictest50357-21kworker/u8:0+events_unbound20:55:162
4155962992317,4cyclictest4182098-21apt-get19:35:121
4155962992317,4cyclictest128874-21/usr/sbin/munin21:50:231
4155957992319,3cyclictest264391-21kworker/u8:0+events_unbound00:02:560
4155967992218,3cyclictest335557-21systemd-journal19:25:013
4155964992219,2cyclictest4108008-21kworker/u8:3+flush-259:021:05:272
4155964992219,2cyclictest269777-21kworker/u8:1+events_unbound00:20:282
4155964992219,2cyclictest249041-21kworker/u8:4+events_unbound23:59:302
4155962992218,3cyclictest285285-21kworker/u8:3+flush-259:000:33:431
4155962992218,3cyclictest201770-21kworker/u8:1+flush-259:023:05:171
4155957992217,3cyclictest335557-21systemd-journal21:42:270
4155964992118,2cyclictest264391-21kworker/u8:0+events_unbound00:38:492
4155964992118,2cyclictest133761-21kworker/u8:1+events_unbound22:15:272
4155964992116,3cyclictest201770-21kworker/u8:1+flush-259:023:15:002
4155964992116,2cyclictest175156-21kworker/u8:0+events_unbound23:33:302
4155962992117,3cyclictest97069-21kworker/u8:2+flush-259:022:20:161
4155962992117,3cyclictest4192473-21apt-get19:45:111
4155962992117,3cyclictest133761-21kworker/u8:1+flush-259:022:10:211
4155962992116,4cyclictest507-21in:imuxsock22:35:001
4155962992116,3cyclictest232808-21kworker/u8:3+flush-259:000:00:181
4155957992118,2cyclictest196461-21kworker/u8:2+events_unbound23:04:300
4155957992117,3cyclictest196461-21kworker/u8:2+flush-259:023:40:150
415596799206,10cyclictest0-21swapper/300:31:463
4155967992016,2cyclictest0-21swapper/322:04:593
4155967992015,3cyclictest175156-21kworker/u8:0+flush-259:023:00:013
4155967992014,4cyclictest335557-21systemd-journal20:51:503
415596799200,17cyclictest4166277-21latency_hist19:20:003
4155964992018,2cyclictest4108008-21kworker/u8:3+events_unbound21:10:212
4155964992017,2cyclictest70399-21kworker/u8:1+events_unbound20:51:282
4155964992016,3cyclictest4108008-21kworker/u8:3+flush-259:019:10:212
4155962992014,4cyclictest3717-21apt-get19:50:111
4155957992017,2cyclictest4097006-21kworker/u8:2+events_unbound19:21:210
4155957992017,2cyclictest285285-21kworker/u8:3+events_unbound00:25:000
4155957992017,2cyclictest185885-21kworker/u8:1+events_unbound22:50:230
4155967991916,2cyclictest4108008-21kworker/u8:3+flush-259:021:05:163
4155967991915,2cyclictest0-21swapper/322:40:003
4155967991914,3cyclictest335557-21systemd-journal22:30:013
4155967991914,3cyclictest275008-21apt-get00:10:113
4155967991914,3cyclictest14072-21apt-get20:00:123
4155967991912,4cyclictest91642-21latency_hist21:15:023
4155967991910,8cyclictest265655-21kthreadcore00:00:193
4155964991917,2cyclictest4108008-21kworker/u8:3+events_unbound21:50:272
4155964991916,2cyclictest196461-21kworker/u8:2+events_unbound23:44:282
4155964991916,2cyclictest133761-21kworker/u8:1+events_unbound22:11:292
4155964991914,2cyclictest97069-21kworker/u8:2+events_unbound22:20:282
4155962991915,3cyclictest0-21swapper/121:19:591
4155957991914,4cyclictest4108008-21kworker/u8:3+events_unbound21:32:310
4155967991814,2cyclictest0-21swapper/323:05:003
415596799181,2cyclictest507-21in:imuxsock23:20:003
415596799181,10cyclictest155689-21irqstats22:15:173
415596799180,9cyclictest39888-21/usr/sbin/munin20:25:153
4155962991814,3cyclictest232808-21kworker/u8:3+flush-259:023:39:591
4155957991815,2cyclictest4108008-21kworker/u8:3+flush-259:019:40:170
4155957991815,2cyclictest4097006-21kworker/u8:2+events_unbound19:15:230
4155957991815,2cyclictest133761-21kworker/u8:1+flush-259:022:05:210
4155957991815,2cyclictest133761-21kworker/u8:1+flush-259:022:05:200
415596799174,12cyclictest303381-21cut00:35:203
4155967991715,1cyclictest0-21swapper/322:55:003
4155967991713,2cyclictest0-21swapper/321:59:593
415596799170,6cyclictest29606-21apt-get20:15:133
4155962991713,3cyclictest4108008-21kworker/u8:3+flush-259:020:30:451
415596299171,13cyclictest1-21systemd22:30:011
4155962991710,5cyclictest254006-21latency_hist23:50:011
4155957991714,2cyclictest196461-21kworker/u8:2+events_unbound23:22:180
4155957991713,3cyclictest4108008-21kworker/u8:3+events_unbound21:05:250
415596799163,11cyclictest210944-21cut23:05:193
415596799161,2cyclictest128629-21sh21:49:593
415596799161,2cyclictest116988-21ntpq21:35:203
4155967991612,3cyclictest232808-21kworker/u8:3+flush-259:023:40:193
415596799161,14cyclictest81309-21cron21:05:003
4155967991611,3cyclictest335557-21systemd-journal23:38:293
415596799161,13cyclictest335557-21systemd-journal19:35:003
415596799161,13cyclictest264383-21basename23:59:593
415596799161,13cyclictest254010-21sh23:50:003
415596799161,13cyclictest217249-21awk23:15:013
415596799161,11cyclictest129066-21/usr/sbin/munin21:50:153
415596799160,6cyclictest153622-21ntpq22:10:213
415596799160,5cyclictest233029-21/usr/sbin/munin23:30:253
415596799160,4cyclictest187062-21irqcore22:45:163
415596799160,14cyclictest29330-21cron20:15:003
415596799160,14cyclictest102425-21munin-run21:25:003
4155962991613,2cyclictest201742-21sh23:00:001
4155962991612,3cyclictest185931-21apt-key22:45:011
4155962991610,4cyclictest243746-21cat23:40:011
4155957991613,2cyclictest97069-21kworker/u8:2+events_unbound22:37:290
4155957991613,2cyclictest4108008-21kworker/u8:3+events_unbound19:10:220
4155957991613,2cyclictest13832-21kworker/u8:1+events_unbound20:20:110
4155957991612,3cyclictest97069-21kworker/u8:2+events_unbound22:20:270
415596799154,9cyclictest226723-21ntpq23:20:203
415596799152,11cyclictest0-21swapper/320:35:013
415596799151,12cyclictest160029-21grep22:20:133
415596799151,11cyclictest50689-21cpuspeed_turbos20:35:133
415596799151,11cyclictest34477-21latency_hist20:20:003
415596799150,5cyclictest9086-21grep19:55:143
415596799150,4cyclictest290706-21grep00:25:153
415596799150,4cyclictest228570-21cut23:25:163
415596799150,1cyclictest4891-21grep19:50:163
415596799150,13cyclictest24151-21idleruntime-cro20:10:003
415596799150,13cyclictest148877-21grep22:05:253
415596799150,13cyclictest148877-21grep22:05:243
415596499153,5cyclictest191rcu_preempt23:25:012
415596299159,4cyclictest44990-21cp20:30:011
415596299159,4cyclictest335557-21systemd-journal21:04:271
415596299158,5cyclictest29581-21/usr/sbin/munin20:15:151
4155962991512,2cyclictest4108008-21kworker/u8:3+flush-259:021:35:171
4155962991512,2cyclictest0-21swapper/122:05:011
4155962991512,2cyclictest0-21swapper/120:50:001
4155962991512,2cyclictest0-21swapper/119:30:001
4155962991511,3cyclictest285285-21kworker/u8:3+flush-259:000:25:211
4155962991510,3cyclictest180292-21cron22:40:011
4155957991513,1cyclictest60350irq/132-enp0s29f1:rx-000:35:210
415596799141,11cyclictest0-21swapper/320:45:153
415596799140,4cyclictest72199-21irqcore20:55:183
415596799140,4cyclictest55967-21fschecks_count20:40:133
415596799140,4cyclictest109027-21grep21:30:183
415596499146,1cyclictest191rcu_preempt20:40:222
415596499140,3cyclictest4155966-21date19:10:012
415596299149,4cyclictest4108008-21kworker/u8:3+flush-259:021:10:291
415596299149,4cyclictest212365-21apt-get23:10:101
415596299148,4cyclictest81582-21apt-get21:05:111
415596299147,5cyclictest335557-21systemd-journal22:10:001
415596299147,5cyclictest335557-21systemd-journal22:10:001
4155962991410,3cyclictest135092-21kthreadcore21:55:171
4155957991412,1cyclictest60350irq/132-enp0s29f1:rx-023:27:550
415596799130,12cyclictest254374-21cut23:50:123
415596299139,2cyclictest0-21swapper/122:50:221
415596299139,2cyclictest0-21swapper/120:40:001
4155962991311,1cyclictest259871-21irqcore23:55:171
4155957991311,1cyclictest60350irq/132-enp0s29f1:rx-023:10:160
415596299129,2cyclictest4176964-21cpuspeed_turbos19:30:141
415596299129,2cyclictest217940-21irqcore23:15:161
415596299128,3cyclictest4108008-21kworker/u8:3+flush-259:021:25:251
415596299126,3cyclictest4171688-21kworker/u8:4+flush-259:019:55:161
415595799129,2cyclictest60350irq/132-enp0s29f1:rx-022:00:120
415595799128,3cyclictest233054-21apt-get23:30:140
415596299119,1cyclictest0-21swapper/100:40:001
415596299117,2cyclictest18982-21awk20:05:001
415596299114,5cyclictest1-21systemd23:30:001
415596299108,1cyclictest0-21swapper/122:15:121
41559629996,1cyclictest0-21swapper/100:15:121
41559629996,1cyclictest0-21swapper/100:15:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional