You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 09:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Mon Jul 20, 2026 00:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
746612996158,2cyclictest871497-21apt-get21:10:023
746602994237,3cyclictest908441-21gpgv21:45:000
746602994237,3cyclictest751762-21kworker/u8:0+flush-259:020:15:000
746612993936,2cyclictest819463-21kworker/u8:2+flush-259:021:00:193
746602993935,3cyclictest950605-21kworker/u8:1+flush-259:023:05:000
746606993832,4cyclictest783439-21apt-get19:45:091
746608993633,2cyclictest1043550-21kworker/u8:0+flush-259:000:05:322
746602993631,3cyclictest976649-21apt-get22:50:120
746612993529,4cyclictest908774-21cp21:45:003
746608993431,2cyclictest1007407-21kworker/u8:2+events_unbound23:20:232
746608993330,2cyclictest913861-21kworker/u8:2+events_unbound22:15:242
746608993328,3cyclictest898158-21latency_hist21:35:002
746608993327,4cyclictest929051-21ntpq22:00:192
746608993327,4cyclictest335557-21systemd-journal21:11:412
746608993228,3cyclictest335557-21systemd-journal00:32:302
746608993228,3cyclictest335557-21systemd-journal00:32:292
746606993227,4cyclictest751762-21kworker/u8:0+events_unbound19:45:001
746608993128,2cyclictest783202-21kworker/u8:3+events_unbound19:45:202
746608993127,3cyclictest793485-21kworker/u8:1+events_unbound20:10:222
746608993125,4cyclictest908416-21apt-get21:45:002
746606993125,4cyclictest892607-21gpgv21:30:011
746612993025,3cyclictest746152-21kworker/u8:2+flush-259:020:00:213
746608993027,2cyclictest950605-21kworker/u8:1+events_unbound23:25:232
746608993027,2cyclictest834803-21kworker/u8:0+events_unbound20:35:222
746608993027,2cyclictest1007407-21kworker/u8:2+events_unbound23:35:202
746608993026,3cyclictest746152-21kworker/u8:2+flush-259:019:15:262
746602993024,4cyclictest1033233-21kworker/u8:1+flush-259:000:15:170
746612992925,3cyclictest1033233-21kworker/u8:1+flush-259:000:25:203
746608992926,2cyclictest834803-21kworker/u8:0+flush-259:020:45:222
746608992923,4cyclictest335557-21systemd-journal19:27:282
746606992925,3cyclictest877095-21kworker/u8:3+flush-259:021:15:221
746608992824,3cyclictest746152-21kworker/u8:2+events_unbound19:10:242
746606992825,2cyclictest1027906-21kworker/u8:3+flush-259:023:50:251
746612992723,3cyclictest736571-21kworker/u8:3+events_unbound19:12:313
746608992723,3cyclictest950605-21kworker/u8:1+events_unbound22:55:302
746608992723,3cyclictest877095-21kworker/u8:3+events_unbound21:15:192
746608992722,4cyclictest1018017-21apt-get23:30:112
746602992722,3cyclictest1-21systemd19:50:000
746602992721,5cyclictest802920-21ntpq20:00:190
746612992623,2cyclictest834803-21kworker/u8:0+events_unbound20:35:183
746612992623,2cyclictest1027906-21kworker/u8:3+flush-259:000:00:003
746612992622,3cyclictest892695-21gpgv21:30:003
746608992623,2cyclictest950605-21kworker/u8:1+flush-259:022:40:162
746608992623,2cyclictest1027906-21kworker/u8:3+flush-259:023:55:182
746606992619,5cyclictest509-21rs:main1
746606992619,5cyclictest335557-21systemd-journal21:34:591
746612992522,2cyclictest950605-21kworker/u8:1+flush-259:023:30:163
746612992520,3cyclictest804318-21diskstats20:05:193
746608992522,2cyclictest886895-21kworker/u8:1+events_unbound21:40:142
746608992522,2cyclictest886895-21kworker/u8:1+events_unbound21:30:002
746608992522,2cyclictest1048704-21kworker/u8:5+events_unbound00:38:382
746608992522,2cyclictest1048704-21kworker/u8:5+events_unbound00:38:372
746608992522,2cyclictest1033233-21kworker/u8:1+flush-259:000:25:232
746608992522,2cyclictest1027906-21kworker/u8:3+flush-259:023:40:192
746608992520,4cyclictest844793-21ntpq20:40:202
746606992520,3cyclictest1075236-21/usr/sbin/munin00:25:121
746606992518,5cyclictest913121-21ntpq21:45:211
746602992519,4cyclictest335557-21systemd-journal19:14:590
746602992519,4cyclictest335557-21systemd-journal00:35:000
746602992519,4cyclictest335557-21systemd-journal00:34:590
746612992421,2cyclictest950605-21kworker/u8:1+events_unbound23:21:293
746612992421,2cyclictest1048704-21kworker/u8:5+events_unbound00:08:243
746612992420,3cyclictest950605-21kworker/u8:1+events_unbound23:05:133
746612992420,3cyclictest1048704-21kworker/u8:5+events_unbound00:15:203
746612992419,3cyclictest877095-21kworker/u8:3+events_unbound21:15:243
746608992421,2cyclictest950605-21kworker/u8:1+flush-259:022:25:252
746608992421,2cyclictest877095-21kworker/u8:3+flush-259:022:35:192
746608992420,3cyclictest746152-21kworker/u8:2+events_unbound19:30:152
746608992419,4cyclictest751762-21kworker/u8:0+events_unbound20:15:132
746608992418,2cyclictest1033233-21kworker/u8:1+events_unbound00:10:182
746608992417,5cyclictest866307-21latency_hist21:05:012
746602992419,3cyclictest919433-21apt-get21:55:130
746602992419,3cyclictest919433-21apt-get21:55:130
746612992319,3cyclictest746152-21kworker/u8:2+events_unbound19:26:153
746612992317,4cyclictest1007384-21latency_hist23:20:013
746608992320,3cyclictest950605-21kworker/u8:1+events_unbound23:05:292
746608992320,2cyclictest866538-21kworker/u8:1+events_unbound21:05:182
746606992319,3cyclictest866538-21kworker/u8:1+events_unbound21:10:011
746606992319,2cyclictest0-21swapper/120:35:001
746606992317,5cyclictest819463-21kworker/u8:2+flush-259:020:55:171
746606992317,4cyclictest1023147-21apt-get23:35:121
746602992320,2cyclictest751762-21kworker/u8:0+flush-259:019:25:000
746602992317,4cyclictest950605-21kworker/u8:1+flush-259:023:25:010
746612992219,2cyclictest751762-21kworker/u8:0+flush-259:020:15:263
746612992218,3cyclictest746152-21kworker/u8:2+events_unbound19:55:293
746612992218,3cyclictest746152-21kworker/u8:2+events_unbound19:16:373
746612992216,4cyclictest966514-21diskstats22:40:143
746608992218,3cyclictest950605-21kworker/u8:1+flush-259:022:30:202
746608992218,3cyclictest950605-21kworker/u8:1+events_unbound23:00:132
746608992218,3cyclictest913861-21kworker/u8:2+events_unbound21:50:222
746608992218,3cyclictest819463-21kworker/u8:2+events_unbound20:30:242
746608992218,3cyclictest1007407-21kworker/u8:2+events_unbound23:45:202
746606992217,3cyclictest945668-21/usr/sbin/munin22:20:141
746612992118,2cyclictest997092-21kworker/u8:3+events_unbound23:11:553
746612992118,2cyclictest877095-21kworker/u8:3+flush-259:022:20:253
746608992118,2cyclictest746152-21kworker/u8:2+flush-259:019:50:242
746608992117,3cyclictest1048704-21kworker/u8:5+flush-259:000:00:202
746608992116,3cyclictest877095-21kworker/u8:3+events_unbound21:20:282
746608992115,4cyclictest1069822-21latency_hist00:20:002
746608992113,5cyclictest809110-21latency_hist20:10:012
746606992116,4cyclictest335557-21systemd-journal20:26:251
746606992115,4cyclictest335557-21systemd-journal21:58:281
746606992115,4cyclictest335557-21systemd-journal21:58:281
746606992115,4cyclictest1064909-21/usr/sbin/munin00:15:151
746606992114,5cyclictest335557-21systemd-journal23:49:591
746602992118,1cyclictest0-21swapper/021:10:000
746612992018,2cyclictest913861-21kworker/u8:2+events_unbound21:55:163
746612992018,2cyclictest913861-21kworker/u8:2+events_unbound21:55:163
746612992017,2cyclictest877095-21kworker/u8:3+events_unbound22:51:293
746612992017,2cyclictest834803-21kworker/u8:0+events_unbound20:50:133
746612992017,2cyclictest819463-21kworker/u8:2+events_unbound20:46:293
746612992017,2cyclictest819463-21kworker/u8:2+events_unbound20:30:143
746612992016,3cyclictest840559-21kworker/u8:3+flush-259:020:40:243
746612992016,3cyclictest1027906-21kworker/u8:3+events_unbound23:50:213
746606992016,3cyclictest886895-21kworker/u8:1+flush-259:021:40:271
746606992016,3cyclictest877095-21kworker/u8:3+flush-259:021:20:281
746606992016,3cyclictest819463-21kworker/u8:2+flush-259:020:40:001
746606992016,3cyclictest803789-21apt-get20:04:271
746606992016,3cyclictest1080425-21apt-get00:30:121
746606992016,3cyclictest1080425-21apt-get00:30:121
746602992017,2cyclictest960910-21idleruntime-cro22:35:000
746602992016,3cyclictest913861-21kworker/u8:2+flush-259:022:05:180
746602992015,4cyclictest819463-21kworker/u8:2+flush-259:020:25:000
746602992013,5cyclictest834935-21latency_hist20:35:010
746612991916,2cyclictest1027906-21kworker/u8:3+flush-259:023:45:253
746612991916,2cyclictest0-21swapper/319:45:003
746612991915,3cyclictest877095-21kworker/u8:3+events_unbound22:49:283
746612991915,3cyclictest1048704-21kworker/u8:5+events_unbound00:10:173
746612991914,3cyclictest877095-21kworker/u8:3+events_unbound22:10:173
746612991914,3cyclictest877095-21kworker/u8:3+events_unbound22:10:173
746608991916,2cyclictest793485-21kworker/u8:1+events_unbound20:29:292
746608991916,2cyclictest746152-21kworker/u8:2+flush-259:020:00:182
746608991916,2cyclictest746152-21kworker/u8:2+flush-259:019:55:262
746608991916,2cyclictest1033233-21kworker/u8:1+events_unbound00:20:182
746608991915,3cyclictest997092-21kworker/u8:3+events_unbound23:12:302
746608991915,3cyclictest877095-21kworker/u8:3+events_unbound22:50:222
746606991915,3cyclictest751762-21kworker/u8:0+flush-259:020:20:001
746606991915,2cyclictest861420-21apt-get21:00:141
746606991914,4cyclictest950605-21kworker/u8:1+flush-259:023:15:161
746606991914,3cyclictest950605-21kworker/u8:1+flush-259:022:45:301
746606991914,3cyclictest950605-21kworker/u8:1+flush-259:022:40:161
746602991916,2cyclictest793485-21kworker/u8:1+flush-259:020:00:000
746602991916,2cyclictest1043550-21kworker/u8:0+flush-259:000:05:230
746602991913,4cyclictest1089758-21ntpq00:35:220
746602991913,4cyclictest1089758-21ntpq00:35:220
746612991816,2cyclictest1033233-21kworker/u8:1+events_unbound00:22:493
746612991815,2cyclictest1033233-21kworker/u8:1+events_unbound00:32:323
746612991815,2cyclictest1033233-21kworker/u8:1+events_unbound00:32:313
746612991814,3cyclictest886895-21kworker/u8:1+flush-259:021:30:213
746612991812,4cyclictest509-21rs:main3
746608991815,2cyclictest950605-21kworker/u8:1+events_unbound23:15:202
746608991815,2cyclictest877095-21kworker/u8:3+events_unbound21:35:272
746608991815,2cyclictest834803-21kworker/u8:0+events_unbound20:52:302
746608991815,2cyclictest819463-21kworker/u8:2+events_unbound20:55:222
746608991815,2cyclictest1027906-21kworker/u8:3+events_unbound23:52:592
746608991814,3cyclictest877095-21kworker/u8:3+events_unbound22:20:202
746606991812,4cyclictest335557-21systemd-journal23:44:591
746602991816,1cyclictest0-21swapper/000:24:590
746602991815,2cyclictest819428-21idleruntime-cro20:20:000
746612991714,2cyclictest886895-21kworker/u8:1+flush-259:021:45:293
746612991713,2cyclictest1007407-21kworker/u8:2+flush-259:023:42:053
746612991712,4cyclictest335557-21systemd-journal21:25:003
746612991711,4cyclictest929964-21latency_hist22:05:003
746608991711,5cyclictest913861-21kworker/u8:2+flush-259:022:10:392
746608991711,5cyclictest913861-21kworker/u8:2+flush-259:022:10:392
746606991714,2cyclictest793485-21kworker/u8:1+events_unbound20:05:301
746602991714,2cyclictest60350irq/132-enp0s29f1:rx-022:55:200
746602991714,2cyclictest509-21rs:main0
746602991714,2cyclictest1017763-21sh23:30:000
746602991713,3cyclictest877095-21kworker/u8:3+flush-259:022:35:220
746602991713,3cyclictest819463-21kworker/u8:2+flush-259:021:00:270
746612991613,2cyclictest950605-21kworker/u8:1+events_unbound22:25:123
746612991613,2cyclictest819463-21kworker/u8:2+flush-259:020:25:253
746608991613,2cyclictest751762-21kworker/u8:0+events_unbound19:36:182
746606991613,2cyclictest961592-21irqcore22:35:161
746606991612,3cyclictest746152-21kworker/u8:2+flush-259:019:55:181
746606991610,4cyclictest751762-21kworker/u8:0+events_unbound20:15:011
746602991614,1cyclictest60350irq/132-enp0s29f1:rx-019:50:170
746602991613,2cyclictest60350irq/132-enp0s29f1:rx-023:50:150
746602991612,3cyclictest746152-21kworker/u8:2+flush-259:019:30:170
746612991512,2cyclictest783202-21kworker/u8:3+events_unbound19:52:303
746612991512,2cyclictest757576-21/usr/sbin/munin19:20:203
746608991513,1cyclictest913861-21kworker/u8:2+events_unbound22:05:282
74660699159,4cyclictest335557-21systemd-journal23:31:281
746606991512,2cyclictest913861-21kworker/u8:2+flush-259:022:05:241
746606991511,3cyclictest992157-21apt-get23:05:131
74660299158,5cyclictest835533-21cat20:35:010
746602991513,1cyclictest60350irq/132-enp0s29f1:rx-022:20:240
746602991513,1cyclictest60350irq/132-enp0s29f1:rx-020:57:480
746602991513,1cyclictest60350irq/132-enp0s29f1:rx-020:25:230
746602991512,2cyclictest60350irq/132-enp0s29f1:rx-021:50:150
746602991512,2cyclictest60350irq/132-enp0s29f1:rx-021:15:130
746602991512,2cyclictest60350irq/132-enp0s29f1:rx-020:45:100
746602991512,1cyclictest0-21swapper/019:15:000
746602991511,2cyclictest60350irq/132-enp0s29f1:rx-000:10:220
74660299151,11cyclictest855999-21/usr/sbin/munin20:55:000
746602991510,4cyclictest882515-21apt-get21:20:130
746602991510,3cyclictest971492-21/usr/sbin/munin22:45:150
74661299149,3cyclictest509-21rs:main3
746612991411,2cyclictest913861-21kworker/u8:2+flush-259:022:15:273
746612991411,2cyclictest866538-21kworker/u8:1+flush-259:021:05:163
746612991410,3cyclictest986251-21unixbench_multi22:55:263
746612991410,3cyclictest950605-21kworker/u8:1+events_unbound22:30:183
746608991411,3cyclictest913861-21kworker/u8:2+events_unbound21:59:312
746608991411,3cyclictest913861-21kworker/u8:2+events_unbound21:59:302
746608991410,3cyclictest819463-21kworker/u8:2+events_unbound20:22:302
746606991411,2cyclictest762755-21apt-get19:25:121
746606991410,3cyclictest840559-21kworker/u8:3+flush-259:020:45:001
746602991412,1cyclictest60350irq/132-enp0s29f1:rx-023:45:250
746602991412,1cyclictest60350irq/132-enp0s29f1:rx-023:35:260
746602991412,1cyclictest60350irq/132-enp0s29f1:rx-019:35:260
746602991411,2cyclictest60350irq/132-enp0s29f1:rx-023:05:260
746602991411,2cyclictest60350irq/132-enp0s29f1:rx-019:40:130
746602991410,2cyclictest60350irq/132-enp0s29f1:rx-022:25:180
74661299139,3cyclictest913861-21kworker/u8:2+events_unbound21:53:293
746612991311,2cyclictest877095-21kworker/u8:3+events_unbound22:35:133
746612991310,2cyclictest950605-21kworker/u8:1+flush-259:023:25:173
746612991310,2cyclictest856456-21fschecks_count20:55:153
746612991310,2cyclictest746152-21kworker/u8:2+flush-259:019:35:263
746608991311,1cyclictest877095-21kworker/u8:3+events_unbound22:49:202
74660699139,2cyclictest746152-21kworker/u8:2+events_unbound19:55:001
74660699137,4cyclictest752330-21cat19:15:011
746606991311,1cyclictest0-21swapper/121:55:001
74660699131,10cyclictest991896-21awk23:05:001
746606991310,2cyclictest1049015-21cpuspeed_turbos00:00:151
746606991310,2cyclictest1015366-21kthreadcore23:25:191
74660299139,3cyclictest335557-21systemd-journal22:00:280
746602991311,2cyclictest60350irq/132-enp0s29f1:rx-023:10:510
746602991311,1cyclictest60350irq/132-enp0s29f1:rx-022:40:130
746602991311,1cyclictest60350irq/132-enp0s29f1:rx-021:45:510
746602991311,1cyclictest60350irq/132-enp0s29f1:rx-021:35:220
746602991311,1cyclictest60350irq/132-enp0s29f1:rx-000:25:230
746602991310,2cyclictest60350irq/132-enp0s29f1:rx-023:33:350
74661299129,2cyclictest793485-21kworker/u8:1+flush-259:020:10:203
74661299129,2cyclictest0-21swapper/300:00:203
74660899129,2cyclictest751762-21kworker/u8:0+events_unbound19:24:562
74660699129,1cyclictest746152-21kworker/u8:2-writeback19:35:191
74660699128,2cyclictest953638-21kthreadcore22:25:181
74660699127,4cyclictest335557-21systemd-journal22:16:591
74660299129,2cyclictest60350irq/132-enp0s29f1:rx-022:19:160
74660299129,2cyclictest60350irq/132-enp0s29f1:rx-000:00:040
746602991211,1cyclictest60350irq/132-enp0s29f1:rx-023:40:230
74661299119,1cyclictest0-21swapper/300:35:173
74661299119,1cyclictest0-21swapper/300:35:163
74661299118,2cyclictest913861-21kworker/u8:2+events_unbound22:05:203
74661299118,2cyclictest783202-21kworker/u8:3+events_unbound19:46:193
74661299116,3cyclictest772833-21cron19:35:003
74660699118,2cyclictest982023-21fschecks_count22:55:141
74660699115,4cyclictest1055213-21sed00:05:251
74660699111,8cyclictest762499-21awk19:25:001
74660299118,2cyclictest60350irq/132-enp0s29f1:rx-023:16:400
74661299106,3cyclictest819463-21kworker/u8:2+events_unbound20:20:233
7466129997,1cyclictest0-21swapper/323:00:153
7466069991,2cyclictest1090607-21idleruntime-cro00:40:001
7466069991,2cyclictest1090607-21idleruntime-cro00:39:591
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional