You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-08 - 13:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Wed Jul 08, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4188567995245,5cyclictest274971-21latency_hist23:40:001
4188565994942,4cyclictest217918-21latency_hist22:45:000
4188565994744,2cyclictest212777-21kworker/u8:3+flush-259:022:55:230
4188565994743,3cyclictest4140648-21kworker/u8:2+events_unbound19:10:010
4188565994741,4cyclictest139881-21cat21:30:010
4188567994642,3cyclictest212777-21kworker/u8:3+flush-259:022:50:261
4188565994642,3cyclictest307055-21kworker/u8:1+events_unbound00:15:000
4188567994337,4cyclictest150528-21latency_hist21:40:001
4188565994340,2cyclictest82596-21kworker/u8:4+flush-259:021:10:250
4188579994236,4cyclictest335557-21systemd-journal23:50:003
4188574994137,3cyclictest109081-21kworker/u8:1+flush-259:021:05:002
4188574994036,3cyclictest66391-21kworker/u8:3+flush-259:020:35:002
4188574994034,4cyclictest181872-21latency_hist22:10:002
4188567993935,3cyclictest2150176-21kworker/u8:1+events_unbound20:10:191
4188565993932,5cyclictest150633-21cp21:40:000
4188574993632,3cyclictest156130-21kworker/u8:1+events_unbound22:10:252
4188567993632,3cyclictest280179-21kworker/u8:0+flush-259:000:05:001
4188565993630,4cyclictest66641-21apt-get20:20:020
4188565993532,2cyclictest326996-21kworker/u8:0+events_unbound00:25:250
4188565993532,2cyclictest150393-21kworker/u8:2+flush-259:021:40:200
4188574993328,4cyclictest335557-21systemd-journal21:30:202
4188574993328,3cyclictest335557-21systemd-journal21:10:012
4188567993329,3cyclictest72504-21kworker/u8:0+events_unbound20:53:201
4188567993329,3cyclictest270044-21kworker/u8:3+events_unbound23:45:141
4188574993227,3cyclictest82596-21kworker/u8:4+flush-259:021:50:002
4188567993229,2cyclictest156130-21kworker/u8:1+flush-259:022:05:201
4188567993228,3cyclictest307055-21kworker/u8:1+flush-259:000:15:001
4188567993228,3cyclictest2150176-21kworker/u8:1+flush-259:019:25:191
4188565993228,3cyclictest82596-21kworker/u8:4+events_unbound21:05:200
4188565993227,4cyclictest176976-21apt-get22:05:100
4188565993227,3cyclictest2150176-21kworker/u8:1+events_unbound19:55:000
4188579993125,4cyclictest66391-21kworker/u8:3+flush-259:020:20:003
4188574993126,4cyclictest269494-21cp23:35:012
4188565993128,2cyclictest72504-21kworker/u8:0+events_unbound20:45:230
4188565993124,5cyclictest19405-21ntpq19:30:210
4188574993027,2cyclictest270044-21kworker/u8:3+flush-259:023:35:212
4188574993027,2cyclictest25473-21kworker/u8:0+flush-259:019:45:262
4188574993024,4cyclictest51156-21latency_hist20:05:012
4188574993024,4cyclictest51156-21latency_hist20:05:002
4188567993027,2cyclictest223075-21kworker/u8:0+events_unbound23:10:171
4188567993026,3cyclictest15173-21kworker/u8:2+flush-259:020:35:201
4188567992925,3cyclictest191858-21kworker/u8:0+flush-259:022:21:261
4188565992925,3cyclictest270045-21kworker/u8:4+events_unbound23:49:220
4188565992925,2cyclictest2150176-21kworker/u8:1+events_unbound19:35:190
4188574992825,2cyclictest150393-21kworker/u8:2+flush-259:022:00:202
4188574992824,3cyclictest285425-21kworker/u8:5+events_unbound00:33:272
4188567992824,3cyclictest150393-21kworker/u8:2+flush-259:021:55:251
4188565992825,2cyclictest156130-21kworker/u8:1+flush-259:021:45:240
4188579992722,3cyclictest335557-21systemd-journal23:23:333
4188574992724,2cyclictest156130-21kworker/u8:1+events_unbound22:20:232
4188574992723,3cyclictest72504-21kworker/u8:0+events_unbound20:45:122
4188574992722,4cyclictest253958-21latency_hist23:20:002
4188567992724,2cyclictest150393-21kworker/u8:2+events_unbound22:56:201
4188567992723,3cyclictest15173-21kworker/u8:2+events_unbound20:48:201
4188565992723,3cyclictest25473-21kworker/u8:0+events_unbound19:45:440
4188565992723,3cyclictest223075-21kworker/u8:0+events_unbound23:15:200
4188565992723,3cyclictest156130-21kworker/u8:1+events_unbound22:10:120
4188579992620,4cyclictest335557-21systemd-journal19:40:013
4188574992623,2cyclictest156130-21kworker/u8:1+flush-259:021:50:242
4188574992623,2cyclictest15173-21kworker/u8:2+flush-259:020:35:212
4188574992623,2cyclictest150393-21kworker/u8:2+events_unbound22:58:242
4188574992622,3cyclictest2150176-21kworker/u8:1+events_unbound19:54:202
4188567992623,2cyclictest4193654-21kworker/u8:0+events_unbound19:20:141
4188567992623,2cyclictest4178291-21kworker/u8:3+events_unbound19:36:191
4188567992622,3cyclictest82596-21kworker/u8:4+flush-259:020:55:161
4188567992622,3cyclictest270045-21kworker/u8:4+events_unbound00:20:351
4188567992620,4cyclictest328067-21latency_hist00:30:011
4188565992623,2cyclictest2150176-21kworker/u8:1+events_unbound19:25:000
4188565992622,3cyclictest2150176-21kworker/u8:1+flush-259:020:25:150
4188565992621,3cyclictest143832-21apt-get21:30:190
418856599260,21cyclictest269417-21true23:35:010
4188574992522,2cyclictest4178291-21kworker/u8:3+events_unbound19:26:192
4188574992521,3cyclictest4178291-21kworker/u8:3+flush-259:019:10:172
4188574992520,4cyclictest263308-21ntpq23:25:202
4188567992521,3cyclictest270044-21kworker/u8:3+events_unbound23:40:141
4188567992519,4cyclictest238489-21latency_hist23:05:011
4188565992522,2cyclictest270045-21kworker/u8:4+events_unbound23:55:130
4188565992521,3cyclictest82596-21kworker/u8:4+events_unbound20:56:190
4188579992419,3cyclictest25473-21kworker/u8:0+flush-259:019:40:173
4188574992421,2cyclictest2150176-21kworker/u8:1+events_unbound19:17:202
4188574992420,3cyclictest295802-21latency_hist23:59:592
4188574992420,3cyclictest223075-21kworker/u8:0+events_unbound23:11:342
4188574992420,3cyclictest119172-21kworker/u8:0+events_unbound21:21:192
4188574992419,3cyclictest156130-21kworker/u8:1+flush-259:022:35:002
4188567992421,2cyclictest82596-21kworker/u8:4+flush-259:021:00:201
4188567992421,2cyclictest134615-21kworker/u8:2+events_unbound21:25:231
4188565992421,2cyclictest2150176-21kworker/u8:1+events_unbound20:00:450
4188565992421,2cyclictest2150176-21kworker/u8:1+events_unbound20:00:450
4188565992421,2cyclictest212777-21kworker/u8:3+events_unbound22:53:260
4188565992420,3cyclictest15173-21kworker/u8:2+flush-259:020:30:200
4188565992420,3cyclictest150393-21kworker/u8:2+events_unbound23:20:220
4188565992419,4cyclictest306133-21ntpq00:05:210
4188565992418,4cyclictest223051-21latency_hist22:50:010
4188579992317,4cyclictest156114-21latency_hist21:45:003
4188574992320,3cyclictest82596-21kworker/u8:4+events_unbound21:16:222
4188574992320,2cyclictest150393-21kworker/u8:2+events_unbound23:00:222
4188574992319,3cyclictest326996-21kworker/u8:0+events_unbound00:35:332
4188567992320,2cyclictest51173-21kworker/u8:0+flush-259:020:15:251
4188567992320,2cyclictest312836-21kworker/u8:2+events_unbound00:18:341
4188567992320,2cyclictest2150176-21kworker/u8:1+events_unbound19:10:131
4188567992320,2cyclictest212777-21kworker/u8:3+events_unbound22:43:251
4188567992320,2cyclictest150393-21kworker/u8:2+events_unbound22:04:261
4188567992319,3cyclictest15173-21kworker/u8:2+events_unbound20:05:181
4188565992320,2cyclictest270045-21kworker/u8:4+events_unbound00:20:190
4188565992320,2cyclictest191858-21kworker/u8:0+events_unbound22:30:000
4188565992319,3cyclictest150393-21kworker/u8:2+events_unbound22:00:280
4188579992217,4cyclictest82596-21kworker/u8:4+flush-259:020:40:283
4188579992216,4cyclictest335557-21systemd-journal21:50:003
4188574992219,2cyclictest4178291-21kworker/u8:3+events_unbound19:35:212
4188574992219,2cyclictest312836-21kworker/u8:2+flush-259:000:15:242
4188574992219,2cyclictest2150176-21kworker/u8:1+events_unbound20:14:192
4188574992218,3cyclictest2150176-21kworker/u8:1+events_unbound20:20:142
4188574992218,3cyclictest15173-21kworker/u8:2+events_unbound19:30:162
4188567992219,2cyclictest156130-21kworker/u8:1+events_unbound22:25:141
4188565992218,3cyclictest15173-21kworker/u8:2+events_unbound19:55:230
4188574992118,2cyclictest270044-21kworker/u8:3+flush-259:023:49:482
4188574992118,2cyclictest212777-21kworker/u8:3+events_unbound22:45:252
4188567992118,2cyclictest82596-21kworker/u8:4+events_unbound20:40:241
4188567992118,2cyclictest326996-21kworker/u8:0+flush-259:000:35:161
4188567992118,2cyclictest285425-21kworker/u8:5+events_unbound00:05:231
4188565992119,1cyclictest0-21swapper/000:05:000
4188565992117,3cyclictest2150176-21kworker/u8:1+events_unbound19:13:200
4188565992117,3cyclictest15173-21kworker/u8:2+events_unbound20:15:200
4188579992015,3cyclictest335557-21systemd-journal00:02:343
4188579992015,3cyclictest2150176-21kworker/u8:1+flush-259:019:50:173
4188579992015,3cyclictest114274-21apt-get21:05:113
4188574992017,2cyclictest72504-21kworker/u8:0+events_unbound20:40:142
4188574992017,1cyclictest0-21swapper/221:29:592
4188574992016,3cyclictest301946-21base6400:05:002
4188567992017,2cyclictest270045-21kworker/u8:4+events_unbound23:50:261
4188567992017,2cyclictest25473-21kworker/u8:0+events_unbound19:40:191
4188567992017,2cyclictest2150176-21kworker/u8:1+flush-259:019:15:271
4188567992017,2cyclictest2150176-21kworker/u8:1+events_unbound20:25:111
4188567992017,2cyclictest191858-21kworker/u8:0+flush-259:022:30:241
4188567992017,2cyclictest156130-21kworker/u8:1+events_unbound22:11:101
4188567992017,2cyclictest119172-21kworker/u8:0+events_unbound21:20:291
4188567992016,3cyclictest66391-21kworker/u8:3+events_unbound20:22:201
4188565992017,2cyclictest82596-21kworker/u8:4+events_unbound21:00:220
4188565992016,3cyclictest25473-21kworker/u8:0+events_unbound19:40:230
4188579991915,3cyclictest2150176-21kworker/u8:1+flush-259:020:20:253
4188579991915,3cyclictest156130-21kworker/u8:1+flush-259:022:10:193
4188579991912,5cyclictest109038-21cat21:00:033
4188574991917,1cyclictest82596-21kworker/u8:4+flush-259:021:40:242
4188574991916,2cyclictest270044-21kworker/u8:3+flush-259:023:40:232
4188567991916,2cyclictest150393-21kworker/u8:2+flush-259:021:45:001
4188565991917,2cyclictest270045-21kworker/u8:4+events_unbound23:50:280
4188565991916,2cyclictest223075-21kworker/u8:0+events_unbound23:10:130
4188579991816,1cyclictest0-21swapper/320:55:013
4188579991814,3cyclictest15173-21kworker/u8:2+flush-259:020:40:003
4188574991815,2cyclictest82596-21kworker/u8:4+flush-259:021:35:192
4188574991815,2cyclictest270044-21kworker/u8:3+events_unbound23:50:252
4188574991815,2cyclictest150393-21kworker/u8:2+flush-259:022:40:212
4188574991814,3cyclictest176756-21kworker/u8:3+events_unbound22:15:132
4188567991815,2cyclictest223075-21kworker/u8:0+events_unbound23:05:251
4188567991813,4cyclictest187251-21/usr/sbin/munin22:15:151
4188567991812,4cyclictest119578-21diskstats21:10:141
4188565991814,3cyclictest285425-21kworker/u8:5+events_unbound00:15:340
4188565991814,3cyclictest2150176-21kworker/u8:1+flush-259:019:25:400
4188579991715,1cyclictest0-21swapper/319:30:003
4188579991714,2cyclictest324223-21kthreadcore00:25:193
4188579991714,2cyclictest0-21swapper/300:14:593
4188579991713,3cyclictest77422-21cron20:30:013
4188579991713,2cyclictest0-21swapper/323:15:013
4188579991711,4cyclictest166411-21latency_hist21:55:013
418857999170,15cyclictest490-21dbus-daemon21:30:193
418857499178,2cyclictest202439-21idleruntime-cro22:30:002
4188574991714,2cyclictest191858-21kworker/u8:0+events_unbound22:35:222
4188567991714,2cyclictest2150176-21kworker/u8:1+flush-259:020:00:181
4188567991714,2cyclictest2150176-21kworker/u8:1+flush-259:020:00:181
4188567991714,2cyclictest0-21swapper/123:35:011
4188567991713,3cyclictest30853-21apt-get19:45:141
4188567991713,3cyclictest223075-21kworker/u8:0+events_unbound23:25:121
4188567991712,4cyclictest212777-21kworker/u8:3+flush-259:022:50:001
4188565991714,2cyclictest4193654-21kworker/u8:0+events_unbound19:15:240
4188565991714,2cyclictest326996-21kworker/u8:0+events_unbound00:30:330
4188565991713,3cyclictest150393-21kworker/u8:2+events_unbound23:05:230
4188574991614,1cyclictest0-21swapper/220:10:002
4188574991613,2cyclictest72504-21kworker/u8:0+events_unbound20:50:032
4188574991613,2cyclictest490-21dbus-daemon00:15:002
4188574991613,2cyclictest212777-21kworker/u8:3+events_unbound22:50:142
4188574991611,4cyclictest5137-21apt-get19:20:122
4188567991613,2cyclictest82596-21kworker/u8:4+events_unbound21:05:181
4188567991613,2cyclictest150393-21kworker/u8:2+flush-259:023:20:201
4188567991613,2cyclictest140274-21gpgv21:30:011
4188565991614,1cyclictest60350irq/132-enp0s29f1:rx-022:33:330
4188565991613,2cyclictest60350irq/132-enp0s29f1:rx-022:35:150
4188565991613,2cyclictest60350irq/132-enp0s29f1:rx-020:44:560
4188565991612,3cyclictest82596-21kworker/u8:4+events_unbound21:19:560
418857999159,4cyclictest269391-21apt-get23:35:003
418857999159,4cyclictest176717-21latency_hist22:05:013
4188579991512,2cyclictest170649-21ntp_kernel_err21:55:213
4188579991512,1cyclictest0-21swapper/322:45:183
4188579991511,3cyclictest82596-21kworker/u8:4+flush-259:021:35:173
418857499159,4cyclictest296781-21fw_forwarded_lo00:00:162
418857499159,2cyclictest25473-21kworker/u8:0+events_unbound19:40:152
4188574991512,2cyclictest15173-21kworker/u8:2+flush-259:020:15:152
4188574991511,3cyclictest312836-21kworker/u8:2+events_unbound00:20:062
4188567991511,3cyclictest296008-21gpgv00:00:001
4188567991511,3cyclictest223075-21kworker/u8:0+events_unbound23:17:011
4188565991513,2cyclictest156130-21kworker/u8:1+events_unbound21:50:190
4188565991513,1cyclictest60350irq/132-enp0s29f1:rx-023:41:210
4188565991513,1cyclictest60350irq/132-enp0s29f1:rx-023:38:540
4188565991513,1cyclictest60350irq/132-enp0s29f1:rx-023:25:160
4188565991513,1cyclictest60350irq/132-enp0s29f1:rx-021:55:210
4188565991513,1cyclictest60350irq/132-enp0s29f1:rx-020:52:010
4188565991513,1cyclictest60350irq/132-enp0s29f1:rx-020:05:240
4188565991512,2cyclictest61150irq/133-enp0s29f1:tx-022:20:250
4188565991512,2cyclictest2150176-21kworker/u8:1+events_unbound20:10:150
4188565991510,4cyclictest86835-21ntpq20:35:200
4188579991411,2cyclictest0-21swapper/323:10:013
4188579991411,1cyclictest0-21swapper/321:29:593
4188579991410,3cyclictest150393-21kworker/u8:2+flush-259:023:00:283
4188579991410,2cyclictest179796-21kthreadcore22:05:163
4188574991411,2cyclictest82596-21kworker/u8:4+events_unbound20:55:372
4188574991411,2cyclictest258066-21needreboot23:20:192
4188574991411,2cyclictest171144-21unixbench_singl21:55:262
4188574991411,2cyclictest150393-21kworker/u8:2+events_unbound23:05:152
4188574991410,3cyclictest335557-21systemd-journal19:55:192
4188567991411,2cyclictest156130-21kworker/u8:1+events_unbound21:50:211
4188565991412,1cyclictest60350irq/132-enp0s29f1:rx-023:00:170
4188565991412,1cyclictest60350irq/132-enp0s29f1:rx-000:35:190
418857999139,3cyclictest4178291-21kworker/u8:3+flush-259:019:10:223
418857999139,2cyclictest0-21swapper/323:25:173
418857999137,4cyclictest72504-21kworker/u8:0+flush-259:020:45:183
4188579991311,1cyclictest0-21swapper/322:35:013
418857499138,2cyclictest2150176-21kworker/u8:1+events_unbound20:25:132
4188574991310,2cyclictest285425-21kworker/u8:5+events_unbound00:29:562
4188574991310,2cyclictest109081-21kworker/u8:1+events_unbound21:05:132
4188567991311,2cyclictest66391-21kworker/u8:3+events_unbound20:30:011
4188567991310,2cyclictest15173-21kworker/u8:2+events_unbound19:59:571
4188565991311,1cyclictest60350irq/132-enp0s29f1:rx-022:15:280
4188565991311,1cyclictest60350irq/132-enp0s29f1:rx-021:20:090
418857999129,2cyclictest503-21tpm2-abrmd20:35:003
418857999129,2cyclictest290953-21cpuspeed_turbos23:55:113
418857999126,4cyclictest270024-21cp23:35:023
418857999121,8cyclictest10004-21awk19:24:593
418856799129,2cyclictest82596-21kworker/u8:4+events_unbound21:45:191
418856799129,2cyclictest15828-21irqcore19:30:161
4188567991210,2cyclictest119172-21kworker/u8:0+events_unbound21:15:291
418857999119,1cyclictest0-21swapper/320:10:003
418857999119,1cyclictest0-21swapper/319:45:263
418857999118,2cyclictest56668-21cpuspeed_turbos20:10:143
418857999118,2cyclictest4193654-21kworker/u8:0+flush-259:019:15:063
418857999118,2cyclictest318187-21cpuspeed_turbos00:20:113
418857999118,2cyclictest0-21swapper/323:20:003
418857999118,1cyclictest0-21swapper/319:35:003
418857999118,1cyclictest0-21swapper/300:15:133
418857999116,4cyclictest513-21gdbus00:39:593
418856799118,2cyclictest2150176-21kworker/u8:1+events_unbound19:51:041
418857999107,2cyclictest328534-21fschecks_count00:30:143
418857999107,2cyclictest285732-21cpuspeed_turbos23:50:143
418857999106,3cyclictest82596-21kworker/u8:4+flush-259:020:55:213
418857999106,3cyclictest228883-21grep22:55:163
418857999104,4cyclictest335557-21systemd-journal21:15:003
418857999102,1cyclictest2272842ntp_22:50:213
418857999100,2cyclictest208920-21tr22:35:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional