You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-14 - 06:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Thu May 14, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
77264994945,3cyclictest223204-21kworker/u8:2+events_unbound21:30:132
77264994744,2cyclictest109000-21kworker/u8:0+events_unbound20:25:212
77264994743,3cyclictest109000-21kworker/u8:0+events_unbound19:56:532
77264994741,3cyclictest389186-21kworker/u8:0+events_unbound00:20:232
77264994541,3cyclictest109000-21kworker/u8:0+flush-259:019:46:542
77264994441,2cyclictest223204-21kworker/u8:2+events_unbound23:05:232
77264994441,2cyclictest171092-21kworker/u8:1+events_unbound20:42:032
77262994441,2cyclictest212908-21kworker/u8:3+flush-259:022:20:200
77262994440,3cyclictest181497-21kworker/u8:2+events_unbound21:00:210
77267994336,5cyclictest114113-21latency_hist19:45:013
77264994339,3cyclictest98707-21kworker/u8:1+events_unbound19:41:442
77264994239,2cyclictest98707-21kworker/u8:1+events_unbound19:30:232
77264994239,2cyclictest212908-21kworker/u8:3+events_unbound22:05:162
77262994241,1cyclictest223257-21kworker/0:0+pm22:04:280
77264994138,3cyclictest98707-21kworker/u8:1+events_unbound19:35:432
77264994138,2cyclictest305735-21kworker/u8:1+events_unbound23:35:242
77264994037,2cyclictest223204-21kworker/u8:2+events_unbound21:54:432
77264994037,2cyclictest155759-21kworker/u8:2+events_unbound20:30:452
77264994037,2cyclictest140298-21kworker/u8:3+events_unbound20:47:432
77264994036,3cyclictest368092-21kworker/u8:2+events_unbound00:14:432
77267993935,3cyclictest305735-21kworker/u8:1+flush-259:023:55:003
77267993835,2cyclictest82492-21gpgv19:15:003
77267993835,2cyclictest326823-21kworker/u8:3+flush-259:023:49:593
77264993836,2cyclictest155759-21kworker/u8:2+events_unbound20:37:022
77264993835,2cyclictest305735-21kworker/u8:1+events_unbound23:15:152
77264993835,2cyclictest223204-21kworker/u8:2+flush-259:022:52:442
77264993834,3cyclictest98707-21kworker/u8:1+events_unbound20:15:242
77262993835,2cyclictest155759-21kworker/u8:2+flush-259:020:26:590
77264993735,2cyclictest223204-21kworker/u8:2+events_unbound22:40:222
77264993734,2cyclictest305735-21kworker/u8:1+events_unbound23:12:452
77264993734,2cyclictest212908-21kworker/u8:3+events_unbound21:56:442
77262993731,4cyclictest398988-21ntpq00:15:200
77264993634,2cyclictest98707-21kworker/u8:1+events_unbound20:01:422
77264993633,2cyclictest285013-21kworker/u8:0+events_unbound22:36:452
77262993632,3cyclictest326823-21kworker/u8:3+events_unbound23:35:010
77264993533,2cyclictest212908-21kworker/u8:3+events_unbound22:45:232
77264993533,2cyclictest109000-21kworker/u8:0+events_unbound19:50:122
77264993532,2cyclictest61950-21kworker/u8:3+events_unbound19:28:442
77264993532,2cyclictest212908-21kworker/u8:3+events_unbound22:19:432
77262993533,2cyclictest98707-21kworker/u8:1+flush-259:020:10:000
77262993533,2cyclictest98707-21kworker/u8:1+flush-259:020:09:590
77262993532,2cyclictest98707-21kworker/u8:1+flush-259:019:50:190
77262993531,3cyclictest61950-21kworker/u8:3+events_unbound19:17:440
77264993431,2cyclictest109000-21kworker/u8:0+events_unbound21:10:222
77264993430,3cyclictest212908-21kworker/u8:3+events_unbound22:58:442
77262993431,2cyclictest61950-21kworker/u8:3+events_unbound19:35:230
77267993329,3cyclictest410191-21gpgv00:30:003
77267993329,3cyclictest410191-21gpgv00:30:003
77267993327,4cyclictest509-21rs:main3
77267993326,5cyclictest207719-21latency_hist21:15:013
77263993327,4cyclictest252-21systemd-journal20:12:431
77262993330,2cyclictest223204-21kworker/u8:2+flush-259:021:55:210
77262993330,2cyclictest223204-21kworker/u8:2+flush-259:021:50:200
77264993230,2cyclictest326823-21kworker/u8:3+events_unbound23:30:432
77263993229,2cyclictest155759-21kworker/u8:2+flush-259:020:25:441
77263993228,3cyclictest399758-21kworker/u8:1+flush-259:000:21:441
77262993229,2cyclictest98707-21kworker/u8:1+events_unbound20:00:430
77262993229,2cyclictest410819-21kworker/u8:3+events_unbound00:36:450
77262993229,2cyclictest109000-21kworker/u8:0+events_unbound19:55:190
77262993228,3cyclictest368092-21kworker/u8:2+flush-259:000:10:180
77267993127,3cyclictest223204-21kworker/u8:2+flush-259:022:10:143
77264993129,2cyclictest305735-21kworker/u8:1+events_unbound23:03:442
77264993128,2cyclictest326823-21kworker/u8:3+events_unbound23:21:442
77264993128,2cyclictest197417-21kworker/u8:1+events_unbound21:15:162
77263993129,1cyclictest259150-21fwupd22:04:281
77263993124,6cyclictest109000-21kworker/u8:0+flush-259:021:20:141
77262993128,3cyclictest212908-21kworker/u8:3+events_unbound21:32:450
77262993128,2cyclictest410819-21kworker/u8:3+events_unbound00:32:440
77262993128,2cyclictest109000-21kworker/u8:0+flush-259:020:30:160
77262993127,3cyclictest305735-21kworker/u8:1+events_unbound23:28:440
77267993025,4cyclictest285013-21kworker/u8:0+flush-259:022:40:003
77267993025,3cyclictest394426-21gpgv00:15:003
77267993024,4cyclictest275153-21diskstats22:20:133
77264993027,2cyclictest326823-21kworker/u8:3+flush-259:000:05:262
77264993027,2cyclictest212908-21kworker/u8:3+events_unbound22:25:202
77264993026,3cyclictest326823-21kworker/u8:3+flush-259:023:25:152
77263993027,2cyclictest72152-21kworker/u8:0+events_unbound19:20:241
77263993026,3cyclictest155759-21kworker/u8:2+events_unbound20:32:441
77263993023,5cyclictest154815-21ntpq20:20:201
77262993024,2cyclictest197417-21kworker/u8:1+events_unbound21:15:180
77264992927,2cyclictest326823-21kworker/u8:3+events_unbound23:43:452
77264992927,2cyclictest109000-21kworker/u8:0+flush-259:021:05:252
77263992926,2cyclictest98707-21kworker/u8:1+flush-259:019:51:541
77263992925,3cyclictest140298-21kworker/u8:3+events_unbound20:55:211
77263992924,4cyclictest410852-21apt-get00:30:111
77263992924,4cyclictest252-21systemd-journal21:20:001
77262992926,2cyclictest305735-21kworker/u8:1+flush-259:023:35:210
77262992924,3cyclictest252-21systemd-journal20:19:440
77267992823,4cyclictest368092-21kworker/u8:2+flush-259:023:55:163
77267992822,4cyclictest326776-21latency_hist23:10:013
77263992822,5cyclictest135399-21apt-get20:05:111
77263992822,5cyclictest135399-21apt-get20:05:111
77263992821,5cyclictest242884-21ntpq21:45:211
77262992826,2cyclictest109000-21kworker/u8:0+events_unbound19:45:440
77262992825,2cyclictest98707-21kworker/u8:1+flush-259:019:30:440
77262992825,2cyclictest285013-21kworker/u8:0+flush-259:022:30:190
77262992825,2cyclictest109000-21kworker/u8:0+events_unbound21:06:440
77262992821,5cyclictest316872-21diskstats23:00:140
77267992722,4cyclictest368092-21kworker/u8:2+flush-259:000:10:013
77267992720,5cyclictest192231-21latency_hist21:00:013
77263992724,2cyclictest305735-21kworker/u8:1+events_unbound23:40:191
77263992724,2cyclictest212908-21kworker/u8:3+flush-259:022:25:211
77262992725,2cyclictest305735-21kworker/u8:1+flush-259:023:10:240
77262992724,3cyclictest223204-21kworker/u8:2+events_unbound22:13:440
77262992724,2cyclictest326823-21kworker/u8:3+flush-259:023:20:160
77262992724,2cyclictest155759-21kworker/u8:2+events_unbound20:35:170
77262992724,2cyclictest140298-21kworker/u8:3+flush-259:020:45:000
77267992622,3cyclictest410819-21kworker/u8:3+flush-259:000:30:213
77267992621,3cyclictest223204-21kworker/u8:2+flush-259:023:15:003
77263992623,2cyclictest368092-21kworker/u8:2+events_unbound00:28:431
77263992623,2cyclictest368092-21kworker/u8:2+events_unbound00:28:421
77263992623,2cyclictest223204-21kworker/u8:2+flush-259:021:40:441
77262992623,2cyclictest140298-21kworker/u8:3+flush-259:020:45:150
77267992517,6cyclictest316295-21cat23:00:003
77264992522,2cyclictest368092-21kworker/u8:2+events_unbound23:55:162
77264992522,2cyclictest140298-21kworker/u8:3+events_unbound20:50:142
77263992522,2cyclictest212908-21kworker/u8:3+flush-259:022:15:161
77263992521,3cyclictest305735-21kworker/u8:1+events_unbound23:45:441
77263992521,3cyclictest212908-21kworker/u8:3+flush-259:021:30:191
77262992523,2cyclictest109000-21kworker/u8:0+events_unbound21:13:440
77262992522,2cyclictest368092-21kworker/u8:2+events_unbound23:59:440
77262992522,2cyclictest212908-21kworker/u8:3+events_unbound22:50:200
77262992520,3cyclictest186629-21latency_hist20:55:010
77267992420,3cyclictest61950-21kworker/u8:3+flush-259:019:25:243
77267992418,4cyclictest305735-21kworker/u8:1+events_unbound23:30:203
77264992421,2cyclictest305735-21kworker/u8:1+events_unbound00:04:532
77264992420,3cyclictest285013-21kworker/u8:0+events_unbound22:30:262
77264992418,4cyclictest135374-21/usr/sbin/munin20:05:142
77264992418,4cyclictest135374-21/usr/sbin/munin20:05:142
77263992420,3cyclictest305735-21kworker/u8:1+flush-259:023:25:191
77267992320,2cyclictest155759-21kworker/u8:2+events_unbound20:35:233
77267992319,3cyclictest310881-21munin-plugin-st22:55:003
77267992318,3cyclictest252-21systemd-journal19:55:443
77263992321,2cyclictest326823-21kworker/u8:3+events_unbound23:38:451
77263992319,3cyclictest181497-21kworker/u8:2+events_unbound21:01:431
77262992320,3cyclictest61950-21kworker/u8:3+events_unbound19:20:280
77262992319,3cyclictest389186-21kworker/u8:0+events_unbound00:27:450
77262992319,3cyclictest389186-21kworker/u8:0+events_unbound00:27:450
77262992317,5cyclictest252-21systemd-journal21:30:010
77267992217,3cyclictest61950-21kworker/u8:3+flush-259:019:35:163
77264992219,2cyclictest61950-21kworker/u8:3+events_unbound19:21:502
77264992218,3cyclictest181497-21kworker/u8:2+events_unbound21:00:172
77264992217,3cyclictest252-21systemd-journal21:27:092
77263992218,3cyclictest368092-21kworker/u8:2+events_unbound00:15:131
77263992218,3cyclictest326823-21kworker/u8:3+flush-259:000:00:211
77263992218,3cyclictest305735-21kworker/u8:1+events_unbound23:02:271
77263992217,4cyclictest305735-21kworker/u8:1+events_unbound23:52:231
77262992220,2cyclictest212908-21kworker/u8:3+events_unbound22:27:230
77262992219,2cyclictest326823-21kworker/u8:3+events_unbound23:50:200
77262992219,2cyclictest326823-21kworker/u8:3+events_unbound00:00:160
77262992218,3cyclictest212908-21kworker/u8:3+flush-259:022:55:240
77267992115,4cyclictest223204-21kworker/u8:2+flush-259:021:55:003
77264992114,4cyclictest252-21systemd-journal19:10:432
77263992118,2cyclictest98707-21kworker/u8:1+flush-259:020:15:141
77263992117,3cyclictest223204-21kworker/u8:2+events_unbound22:52:261
77262992118,3cyclictest212908-21kworker/u8:3+flush-259:021:20:240
77262992118,2cyclictest223204-21kworker/u8:2+events_unbound21:45:210
77267992013,5cyclictest342279-21latency_hist23:25:013
77264992016,3cyclictest223204-21kworker/u8:2+events_unbound22:04:292
77263992018,1cyclictest285013-21kworker/u8:0+events_unbound22:35:181
77262992017,2cyclictest140298-21kworker/u8:3+flush-259:020:55:190
77267991916,2cyclictest173750-21kthreadcore20:40:173
77267991915,3cyclictest223204-21kworker/u8:2+flush-259:021:45:203
77267991915,3cyclictest109000-21kworker/u8:0+flush-259:020:30:143
77267991914,4cyclictest233805-21apt-get21:40:113
77264991916,2cyclictest98707-21kworker/u8:1+events_unbound20:20:162
77264991916,2cyclictest212908-21kworker/u8:3+events_unbound22:24:432
77264991916,2cyclictest212908-21kworker/u8:3+events_unbound21:35:262
77264991914,4cyclictest326823-21kworker/u8:3+flush-259:023:45:172
77264991910,4cyclictest420894-21latency_hist00:40:002
77263991917,1cyclictest326823-21kworker/u8:3+events_unbound23:20:251
77263991915,3cyclictest72152-21kworker/u8:0+events_unbound19:10:211
77263991915,3cyclictest109000-21kworker/u8:0+events_unbound19:47:441
77263991913,3cyclictest98707-21kworker/u8:1+events_unbound20:00:231
77262991916,2cyclictest61950-21kworker/u8:3+events_unbound19:25:140
77262991916,2cyclictest305735-21kworker/u8:1+events_unbound23:15:250
77262991915,3cyclictest399758-21kworker/u8:1+events_unbound00:22:090
77262991915,3cyclictest305735-21kworker/u8:1+events_unbound23:45:220
77262991914,4cyclictest72152-21kworker/u8:0+events_unbound19:12:440
77267991814,3cyclictest197417-21kworker/u8:1+flush-259:021:10:013
77264991815,3cyclictest223204-21kworker/u8:2+events_unbound21:40:162
77264991815,2cyclictest72152-21kworker/u8:0+events_unbound19:16:482
77264991815,2cyclictest212908-21kworker/u8:3+events_unbound22:10:242
77263991815,3cyclictest285013-21kworker/u8:0+events_unbound22:30:221
77263991815,2cyclictest223204-21kworker/u8:2+flush-259:023:05:181
77263991814,3cyclictest212908-21kworker/u8:3+events_unbound21:26:441
77267991714,2cyclictest72152-21kworker/u8:0+flush-259:019:20:243
77267991714,2cyclictest383126-21ntp_kernel_pll_00:00:193
77267991712,3cyclictest98707-21kworker/u8:1+flush-259:019:50:153
77263991714,2cyclictest109000-21kworker/u8:0+events_unbound19:55:241
77263991713,3cyclictest368092-21kworker/u8:2+events_unbound00:05:151
77263991713,3cyclictest212908-21kworker/u8:3+events_unbound22:07:191
77262991713,3cyclictest61950-21kworker/u8:3+events_unbound19:41:520
77262991713,3cyclictest212908-21kworker/u8:3+events_unbound22:47:260
77267991613,1cyclictest0-21swapper/320:55:013
77267991612,3cyclictest305735-21kworker/u8:1+flush-259:023:35:263
77267991612,3cyclictest109000-21kworker/u8:0+events_unbound20:20:003
77267991611,4cyclictest109000-21kworker/u8:0+flush-259:020:05:163
77267991611,4cyclictest109000-21kworker/u8:0+flush-259:020:05:163
7726499169,5cyclictest252-21systemd-journal20:14:592
77264991613,2cyclictest109000-21kworker/u8:0+events_unbound21:23:442
77264991612,3cyclictest242873-21ntp_kernel_pll_21:45:202
77264991611,1cyclictest191rcu_preempt23:55:012
77263991612,3cyclictest410819-21kworker/u8:3+flush-259:000:35:241
77263991612,3cyclictest223204-21kworker/u8:2+flush-259:021:35:141
77263991612,3cyclictest109000-21kworker/u8:0+events_unbound19:44:431
77263991610,4cyclictest252-21systemd-journal23:20:001
77262991613,2cyclictest60350irq/132-enp0s29f1:rx-020:13:300
77262991613,2cyclictest326823-21kworker/u8:3+events_unbound23:41:440
77262991612,3cyclictest223204-21kworker/u8:2+events_unbound22:15:130
77267991513,1cyclictest0-21swapper/319:45:173
77267991512,2cyclictest2971-21cron20:25:003
77267991512,1cyclictest0-21swapper/322:00:003
77267991510,3cyclictest389186-21kworker/u8:0+flush-259:000:20:243
77267991510,3cyclictest347438-21sh23:30:013
7726499158,5cyclictest252-21systemd-journal00:34:592
7726499153,5cyclictest41-21ksoftirqd/220:55:152
7726399159,5cyclictest77206-21latency_hist19:10:001
77263991512,2cyclictest279857-21sh22:25:001
77263991512,2cyclictest223204-21kworker/u8:2+events_unbound22:44:451
77263991512,2cyclictest0-21swapper/121:10:001
77263991511,3cyclictest72152-21kworker/u8:0+events_unbound19:15:171
77263991511,3cyclictest212908-21kworker/u8:3+events_unbound22:57:291
77263991511,3cyclictest140298-21kworker/u8:3+events_unbound20:45:141
77262991513,1cyclictest60350irq/132-enp0s29f1:rx-021:35:230
77262991512,2cyclictest60350irq/132-enp0s29f1:rx-000:05:100
77262991512,2cyclictest0-21swapper/023:10:010
77267991410,3cyclictest212908-21kworker/u8:3+events_unbound21:30:213
77267991410,2cyclictest197390-21sh21:05:003
7726399148,4cyclictest248910-21latency_hist21:55:001
77263991412,2cyclictest368092-21kworker/u8:2+events_unbound00:10:211
77263991411,2cyclictest212908-21kworker/u8:3+flush-259:022:45:241
77262991413,1cyclictest60350irq/132-enp0s29f1:rx-020:22:230
77262991412,2cyclictest60350irq/132-enp0s29f1:rx-022:07:360
77262991412,1cyclictest60350irq/132-enp0s29f1:rx-022:40:220
77262991410,3cyclictest223204-21kworker/u8:2+flush-259:021:40:150
7726799139,3cyclictest212908-21kworker/u8:3+flush-259:022:05:243
7726399139,3cyclictest326823-21kworker/u8:3+events_unbound23:30:181
7726399139,3cyclictest305735-21kworker/u8:1+flush-259:023:55:261
7726399139,3cyclictest212908-21kworker/u8:3+flush-259:022:10:151
77263991310,2cyclictest2213417-21kworker/u8:2+events_unbound19:25:161
7726299139,3cyclictest212908-21kworker/u8:3+events_unbound22:38:230
7726799129,2cyclictest420958-21latency_hist00:40:003
7726799129,2cyclictest281137-21kthreadcore22:25:173
7726799129,2cyclictest140603-21cpuspeed_turbos20:10:123
7726799128,3cyclictest98707-21kworker/u8:1+flush-259:020:00:343
7726799128,3cyclictest140298-21kworker/u8:3+flush-259:020:45:263
7726799128,2cyclictest0-21swapper/323:00:183
77267991210,1cyclictest0-21swapper/321:40:003
7726399129,2cyclictest2213417-21kworker/u8:2+events_unbound19:34:441
7726399129,2cyclictest140298-21kworker/u8:3+events_unbound20:50:211
7726399129,1cyclictest0-21swapper/123:10:231
7726399128,3cyclictest61950-21kworker/u8:3+events_unbound19:37:441
7726799119,1cyclictest0-21swapper/323:15:133
7726799118,2cyclictest362906-21idleruntime-cro23:45:013
7726799118,2cyclictest0-21swapper/322:00:133
7726799118,2cyclictest0-21swapper/321:25:013
7726799118,2cyclictest0-21swapper/300:15:173
7726399118,2cyclictest155759-21kworker/u8:2+events_unbound20:35:131
7726799108,1cyclictest0-21swapper/322:30:243
7726799107,2cyclictest156044-21cpuspeed_turbos20:25:123
7726799106,3cyclictest223204-21kworker/u8:2+flush-259:022:45:133
7726399107,2cyclictest175326-21needreboot20:40:191
772679997,1cyclictest0-21swapper/321:25:233
772679995,3cyclictest274136-21cat22:15:253
772679985,2cyclictest208999-21kthreadcore21:15:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional