You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-10 - 15:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Mon Aug 10, 2026 00:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31588099550,53cyclictest1-21systemd22:47:000
315884995244,2cyclictest550379-21kworker/u8:4+flush-259:000:35:001
315887995146,3cyclictest482603-21kworker/u8:2+events_unbound21:55:002
315884995148,2cyclictest523608-21kworker/u8:3+flush-259:022:35:001
315884994946,2cyclictest378378-21kworker/u8:0+events_unbound20:40:001
315884994744,2cyclictest383698-21kworker/u8:2+flush-259:020:15:001
315887994336,4cyclictest383966-21latency_hist20:15:012
315884994037,2cyclictest451667-21kworker/u8:0+flush-259:021:35:231
315884994037,2cyclictest337178-21kworker/u8:4+events_unbound20:55:261
315884994036,2cyclictest623447-21kworker/u8:1+events_unbound00:35:201
315884994034,2cyclictest337178-21kworker/u8:4+events_unbound21:00:241
315884993936,2cyclictest523608-21kworker/u8:3+events_unbound22:45:241
315884993834,3cyclictest550379-21kworker/u8:4+events_unbound00:05:261
315880993834,3cyclictest629143-21gpgv00:10:000
315889993733,3cyclictest534917-21/usr/sbin/munin22:40:243
315884993733,3cyclictest607728-21kworker/u8:0+flush-259:023:55:191
315884993733,3cyclictest337178-21kworker/u8:4+events_unbound20:30:211
315884993733,2cyclictest3926592-21kworker/u8:1+events_unbound19:15:201
315889993630,4cyclictest660041-21latency_hist00:40:003
315887993633,2cyclictest257334-21kworker/u8:2+events_unbound19:45:182
315884993633,2cyclictest634227-21kworker/u8:2+events_unbound00:20:131
315884993532,2cyclictest503277-21kworker/u8:0+flush-259:023:05:211
315884993532,2cyclictest503277-21kworker/u8:0+events_unbound22:10:231
315884993531,3cyclictest257334-21kworker/u8:2+events_unbound19:35:171
315884993431,2cyclictest550379-21kworker/u8:4+events_unbound23:20:191
315884993431,2cyclictest3926592-21kworker/u8:1+events_unbound20:10:011
315884993431,2cyclictest378378-21kworker/u8:0+flush-259:020:25:251
315884993431,2cyclictest378378-21kworker/u8:0+flush-259:020:25:241
315884993430,3cyclictest581248-21kworker/u8:0+events_unbound23:25:151
315884993430,3cyclictest550172-21kworker/u8:1+events_unbound23:45:151
315884993430,3cyclictest451667-21kworker/u8:0+events_unbound21:30:241
315884993329,3cyclictest570914-21kworker/u8:3+events_unbound23:35:181
315884993327,4cyclictest451636-21latency_hist21:20:001
315889993225,5cyclictest415042-21latency_hist20:45:003
315887993228,3cyclictest623447-21kworker/u8:1+flush-259:000:25:192
315884993229,2cyclictest430775-21kworker/u8:1+events_unbound21:20:141
315884993229,2cyclictest257334-21kworker/u8:2+flush-259:019:40:231
315884993228,3cyclictest523608-21kworker/u8:3+flush-259:022:40:201
315884993227,2cyclictest430775-21kworker/u8:1+events_unbound21:50:241
315887993125,4cyclictest363293-21latency_hist19:55:002
315884993128,2cyclictest257334-21kworker/u8:2+flush-259:019:10:221
315884993125,4cyclictest446469-21latency_hist21:15:011
31588099310,29cyclictest1-21systemd21:19:330
315884993027,2cyclictest623447-21kworker/u8:1+flush-259:000:25:251
315884993027,2cyclictest337178-21kworker/u8:4+flush-259:020:45:191
315884993026,3cyclictest430775-21kworker/u8:1+flush-259:021:25:161
315884993025,3cyclictest477708-21apt-get21:45:121
315884993023,3cyclictest513636-21kworker/u8:1+events_unbound22:20:141
315887992923,4cyclictest335557-21systemd-journal00:38:342
315884992926,2cyclictest550379-21kworker/u8:4+events_unbound23:10:211
315884992926,2cyclictest550379-21kworker/u8:4+events_unbound00:00:341
315884992926,2cyclictest482603-21kworker/u8:2+flush-259:022:15:161
315884992926,2cyclictest257334-21kworker/u8:2+events_unbound20:04:311
315884992925,3cyclictest523608-21kworker/u8:3+flush-259:022:35:191
315884992925,3cyclictest523608-21kworker/u8:3+flush-259:022:35:191
315884992925,3cyclictest3926592-21kworker/u8:1+events_unbound19:20:181
315884992925,3cyclictest383698-21kworker/u8:2+events_unbound20:20:201
315884992925,3cyclictest257334-21kworker/u8:2+events_unbound19:50:141
315884992922,2cyclictest430775-21kworker/u8:1+events_unbound21:55:221
315889992822,4cyclictest565706-21latency_hist23:10:013
315887992825,2cyclictest430775-21kworker/u8:1+flush-259:021:10:182
315887992824,3cyclictest513636-21kworker/u8:1+flush-259:022:30:212
315887992821,5cyclictest591580-21latency_hist23:35:012
315884992825,2cyclictest550379-21kworker/u8:4+events_unbound23:00:251
315884992825,2cyclictest482603-21kworker/u8:2+flush-259:022:00:261
315884992825,2cyclictest441013-21kworker/u8:2+events_unbound21:10:011
315884992824,3cyclictest550379-21kworker/u8:4+flush-259:022:56:341
315880992823,3cyclictest335557-21systemd-journal20:34:330
315880992821,5cyclictest597003-21store23:40:000
315884992724,2cyclictest550379-21kworker/u8:4+events_unbound23:17:011
315884992719,3cyclictest420254-21kworker/u8:0+events_unbound20:50:171
315889992623,2cyclictest550379-21kworker/u8:4+events_unbound23:04:553
315889992622,3cyclictest628569-21apt-get00:10:023
315889992620,4cyclictest524772-21diskstats22:30:133
315887992623,2cyclictest550379-21kworker/u8:4+events_unbound23:40:232
315887992622,3cyclictest430775-21kworker/u8:1+flush-259:022:05:172
315884992623,2cyclictest550379-21kworker/u8:4+events_unbound23:40:221
315884992620,4cyclictest523062-21ntpq22:25:231
315884992620,4cyclictest523062-21ntpq22:25:221
315880992622,3cyclictest513636-21kworker/u8:1+flush-259:022:30:000
315880992622,3cyclictest513636-21kworker/u8:1+flush-259:022:30:000
315889992523,2cyclictest451667-21kworker/u8:0+events_unbound21:49:553
315889992520,3cyclictest613092-21latency_hist23:55:013
315887992521,3cyclictest523608-21kworker/u8:3+flush-259:022:40:252
315887992520,4cyclictest384201-21/usr/sbin/munin20:15:142
315884992522,2cyclictest503277-21kworker/u8:0+flush-259:022:50:191
315884992522,2cyclictest451667-21kworker/u8:0+events_unbound21:40:121
315884992522,2cyclictest430775-21kworker/u8:1+events_unbound22:06:341
315884992521,3cyclictest410164-21apt-get20:40:131
315880992518,5cyclictest639349-21latency_hist00:19:590
315887992420,3cyclictest257334-21kworker/u8:2+events_unbound19:10:232
315884992420,3cyclictest3926592-21kworker/u8:1+flush-259:019:30:051
315880992416,6cyclictest335557-21systemd-journal22:44:590
315889992317,4cyclictest435283-21ntpq21:00:233
315887992320,2cyclictest3926592-21kworker/u8:1+flush-259:019:55:272
315887992319,3cyclictest337178-21kworker/u8:4+flush-259:020:56:022
315884992320,2cyclictest3926592-21kworker/u8:1+events_unbound19:55:201
315884992319,3cyclictest257334-21kworker/u8:2+events_unbound19:25:151
315880992316,5cyclictest373629-21latency_hist20:05:000
31588999221,19cyclictest1-21systemd22:19:593
315887992218,3cyclictest550379-21kworker/u8:4+events_unbound23:06:222
315887992218,3cyclictest503277-21kworker/u8:0+events_unbound22:18:362
315887992218,3cyclictest462200-21/usr/sbin/munin21:30:172
315887992217,4cyclictest596779-21apt-get23:40:002
315887992217,3cyclictest430775-21kworker/u8:1+flush-259:021:35:152
315887992216,4cyclictest628681-21cp00:09:592
315884992219,2cyclictest570914-21kworker/u8:3+events_unbound23:30:361
315884992218,3cyclictest623447-21kworker/u8:1+events_unbound00:15:251
315880992218,3cyclictest482603-21kworker/u8:2+flush-259:022:15:250
315880992217,3cyclictest3926592-21kworker/u8:1+flush-259:019:59:590
315880992216,4cyclictest342393-21apt-get19:35:150
315880992215,4cyclictest560551-21latency_hist23:05:010
315889992116,4cyclictest607510-21apt-get23:50:013
315889992116,4cyclictest368455-21latency_hist20:00:013
315887992118,2cyclictest257334-21kworker/u8:2+events_unbound20:05:192
315887992117,3cyclictest550172-21kworker/u8:1+events_unbound23:50:192
315887992117,3cyclictest3926592-21kworker/u8:1+events_unbound19:40:172
315887992117,3cyclictest378378-21kworker/u8:0+events_unbound20:25:232
315887992117,3cyclictest378378-21kworker/u8:0+events_unbound20:25:232
315884992118,2cyclictest550172-21kworker/u8:1+events_unbound23:52:311
315884992118,2cyclictest383698-21kworker/u8:2+events_unbound20:15:261
315880992115,4cyclictest528664-21ntpq22:30:200
315880992114,5cyclictest628578-21latency_hist00:10:000
315880992114,5cyclictest585518-21ntpq23:25:200
315880992114,5cyclictest409019-21ntpq20:35:210
315889992017,1cyclictest0-21swapper/320:09:593
315887992018,1cyclictest623447-21kworker/u8:1+events_unbound00:20:212
315887992017,2cyclictest482603-21kworker/u8:2+flush-259:022:10:202
315887992017,2cyclictest337178-21kworker/u8:4+flush-259:020:36:382
315887992016,3cyclictest529548-21kworker/u8:2+events_unbound22:39:342
315887992016,3cyclictest529548-21kworker/u8:2+events_unbound22:39:332
315887992016,3cyclictest513636-21kworker/u8:1+events_unbound22:29:352
315887992016,3cyclictest513636-21kworker/u8:1+events_unbound22:29:342
315887992016,3cyclictest503277-21kworker/u8:0+events_unbound22:52:342
315887992016,3cyclictest451667-21kworker/u8:0+events_unbound21:40:152
315887992016,3cyclictest430775-21kworker/u8:1+flush-259:021:45:252
315887992016,3cyclictest383698-21kworker/u8:2+events_unbound20:20:502
315889991916,2cyclictest550379-21kworker/u8:4+events_unbound00:07:413
315889991914,3cyclictest430775-21kworker/u8:1+flush-259:022:05:223
315887991916,2cyclictest550379-21kworker/u8:4+flush-259:000:10:242
315887991916,2cyclictest257334-21kworker/u8:2+events_unbound19:20:022
315880991913,4cyclictest607613-21cp23:50:010
315889991817,1cyclictest3926592-21kworker/u8:1+events_unbound19:18:563
315889991815,2cyclictest596780-21sh23:40:003
315889991815,2cyclictest441013-21kworker/u8:2+events_unbound21:11:463
315889991814,3cyclictest368730-21apt-get20:00:203
315889991812,4cyclictest335557-21systemd-journal21:10:003
315887991815,2cyclictest550379-21kworker/u8:4+events_unbound00:30:242
315887991815,2cyclictest420254-21kworker/u8:0+events_unbound20:50:212
315887991814,3cyclictest607728-21kworker/u8:0+events_unbound23:55:132
315887991814,3cyclictest503277-21kworker/u8:0+flush-259:022:57:362
315887991814,3cyclictest420254-21kworker/u8:0+events_unbound21:01:352
315887991814,3cyclictest3926592-21kworker/u8:1+events_unbound19:19:332
315887991814,3cyclictest337178-21kworker/u8:4+flush-259:020:43:082
315880991814,3cyclictest3926592-21kworker/u8:1+flush-259:019:20:000
315880991813,3cyclictest608022-21base6423:50:010
315880991813,3cyclictest446456-21cron21:15:000
315880991812,4cyclictest335557-21systemd-journal21:31:430
31588999178,1cyclictest191rcu_preempt20:50:203
315889991714,2cyclictest441013-21kworker/u8:2+events_unbound21:19:053
315889991714,2cyclictest257334-21kworker/u8:2+events_unbound19:25:353
315887991714,2cyclictest545020-21cron22:49:592
315887991713,3cyclictest513636-21kworker/u8:1+events_unbound22:20:252
315887991713,3cyclictest430775-21kworker/u8:1+flush-259:021:59:382
315887991713,3cyclictest3926592-21kworker/u8:1+events_unbound20:00:272
315887991713,3cyclictest337178-21kworker/u8:4+events_unbound20:45:342
315887991713,2cyclictest257334-21kworker/u8:2+events_unbound19:35:192
315880991714,2cyclictest60350irq/132-enp0s29f1:rx-023:40:240
315880991714,2cyclictest352909-21kworker/u8:0+flush-259:019:45:000
31588999168,5cyclictest0-21swapper/320:19:133
31588999161,4cyclictest582331-21sed23:25:153
315889991614,1cyclictest503277-21kworker/u8:0+events_unbound22:26:463
315889991614,1cyclictest503277-21kworker/u8:0+events_unbound22:26:453
315889991614,1cyclictest441013-21kworker/u8:2+events_unbound21:21:483
315889991613,2cyclictest529548-21kworker/u8:2+events_unbound22:36:223
315889991613,2cyclictest529548-21kworker/u8:2+events_unbound22:36:223
315889991613,2cyclictest337178-21kworker/u8:4+events_unbound20:23:453
315889991611,3cyclictest335557-21systemd-journal21:42:333
315887991613,2cyclictest550379-21kworker/u8:4+events_unbound23:50:012
315887991612,3cyclictest482603-21kworker/u8:2+events_unbound22:00:342
315887991612,3cyclictest441013-21kworker/u8:2+events_unbound21:08:332
315887991612,3cyclictest430775-21kworker/u8:1+flush-259:021:20:242
315887991612,3cyclictest378378-21kworker/u8:0+events_unbound20:35:012
315887991611,4cyclictest257334-21kworker/u8:2+events_unbound19:32:352
315884991613,2cyclictest257334-21kworker/u8:2+events_unbound19:49:241
315880991613,2cyclictest61150irq/133-enp0s29f1:tx-020:50:150
315880991612,3cyclictest623447-21kworker/u8:1+flush-259:000:36:210
315880991612,3cyclictest331769-21idleruntime-cro19:25:000
315880991612,2cyclictest60350irq/132-enp0s29f1:rx-021:05:210
315880991612,2cyclictest60350irq/132-enp0s29f1:rx-021:00:010
31588999158,3cyclictest0-21swapper/300:20:443
31588999157,3cyclictest0-21swapper/322:22:043
31588999156,5cyclictest0-21swapper/320:50:013
31588999152,2cyclictest650095-21diskstats00:30:143
31588999151,9cyclictest554444-21gcc22:55:223
31588999151,4cyclictest471542-21/usr/sbin/munin21:35:213
315889991512,2cyclictest508434-21idleruntime-cro22:15:003
315889991512,2cyclictest3926592-21kworker/u8:1+events_unbound19:44:383
315889991512,2cyclictest0-21swapper/323:25:003
315889991511,3cyclictest636741-21kthreadcore00:15:193
315889991511,3cyclictest482603-21kworker/u8:2+flush-259:022:00:273
315889991511,3cyclictest2109693-21snmpd20:30:143
315889991511,1cyclictest191rcu_preempt19:30:333
315887991512,2cyclictest570914-21kworker/u8:3+events_unbound23:17:032
315887991512,2cyclictest550172-21kworker/u8:1+flush-259:023:25:012
315887991511,3cyclictest441013-21kworker/u8:2+flush-259:021:15:202
315887991511,3cyclictest257334-21kworker/u8:2+flush-259:019:25:242
31588099159,4cyclictest379007-21/usr/sbin/munin20:10:240
31588099158,5cyclictest507608-21ntpq22:10:220
315880991513,1cyclictest60350irq/132-enp0s29f1:rx-021:50:210
315880991513,1cyclictest60350irq/132-enp0s29f1:rx-019:12:220
315880991513,1cyclictest60350irq/132-enp0s29f1:rx-000:30:150
315880991512,2cyclictest60350irq/132-enp0s29f1:rx-023:10:140
315880991512,2cyclictest60350irq/132-enp0s29f1:rx-021:35:140
315880991512,2cyclictest60350irq/132-enp0s29f1:rx-020:15:240
315880991512,2cyclictest60350irq/132-enp0s29f1:rx-019:45:120
315880991511,3cyclictest60350irq/132-enp0s29f1:rx-020:25:130
315880991511,3cyclictest60350irq/132-enp0s29f1:rx-020:25:120
315880991511,3cyclictest513877-21apt-get22:20:110
31588999149,4cyclictest257334-21kworker/u8:2+flush-259:019:50:173
31588999147,3cyclictest0-21swapper/323:12:483
31588999142,2cyclictest50-21ksoftirqd/323:30:233
315889991411,2cyclictest430775-21kworker/u8:1+events_unbound21:50:503
315889991411,2cyclictest3926592-21kworker/u8:1+events_unbound19:23:383
315889991411,1cyclictest191rcu_preempt19:12:373
315889991410,1cyclictest191rcu_preempt00:25:573
315889991410,0cyclictest191rcu_preempt19:39:133
31588799149,4cyclictest570914-21kworker/u8:3+events_unbound23:27:032
315887991410,3cyclictest623447-21kworker/u8:1+flush-259:000:15:252
31588099147,4cyclictest492084-21ntpq21:55:190
315880991413,1cyclictest60350irq/132-enp0s29f1:rx-023:16:110
315880991413,1cyclictest60350irq/132-enp0s29f1:rx-020:44:340
315880991413,1cyclictest60350irq/132-enp0s29f1:rx-000:26:540
315880991412,1cyclictest60350irq/132-enp0s29f1:rx-023:59:310
315880991412,1cyclictest60350irq/132-enp0s29f1:rx-022:35:190
315880991412,1cyclictest60350irq/132-enp0s29f1:rx-022:35:190
315880991412,1cyclictest60350irq/132-enp0s29f1:rx-019:51:270
315880991412,1cyclictest60350irq/132-enp0s29f1:rx-000:20:470
315880991411,2cyclictest60350irq/132-enp0s29f1:rx-023:30:240
315880991411,2cyclictest60350irq/132-enp0s29f1:rx-021:26:150
315880991410,2cyclictest0-21swapper/000:00:220
31588999135,1cyclictest0-21swapper/319:45:233
31588999132,3cyclictest50-21ksoftirqd/322:50:183
31588999132,2cyclictest481rcuc/320:25:253
31588999132,2cyclictest481rcuc/320:25:243
31588999131,3cyclictest429664-21ntpq20:55:243
315889991310,2cyclictest618557-21cpuspeed_turbos00:00:153
315887991310,2cyclictest430775-21kworker/u8:1+events_unbound21:28:342
31588099139,3cyclictest60350irq/132-enp0s29f1:rx-021:20:130
31588099137,4cyclictest431220-21/usr/sbin/munin21:00:140
315880991311,1cyclictest60350irq/132-enp0s29f1:rx-023:24:010
315880991311,1cyclictest60350irq/132-enp0s29f1:rx-021:44:320
315880991311,1cyclictest60350irq/132-enp0s29f1:rx-019:25:110
315880991310,2cyclictest61150irq/133-enp0s29f1:tx-020:05:260
31588999128,1cyclictest191rcu_preempt22:45:143
31588999123,4cyclictest50-21ksoftirqd/320:35:223
31588999121,4cyclictest50-21ksoftirqd/321:30:163
315889991211,1cyclictest481rcuc/321:26:193
31588999120,6cyclictest492715-21runrttasks21:57:193
31588999120,3cyclictest50-21ksoftirqd/323:15:213
31588799128,3cyclictest607728-21kworker/u8:0+events_unbound00:00:162
315880991210,1cyclictest60350irq/132-enp0s29f1:rx-023:05:250
315880991210,1cyclictest60350irq/132-enp0s29f1:rx-021:45:150
315880991210,1cyclictest60350irq/132-enp0s29f1:rx-020:45:230
315880991210,1cyclictest60350irq/132-enp0s29f1:rx-019:30:260
31588999119,1cyclictest481rcuc/323:55:053
31588999113,5cyclictest50-21ksoftirqd/320:10:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional